2023-06-08T03:36:43.852 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T03:36:43.854 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi --archive /home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298111 --owner scheduled_xiubli@teuthology --verbose -- /home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298111/orig.config.yaml 2023-06-08T03:36:43.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-08T03:36:43.994 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298111 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7298111' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-08_03:32:08 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-08T03:36:43.995 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-08T03:36:43.996 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-08T03:36:43.997 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-08T03:36:43.999 INFO:teuthology.task.internal:Checking packages... 2023-06-08T03:36:44.028 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-08T03:36:44.029 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-08T03:36:44.029 INFO:teuthology.packaging:ref: None 2023-06-08T03:36:44.029 INFO:teuthology.packaging:tag: None 2023-06-08T03:36:44.030 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-08T03:36:44.030 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:36:44.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-08T03:36:44.250 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313.ga02638f8 2023-06-08T03:36:44.251 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-08T03:36:44.265 INFO:teuthology.task.internal:no buildpackages task found 2023-06-08T03:36:44.266 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-08T03:36:44.274 INFO:teuthology.task.internal:Saving configuration 2023-06-08T03:36:44.290 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-08T03:36:44.301 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T03:36:44.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298111', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-08 03:32:15.539700', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-08T03:36:44.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298111', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-08 03:32:15.541226', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-08T03:36:44.355 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-08T03:36:44.366 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-08T03:36:44.366 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-08T03:36:44.366 INFO:teuthology.run_tasks:Running task console_log... 2023-06-08T03:36:44.457 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a9886cf70>, signals=[15]) 2023-06-08T03:36:44.459 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-08T03:36:44.465 INFO:teuthology.task.internal:Opening connections... 2023-06-08T03:36:44.465 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:36:44.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:36:44.536 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:36:44.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:36:44.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-08T03:36:44.617 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-06-08T03:36:44.639 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-06-08T03:36:44.639 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-06-08T03:36:44.699 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-08T03:36:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T03:36:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-08T03:36:44.702 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-08T03:36:44.702 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-08T03:36:44.702 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-06-08T03:36:44.725 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-06-08T03:36:44.743 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-06-08T03:36:44.743 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-06-08T03:36:44.804 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-06-08T03:36:44.804 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-06-08T03:36:44.804 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-06-08T03:36:44.804 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-06-08T03:36:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-08T03:36:44.806 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T03:36:44.806 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:36:44.806 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T03:36:44.806 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-08T03:36:44.806 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-08T03:36:44.806 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-08T03:36:44.807 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-06-08T03:36:44.833 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-08T03:36:44.843 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-08T03:36:44.849 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-08T03:36:44.849 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2023-06-08T03:36:44.852 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-06-08T03:36:44.868 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-08T03:36:44.874 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-08T03:36:44.875 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2023-06-08T03:36:44.911 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-06-08T03:36:44.935 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-08T03:36:44.992 INFO:teuthology.run_tasks:Running task kernel... 2023-06-08T03:36:45.009 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-06-08T03:36:45.010 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-06-08T03:36:45.010 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-06-08T03:36:45.011 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-08T03:36:45.012 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-08T03:36:45.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:36:45.029 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-06-08T03:36:45.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:36:45.031 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2023-06-08T03:36:45.089 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:45.089 INFO:teuthology.task.kernel:Running kernel on smithi135: 4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:45.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2023-06-08T03:36:45.091 INFO:teuthology.orchestra.run.smithi043.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:45.091 INFO:teuthology.task.kernel:Running kernel on smithi043: 4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:45.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2023-06-08T03:36:46.262 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-06-08T03:36:46.262 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-06-08T03:36:46.280 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-06-08T03:36:46.280 INFO:teuthology.orchestra.run.smithi043.stdout:Unable to read consumer identity 2023-06-08T03:36:50.086 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-08T03:36:50.188 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-08T03:36:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-08T03:36:51.421 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-08T03:36:54.855 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 471 kB/s | 24 kB 00:00 2023-06-08T03:36:54.861 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 464 kB/s | 24 kB 00:00 2023-06-08T03:36:55.549 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-06-08T03:36:55.564 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-06-08T03:36:55.607 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-06-08T03:36:55.608 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2023-06-08T03:36:55.608 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-06-08T03:36:55.621 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-06-08T03:36:55.623 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-06-08T03:36:55.623 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-06-08T03:36:55.729 DEBUG:teuthology.orchestra.run.smithi135:> echo no | sudo yum reinstall kernel || true 2023-06-08T03:36:55.769 DEBUG:teuthology.orchestra.run.smithi043:> echo no | sudo yum reinstall kernel || true 2023-06-08T03:36:56.058 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-06-08T03:36:56.059 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-06-08T03:36:56.116 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-06-08T03:36:56.116 INFO:teuthology.orchestra.run.smithi043.stdout:Unable to read consumer identity 2023-06-08T03:36:56.319 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:02 ago on Thu 08 Jun 2023 03:36:54 AM UTC. 2023-06-08T03:36:56.368 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-08T03:36:56.386 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:02 ago on Thu 08 Jun 2023 03:36:54 AM UTC. 2023-06-08T03:36:56.402 INFO:teuthology.orchestra.run.smithi135.stderr:Error: No packages marked for reinstall. 2023-06-08T03:36:56.432 INFO:teuthology.orchestra.run.smithi043.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-08T03:36:56.448 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum reinstall -y kernel || true 2023-06-08T03:36:56.471 INFO:teuthology.orchestra.run.smithi043.stderr:Error: No packages marked for reinstall. 2023-06-08T03:36:56.518 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum reinstall -y kernel || true 2023-06-08T03:36:56.778 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-06-08T03:36:56.778 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-06-08T03:36:56.866 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-06-08T03:36:56.866 INFO:teuthology.orchestra.run.smithi043.stdout:Unable to read consumer identity 2023-06-08T03:36:57.030 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Thu 08 Jun 2023 03:36:54 AM UTC. 2023-06-08T03:36:57.072 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-08T03:36:57.102 INFO:teuthology.orchestra.run.smithi135.stderr:Error: No packages marked for reinstall. 2023-06-08T03:36:57.132 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:03 ago on Thu 08 Jun 2023 03:36:54 AM UTC. 2023-06-08T03:36:57.148 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2023-06-08T03:36:57.173 INFO:teuthology.orchestra.run.smithi043.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-08T03:36:57.198 INFO:teuthology.orchestra.run.smithi043.stderr:Error: No packages marked for reinstall. 2023-06-08T03:36:57.229 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:57.229 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:57.229 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-06-08T03:36:57.230 DEBUG:teuthology.parallel:result is None 2023-06-08T03:36:57.250 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2023-06-08T03:36:57.331 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:57.332 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-06-08T03:36:57.333 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-06-08T03:36:57.333 DEBUG:teuthology.parallel:result is None 2023-06-08T03:36:57.333 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-08T03:36:57.340 INFO:teuthology.task.internal:Creating test directory... 2023-06-08T03:36:57.340 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-08T03:36:57.342 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-08T03:36:57.362 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-08T03:36:57.370 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-08T03:36:57.376 INFO:teuthology.task.internal:Creating archive directory... 2023-06-08T03:36:57.376 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-08T03:36:57.403 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-08T03:36:57.432 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-08T03:36:57.443 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-08T03:36:57.444 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-08T03:36:57.469 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-08T03:36:57.503 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:36:57.518 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:36:57.541 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:36:57.553 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:36:57.555 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-08T03:36:57.561 INFO:teuthology.task.internal:Configuring sudo... 2023-06-08T03:36:57.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-08T03:36:57.564 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-08T03:36:57.590 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-08T03:36:57.598 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-08T03:36:57.598 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-08T03:36:57.632 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-08T03:36:57.649 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:36:57.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:36:57.785 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:36:57.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:36:57.911 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:36:57.912 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-08T03:36:57.978 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:36:58.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:36:58.070 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:36:58.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:36:58.195 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:36:58.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-08T03:36:58.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2023-06-08T03:36:58.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-06-08T03:36:58.319 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-08T03:36:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-08T03:36:58.837 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-08T03:36:58.845 INFO:teuthology.task.internal:Starting timer... 2023-06-08T03:36:58.845 INFO:teuthology.run_tasks:Running task pcp... 2023-06-08T03:36:58.854 INFO:teuthology.run_tasks:Running task selinux... 2023-06-08T03:36:58.868 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-06-08T03:36:58.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2023-06-08T03:36:58.940 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2023-06-08T03:36:58.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-06-08T03:36:58.995 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2023-06-08T03:36:58.996 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-08T03:36:58.997 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2023-06-08T03:36:59.021 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2023-06-08T03:36:59.022 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-06-08T03:36:59.042 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-06-08T03:36:59.043 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-06-08T03:36:59.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-08T03:36:59.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:36:59.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-08T03:36:59.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:36:59.116 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-08T03:36:59.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2023-06-08T03:36:59.159 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-06-08T03:36:59.187 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-08T03:36:59.196 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-08T03:36:59.203 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-08T03:36:59.334 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-08T03:36:59.355 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-08T03:36:59.356 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-08T03:45:24.628 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-06-08T03:45:24.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-06-08T03:45:24.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:45:24.703 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-06-08T03:45:24.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-06-08T03:45:24.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:45:24.844 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-06-08T03:45:24.909 INFO:teuthology.run_tasks:Running task clock... 2023-06-08T03:45:24.922 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-08T03:45:24.923 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-08T03:45:24.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-08T03:45:24.926 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-08T03:45:24.927 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-08T03:45:24.960 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-08T03:45:24.976 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-08T03:45:24.978 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-08T03:45:24.992 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-08T03:45:25.048 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2023-06-08T03:45:25.061 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2023-06-08T03:45:25.065 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-06-08T03:45:25.076 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-06-08T03:45:25.077 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-08T03:45:25.091 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-08T03:45:25.092 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-08T03:45:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-08T03:45:25.168 INFO:teuthology.orchestra.run.smithi043.stderr:bash: ntpq: command not found 2023-06-08T03:45:25.172 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-08T03:45:25.172 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2023-06-08T03:45:25.172 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.172 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.172 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.172 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.180 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-06-08T03:45:25.183 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-08T03:45:25.183 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-06-08T03:45:25.184 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.184 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.184 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.184 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:45:25.185 INFO:teuthology.run_tasks:Running task install... 2023-06-08T03:45:25.193 DEBUG:teuthology.task.install:project ceph 2023-06-08T03:45:25.193 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-08T03:45:25.193 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-08T03:45:25.194 INFO:teuthology.task.install:Using flavor: default 2023-06-08T03:45:25.199 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-08T03:45:25.200 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-08T03:45:25.200 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-08T03:45:25.201 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:45:25.203 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-08T03:45:25.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:45:25.344 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-08T03:45:25.345 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-08T03:45:25.435 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-08T03:45:25.436 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-08T03:45:25.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-08T03:45:25.643 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:45:25.643 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-08T03:45:25.672 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-08T03:45:25.673 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-08T03:45:25.720 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-08T03:45:25.720 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:45:25.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-08T03:45:25.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-08T03:45:25.752 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-08T03:45:25.753 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-08T03:45:25.821 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-08T03:45:25.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-08T03:45:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-06-08T03:45:25.888 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-06-08T03:45:25.903 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-08T03:45:25.972 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2023-06-08T03:45:25.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2023-06-08T03:45:26.258 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-06-08T03:45:26.363 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-06-08T03:45:26.566 INFO:teuthology.orchestra.run.smithi135.stdout:44 files removed 2023-06-08T03:45:26.618 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-08T03:45:26.661 INFO:teuthology.orchestra.run.smithi043.stdout:44 files removed 2023-06-08T03:45:26.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-08T03:45:26.947 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-06-08T03:45:27.059 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-06-08T03:45:28.042 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 108 kB/s | 80 kB 00:00 2023-06-08T03:45:28.174 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 109 kB/s | 80 kB 00:00 2023-06-08T03:45:28.709 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-06-08T03:45:28.832 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-06-08T03:45:29.308 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 2.6 kB/s | 1.5 kB 00:00 2023-06-08T03:45:29.408 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 2.7 kB/s | 1.5 kB 00:00 2023-06-08T03:45:31.170 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-06-08T03:45:31.942 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-08T03:45:32.756 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-06-08T03:45:33.261 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-06-08T03:45:36.221 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 439 kB/s | 24 kB 00:00 2023-06-08T03:45:36.909 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 459 kB/s | 24 kB 00:00 2023-06-08T03:45:37.090 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-06-08T03:45:37.802 INFO:teuthology.orchestra.run.smithi043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-06-08T03:45:45.049 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-06-08T03:45:46.228 INFO:teuthology.orchestra.run.smithi043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-06-08T03:45:56.114 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:45:56.115 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:45:56.130 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-08T03:45:56.131 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-08T03:45:56.132 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-08T03:45:56.133 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T03:45:56.135 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T03:45:56.139 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-08T03:45:56.140 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:45:56.274 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-06-08T03:45:56.287 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-06-08T03:45:56.287 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-06-08T03:45:56.287 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-06-08T03:45:56.288 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-06-08T03:45:56.288 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-08T03:45:56.288 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-08T03:45:56.288 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-08T03:45:56.288 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-08T03:45:56.288 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-08T03:45:56.289 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-08T03:45:56.289 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-08T03:45:56.291 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-08T03:45:56.291 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-08T03:45:56.291 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-08T03:45:56.291 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-08T03:45:56.291 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-08T03:45:56.292 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-08T03:45:56.293 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-08T03:45:56.294 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-08T03:45:56.295 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-08T03:45:56.296 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-06-08T03:45:56.296 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-08T03:45:56.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-08T03:45:56.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-08T03:45:56.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-08T03:45:56.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-08T03:45:56.297 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-08T03:45:56.298 INFO:teuthology.orchestra.run.smithi135.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-08T03:45:56.299 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-08T03:45:56.300 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-08T03:45:56.301 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-08T03:45:56.302 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-08T03:45:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-08T03:45:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-08T03:45:56.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-08T03:45:56.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-08T03:45:56.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-06-08T03:45:56.308 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql 10 2023-06-08T03:45:56.309 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:45:56.309 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-06-08T03:45:56.309 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-06-08T03:45:56.309 INFO:teuthology.orchestra.run.smithi135.stdout:Install 128 Packages 2023-06-08T03:45:56.309 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 3 Packages 2023-06-08T03:45:56.309 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:45:56.310 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 197 M 2023-06-08T03:45:56.310 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-06-08T03:45:56.700 INFO:teuthology.orchestra.run.smithi135.stdout:(1/131): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-06-08T03:45:57.442 INFO:teuthology.orchestra.run.smithi135.stdout:(2/131): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 1.1 MB/s | 848 kB 00:00 2023-06-08T03:45:57.618 INFO:teuthology.orchestra.run.smithi135.stdout:(3/131): ceph-immutable-object-cache-18.0.0-431 945 kB/s | 166 kB 00:00 2023-06-08T03:45:58.236 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:45:58.238 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:45:58.253 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-08T03:45:58.254 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-08T03:45:58.255 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-08T03:45:58.256 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T03:45:58.259 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T03:45:58.262 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-08T03:45:58.263 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:45:58.405 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-06-08T03:45:58.419 INFO:teuthology.orchestra.run.smithi043.stdout:=========================================================================================================================== 2023-06-08T03:45:58.419 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout:=========================================================================================================================== 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-08T03:45:58.420 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-08T03:45:58.421 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-08T03:45:58.422 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-08T03:45:58.423 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-08T03:45:58.424 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-08T03:45:58.424 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-08T03:45:58.424 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-08T03:45:58.424 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-08T03:45:58.424 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-08T03:45:58.424 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-08T03:45:58.425 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-08T03:45:58.425 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-08T03:45:58.425 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-08T03:45:58.425 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2023-06-08T03:45:58.425 INFO:teuthology.orchestra.run.smithi043.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-08T03:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-08T03:45:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-08T03:45:58.428 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-08T03:45:58.429 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-08T03:45:58.430 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-08T03:45:58.431 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-08T03:45:58.432 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-08T03:45:58.433 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-08T03:45:58.434 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-08T03:45:58.435 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-08T03:45:58.436 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-08T03:45:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling module streams: 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql 10 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-06-08T03:45:58.438 INFO:teuthology.orchestra.run.smithi043.stdout:=========================================================================================================================== 2023-06-08T03:45:58.439 INFO:teuthology.orchestra.run.smithi043.stdout:Install 128 Packages 2023-06-08T03:45:58.439 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 3 Packages 2023-06-08T03:45:58.439 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:45:58.439 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 197 M 2023-06-08T03:45:58.440 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-06-08T03:45:58.634 INFO:teuthology.orchestra.run.smithi135.stdout:(4/131): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-06-08T03:45:58.887 INFO:teuthology.orchestra.run.smithi043.stdout:(1/131): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-06-08T03:45:59.052 INFO:teuthology.orchestra.run.smithi135.stdout:(5/131): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 3.7 MB/s | 1.5 MB 00:00 2023-06-08T03:45:59.887 INFO:teuthology.orchestra.run.smithi043.stdout:(2/131): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 848 kB/s | 848 kB 00:00 2023-06-08T03:45:59.952 INFO:teuthology.orchestra.run.smithi135.stdout:(6/131): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 5.1 MB/s | 4.6 MB 00:00 2023-06-08T03:45:59.996 INFO:teuthology.orchestra.run.smithi043.stdout:(3/131): ceph-immutable-object-cache-18.0.0-431 1.5 MB/s | 166 kB 00:00 2023-06-08T03:46:00.812 INFO:teuthology.orchestra.run.smithi043.stdout:(4/131): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 2.8 MB/s | 2.3 MB 00:00 2023-06-08T03:46:01.221 INFO:teuthology.orchestra.run.smithi043.stdout:(5/131): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 3.8 MB/s | 1.5 MB 00:00 2023-06-08T03:46:02.063 INFO:teuthology.orchestra.run.smithi043.stdout:(6/131): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 5.5 MB/s | 4.6 MB 00:00 2023-06-08T03:46:02.160 INFO:teuthology.orchestra.run.smithi135.stdout:(7/131): ceph-base-18.0.0-4313.ga02638f8.el8.x8 967 kB/s | 5.4 MB 00:05 2023-06-08T03:46:02.772 INFO:teuthology.orchestra.run.smithi043.stdout:(7/131): ceph-base-18.0.0-4313.ga02638f8.el8.x8 1.3 MB/s | 5.4 MB 00:04 2023-06-08T03:46:03.070 INFO:teuthology.orchestra.run.smithi135.stdout:(8/131): ceph-osd-18.0.0-4313.ga02638f8.el8.x86 5.7 MB/s | 18 MB 00:03 2023-06-08T03:46:03.145 INFO:teuthology.orchestra.run.smithi135.stdout:(9/131): ceph-selinux-18.0.0-4313.ga02638f8.el8 326 kB/s | 24 kB 00:00 2023-06-08T03:46:04.330 INFO:teuthology.orchestra.run.smithi043.stdout:(8/131): ceph-osd-18.0.0-4313.ga02638f8.el8.x86 7.8 MB/s | 18 MB 00:02 2023-06-08T03:46:04.389 INFO:teuthology.orchestra.run.smithi043.stdout:(9/131): ceph-selinux-18.0.0-4313.ga02638f8.el8 420 kB/s | 24 kB 00:00 2023-06-08T03:46:07.030 INFO:teuthology.orchestra.run.smithi043.stdout:(10/131): ceph-radosgw-18.0.0-4313.ga02638f8.el 3.1 MB/s | 13 MB 00:04 2023-06-08T03:46:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:(11/131): cephfs-mirror-18.0.0-4313.ga02638f8.e 2.3 MB/s | 258 kB 00:00 2023-06-08T03:46:07.222 INFO:teuthology.orchestra.run.smithi043.stdout:(12/131): libcephfs-devel-18.0.0-4313.ga02638f8 373 kB/s | 31 kB 00:00 2023-06-08T03:46:07.473 INFO:teuthology.orchestra.run.smithi043.stdout:(13/131): libcephfs2-18.0.0-4313.ga02638f8.el8. 3.0 MB/s | 771 kB 00:00 2023-06-08T03:46:07.581 INFO:teuthology.orchestra.run.smithi043.stdout:(14/131): libcephsqlite-18.0.0-4313.ga02638f8.e 1.2 MB/s | 137 kB 00:00 2023-06-08T03:46:07.690 INFO:teuthology.orchestra.run.smithi043.stdout:(15/131): librados-devel-18.0.0-4313.ga02638f8. 1.3 MB/s | 139 kB 00:00 2023-06-08T03:46:07.890 INFO:teuthology.orchestra.run.smithi043.stdout:(16/131): libradosstriper1-18.0.0-4313.ga02638f 2.3 MB/s | 473 kB 00:00 2023-06-08T03:46:08.657 INFO:teuthology.orchestra.run.smithi043.stdout:(17/131): ceph-common-18.0.0-4313.ga02638f8.el8 2.1 MB/s | 22 MB 00:10 2023-06-08T03:46:08.758 INFO:teuthology.orchestra.run.smithi043.stdout:(18/131): python3-ceph-argparse-18.0.0-4313.ga0 448 kB/s | 45 kB 00:00 2023-06-08T03:46:08.850 INFO:teuthology.orchestra.run.smithi043.stdout:(19/131): python3-ceph-common-18.0.0-4313.ga026 1.3 MB/s | 119 kB 00:00 2023-06-08T03:46:09.017 INFO:teuthology.orchestra.run.smithi043.stdout:(20/131): python3-cephfs-18.0.0-4313.ga02638f8. 1.2 MB/s | 197 kB 00:00 2023-06-08T03:46:09.225 INFO:teuthology.orchestra.run.smithi043.stdout:(21/131): python3-rados-18.0.0-4313.ga02638f8.e 1.7 MB/s | 370 kB 00:00 2023-06-08T03:46:09.434 INFO:teuthology.orchestra.run.smithi043.stdout:(22/131): python3-rbd-18.0.0-4313.ga02638f8.el8 1.7 MB/s | 365 kB 00:00 2023-06-08T03:46:09.542 INFO:teuthology.orchestra.run.smithi043.stdout:(23/131): python3-rgw-18.0.0-4313.ga02638f8.el8 987 kB/s | 107 kB 00:00 2023-06-08T03:46:09.643 INFO:teuthology.orchestra.run.smithi043.stdout:(24/131): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 945 kB/s | 94 kB 00:00 2023-06-08T03:46:09.727 INFO:teuthology.orchestra.run.smithi043.stdout:(25/131): librgw2-18.0.0-4313.ga02638f8.el8.x86 3.6 MB/s | 6.5 MB 00:01 2023-06-08T03:46:09.827 INFO:teuthology.orchestra.run.smithi043.stdout:(26/131): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 1.8 MB/s | 179 kB 00:00 2023-06-08T03:46:09.902 INFO:teuthology.orchestra.run.smithi043.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4313.g 308 kB/s | 23 kB 00:00 2023-06-08T03:46:09.977 INFO:teuthology.orchestra.run.smithi043.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4313.ga02638f 1.7 MB/s | 128 kB 00:00 2023-06-08T03:46:10.161 INFO:teuthology.orchestra.run.smithi135.stdout:(10/131): ceph-common-18.0.0-4313.ga02638f8.el8 1.6 MB/s | 22 MB 00:13 2023-06-08T03:46:10.386 INFO:teuthology.orchestra.run.smithi135.stdout:(11/131): cephfs-mirror-18.0.0-4313.ga02638f8.e 1.1 MB/s | 258 kB 00:00 2023-06-08T03:46:10.411 INFO:teuthology.orchestra.run.smithi043.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4313.ga0263 3.9 MB/s | 1.7 MB 00:00 2023-06-08T03:46:10.462 INFO:teuthology.orchestra.run.smithi135.stdout:(12/131): libcephfs-devel-18.0.0-4313.ga02638f8 414 kB/s | 31 kB 00:00 2023-06-08T03:46:10.945 INFO:teuthology.orchestra.run.smithi135.stdout:(13/131): libcephfs2-18.0.0-4313.ga02638f8.el8. 1.6 MB/s | 771 kB 00:00 2023-06-08T03:46:11.054 INFO:teuthology.orchestra.run.smithi135.stdout:(14/131): libcephsqlite-18.0.0-4313.ga02638f8.e 1.2 MB/s | 137 kB 00:00 2023-06-08T03:46:11.155 INFO:teuthology.orchestra.run.smithi135.stdout:(15/131): librados-devel-18.0.0-4313.ga02638f8. 1.4 MB/s | 139 kB 00:00 2023-06-08T03:46:11.195 INFO:teuthology.orchestra.run.smithi043.stdout:(30/131): ceph-test-18.0.0-4313.ga02638f8.el8.x 6.0 MB/s | 41 MB 00:06 2023-06-08T03:46:11.253 INFO:teuthology.orchestra.run.smithi043.stdout:(31/131): rbd-mirror-18.0.0-4313.ga02638f8.el8. 2.1 MB/s | 3.4 MB 00:01 2023-06-08T03:46:11.312 INFO:teuthology.orchestra.run.smithi043.stdout:(32/131): ceph-mgr-modules-core-18.0.0-4313.ga0 2.0 MB/s | 240 kB 00:00 2023-06-08T03:46:11.346 INFO:teuthology.orchestra.run.smithi043.stdout:(33/131): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 517 kB/s | 47 kB 00:00 2023-06-08T03:46:11.387 INFO:teuthology.orchestra.run.smithi043.stdout:(34/131): ceph-prometheus-alerts-18.0.0-4313.ga 193 kB/s | 15 kB 00:00 2023-06-08T03:46:11.422 INFO:teuthology.orchestra.run.smithi135.stdout:(16/131): libradosstriper1-18.0.0-4313.ga02638f 1.7 MB/s | 473 kB 00:00 2023-06-08T03:46:11.463 INFO:teuthology.orchestra.run.smithi043.stdout:(35/131): cephadm-18.0.0-4313.ga02638f8.el8.noa 2.1 MB/s | 160 kB 00:00 2023-06-08T03:46:11.513 INFO:teuthology.orchestra.run.smithi043.stdout:(36/131): ceph-volume-18.0.0-4313.ga02638f8.el8 1.5 MB/s | 258 kB 00:00 2023-06-08T03:46:11.538 INFO:teuthology.orchestra.run.smithi043.stdout:(37/131): cephfs-top-18.0.0-4313.ga02638f8.el8. 239 kB/s | 18 kB 00:00 2023-06-08T03:46:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 191 kB/s | 59 kB 00:00 2023-06-08T03:46:11.914 INFO:teuthology.orchestra.run.smithi043.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-06-08T03:46:11.972 INFO:teuthology.orchestra.run.smithi135.stdout:(17/131): ceph-radosgw-18.0.0-4313.ga02638f8.el 1.3 MB/s | 13 MB 00:09 2023-06-08T03:46:11.989 INFO:teuthology.orchestra.run.smithi043.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 643 kB/s | 306 kB 00:00 2023-06-08T03:46:12.064 INFO:teuthology.orchestra.run.smithi043.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2023-06-08T03:46:12.072 INFO:teuthology.orchestra.run.smithi135.stdout:(18/131): python3-ceph-argparse-18.0.0-4313.ga0 449 kB/s | 45 kB 00:00 2023-06-08T03:46:12.090 INFO:teuthology.orchestra.run.smithi043.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.6 MB/s | 476 kB 00:00 2023-06-08T03:46:12.164 INFO:teuthology.orchestra.run.smithi135.stdout:(19/131): python3-ceph-common-18.0.0-4313.ga026 1.3 MB/s | 119 kB 00:00 2023-06-08T03:46:12.323 INFO:teuthology.orchestra.run.smithi135.stdout:(20/131): python3-cephfs-18.0.0-4313.ga02638f8. 1.2 MB/s | 197 kB 00:00 2023-06-08T03:46:12.348 INFO:teuthology.orchestra.run.smithi043.stdout:(43/131): ceph-mgr-diskprediction-local-18.0.0- 3.8 MB/s | 7.4 MB 00:01 2023-06-08T03:46:12.507 INFO:teuthology.orchestra.run.smithi043.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 79 kB/s | 33 kB 00:00 2023-06-08T03:46:12.540 INFO:teuthology.orchestra.run.smithi135.stdout:(21/131): python3-rados-18.0.0-4313.ga02638f8.e 1.7 MB/s | 370 kB 00:00 2023-06-08T03:46:12.557 INFO:teuthology.orchestra.run.smithi043.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 78 kB/s | 16 kB 00:00 2023-06-08T03:46:12.583 INFO:teuthology.orchestra.run.smithi043.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 358 kB/s | 185 kB 00:00 2023-06-08T03:46:12.608 INFO:teuthology.orchestra.run.smithi043.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-06-08T03:46:12.650 INFO:teuthology.orchestra.run.smithi043.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-06-08T03:46:12.675 INFO:teuthology.orchestra.run.smithi043.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-06-08T03:46:12.699 INFO:teuthology.orchestra.run.smithi135.stdout:(22/131): python3-rbd-18.0.0-4313.ga02638f8.el8 2.2 MB/s | 365 kB 00:00 2023-06-08T03:46:12.717 INFO:teuthology.orchestra.run.smithi043.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2023-06-08T03:46:12.766 INFO:teuthology.orchestra.run.smithi135.stdout:(23/131): python3-rgw-18.0.0-4313.ga02638f8.el8 1.6 MB/s | 107 kB 00:00 2023-06-08T03:46:12.809 INFO:teuthology.orchestra.run.smithi043.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-06-08T03:46:12.833 INFO:teuthology.orchestra.run.smithi135.stdout:(24/131): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 1.4 MB/s | 94 kB 00:00 2023-06-08T03:46:12.884 INFO:teuthology.orchestra.run.smithi043.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 782 kB/s | 59 kB 00:00 2023-06-08T03:46:12.976 INFO:teuthology.orchestra.run.smithi043.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 658 kB/s | 60 kB 00:00 2023-06-08T03:46:13.043 INFO:teuthology.orchestra.run.smithi043.stdout:(54/131): python3-cherrypy-18.4.0-1.el8.noarch. 791 kB/s | 384 kB 00:00 2023-06-08T03:46:13.102 INFO:teuthology.orchestra.run.smithi043.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-06-08T03:46:13.127 INFO:teuthology.orchestra.run.smithi043.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-06-08T03:46:13.169 INFO:teuthology.orchestra.run.smithi043.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 504 kB/s | 34 kB 00:00 2023-06-08T03:46:13.203 INFO:teuthology.orchestra.run.smithi043.stdout:(58/131): python3-kubernetes-11.0.0-6.el8.noarc 2.2 MB/s | 1.2 MB 00:00 2023-06-08T03:46:13.228 INFO:teuthology.orchestra.run.smithi043.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-06-08T03:46:13.253 INFO:teuthology.orchestra.run.smithi043.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 733 kB/s | 61 kB 00:00 2023-06-08T03:46:13.279 INFO:teuthology.orchestra.run.smithi043.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-06-08T03:46:13.296 INFO:teuthology.orchestra.run.smithi043.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2023-06-08T03:46:13.312 INFO:teuthology.orchestra.run.smithi043.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 497 kB/s | 29 kB 00:00 2023-06-08T03:46:13.338 INFO:teuthology.orchestra.run.smithi043.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 468 kB/s | 27 kB 00:00 2023-06-08T03:46:13.413 INFO:teuthology.orchestra.run.smithi043.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-06-08T03:46:13.447 INFO:teuthology.orchestra.run.smithi043.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 565 kB/s | 61 kB 00:00 2023-06-08T03:46:13.480 INFO:teuthology.orchestra.run.smithi043.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-06-08T03:46:13.506 INFO:teuthology.orchestra.run.smithi043.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 927 kB/s | 85 kB 00:00 2023-06-08T03:46:13.522 INFO:teuthology.orchestra.run.smithi043.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-06-08T03:46:13.548 INFO:teuthology.orchestra.run.smithi043.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-06-08T03:46:13.631 INFO:teuthology.orchestra.run.smithi043.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-06-08T03:46:13.657 INFO:teuthology.orchestra.run.smithi043.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-06-08T03:46:13.699 INFO:teuthology.orchestra.run.smithi043.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-06-08T03:46:13.733 INFO:teuthology.orchestra.run.smithi135.stdout:(25/131): ceph-test-18.0.0-4313.ga02638f8.el8.x 3.8 MB/s | 41 MB 00:10 2023-06-08T03:46:13.741 INFO:teuthology.orchestra.run.smithi043.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-06-08T03:46:13.826 INFO:teuthology.orchestra.run.smithi135.stdout:(26/131): librgw2-18.0.0-4313.ga02638f8.el8.x86 2.7 MB/s | 6.5 MB 00:02 2023-06-08T03:46:13.849 INFO:teuthology.orchestra.run.smithi043.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 359 kB/s | 39 kB 00:00 2023-06-08T03:46:13.850 INFO:teuthology.orchestra.run.smithi135.stdout:(27/131): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 1.5 MB/s | 179 kB 00:00 2023-06-08T03:46:13.901 INFO:teuthology.orchestra.run.smithi135.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4313.ga02638f 2.5 MB/s | 128 kB 00:00 2023-06-08T03:46:13.926 INFO:teuthology.orchestra.run.smithi135.stdout:(29/131): ceph-grafana-dashboards-18.0.0-4313.g 229 kB/s | 23 kB 00:00 2023-06-08T03:46:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 2.8 MB/s | 688 kB 00:00 2023-06-08T03:46:14.127 INFO:teuthology.orchestra.run.smithi135.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4313.ga0263 7.6 MB/s | 1.7 MB 00:00 2023-06-08T03:46:14.141 INFO:teuthology.orchestra.run.smithi043.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-06-08T03:46:14.183 INFO:teuthology.orchestra.run.smithi043.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-06-08T03:46:14.193 INFO:teuthology.orchestra.run.smithi135.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4313.ga0 3.5 MB/s | 240 kB 00:00 2023-06-08T03:46:14.217 INFO:teuthology.orchestra.run.smithi043.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-06-08T03:46:14.236 INFO:teuthology.orchestra.run.smithi135.stdout:(32/131): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 1.1 MB/s | 47 kB 00:00 2023-06-08T03:46:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-06-08T03:46:14.277 INFO:teuthology.orchestra.run.smithi135.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4313.ga 349 kB/s | 15 kB 00:00 2023-06-08T03:46:14.344 INFO:teuthology.orchestra.run.smithi135.stdout:(34/131): ceph-volume-18.0.0-4313.ga02638f8.el8 3.8 MB/s | 258 kB 00:00 2023-06-08T03:46:14.395 INFO:teuthology.orchestra.run.smithi135.stdout:(35/131): rbd-mirror-18.0.0-4313.ga02638f8.el8. 2.2 MB/s | 3.4 MB 00:01 2023-06-08T03:46:14.420 INFO:teuthology.orchestra.run.smithi135.stdout:(36/131): cephadm-18.0.0-4313.ga02638f8.el8.noa 2.1 MB/s | 160 kB 00:00 2023-06-08T03:46:14.445 INFO:teuthology.orchestra.run.smithi043.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 15 MB/s | 14 MB 00:00 2023-06-08T03:46:14.485 INFO:teuthology.orchestra.run.smithi043.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 681 kB/s | 27 kB 00:00 2023-06-08T03:46:14.487 INFO:teuthology.orchestra.run.smithi135.stdout:(37/131): cephfs-top-18.0.0-4313.ga02638f8.el8. 195 kB/s | 18 kB 00:00 2023-06-08T03:46:14.527 INFO:teuthology.orchestra.run.smithi043.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-06-08T03:46:14.547 INFO:teuthology.orchestra.run.smithi135.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.4 MB/s | 306 kB 00:00 2023-06-08T03:46:14.560 INFO:teuthology.orchestra.run.smithi043.stdout:(84/131): thrift-0.13.0-2.el8.x86_64.rpm 1.6 MB/s | 1.7 MB 00:01 2023-06-08T03:46:14.580 INFO:teuthology.orchestra.run.smithi135.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 639 kB/s | 59 kB 00:00 2023-06-08T03:46:14.586 INFO:teuthology.orchestra.run.smithi043.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 753 kB/s | 44 kB 00:00 2023-06-08T03:46:14.605 INFO:teuthology.orchestra.run.smithi135.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-06-08T03:46:14.644 INFO:teuthology.orchestra.run.smithi043.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-06-08T03:46:14.647 INFO:teuthology.orchestra.run.smithi135.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-06-08T03:46:14.673 INFO:teuthology.orchestra.run.smithi135.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.0 MB/s | 476 kB 00:00 2023-06-08T03:46:14.690 INFO:teuthology.orchestra.run.smithi135.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-06-08T03:46:14.715 INFO:teuthology.orchestra.run.smithi135.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 785 kB/s | 33 kB 00:00 2023-06-08T03:46:14.720 INFO:teuthology.orchestra.run.smithi043.stdout:(87/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-06-08T03:46:14.741 INFO:teuthology.orchestra.run.smithi135.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 323 kB/s | 16 kB 00:00 2023-06-08T03:46:14.745 INFO:teuthology.orchestra.run.smithi043.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-06-08T03:46:14.766 INFO:teuthology.orchestra.run.smithi135.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-06-08T03:46:14.770 INFO:teuthology.orchestra.run.smithi043.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-06-08T03:46:14.795 INFO:teuthology.orchestra.run.smithi043.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-06-08T03:46:14.808 INFO:teuthology.orchestra.run.smithi135.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2023-06-08T03:46:14.821 INFO:teuthology.orchestra.run.smithi043.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 400 kB/s | 20 kB 00:00 2023-06-08T03:46:14.833 INFO:teuthology.orchestra.run.smithi135.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-06-08T03:46:14.846 INFO:teuthology.orchestra.run.smithi043.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-06-08T03:46:14.859 INFO:teuthology.orchestra.run.smithi135.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-06-08T03:46:14.896 INFO:teuthology.orchestra.run.smithi043.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-06-08T03:46:14.905 INFO:teuthology.orchestra.run.smithi135.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 244 kB/s | 18 kB 00:00 2023-06-08T03:46:14.938 INFO:teuthology.orchestra.run.smithi043.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-06-08T03:46:14.951 INFO:teuthology.orchestra.run.smithi135.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-06-08T03:46:14.976 INFO:teuthology.orchestra.run.smithi135.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 692 kB/s | 49 kB 00:00 2023-06-08T03:46:14.997 INFO:teuthology.orchestra.run.smithi043.stdout:(95/131): python3-numpy-1.14.3-10.el8.x86_64.rp 8.6 MB/s | 3.7 MB 00:00 2023-06-08T03:46:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-06-08T03:46:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-06-08T03:46:15.039 INFO:teuthology.orchestra.run.smithi043.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-06-08T03:46:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-06-08T03:46:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 309 kB/s | 16 kB 00:00 2023-06-08T03:46:15.081 INFO:teuthology.orchestra.run.smithi043.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-06-08T03:46:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 668 kB/s | 34 kB 00:00 2023-06-08T03:46:15.129 INFO:teuthology.orchestra.run.smithi135.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-06-08T03:46:15.154 INFO:teuthology.orchestra.run.smithi135.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-06-08T03:46:15.156 INFO:teuthology.orchestra.run.smithi043.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-06-08T03:46:15.180 INFO:teuthology.orchestra.run.smithi135.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 370 kB/s | 19 kB 00:00 2023-06-08T03:46:15.205 INFO:teuthology.orchestra.run.smithi135.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2023-06-08T03:46:15.222 INFO:teuthology.orchestra.run.smithi135.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 696 kB/s | 29 kB 00:00 2023-06-08T03:46:15.240 INFO:teuthology.orchestra.run.smithi043.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-06-08T03:46:15.248 INFO:teuthology.orchestra.run.smithi135.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 656 kB/s | 27 kB 00:00 2023-06-08T03:46:15.273 INFO:teuthology.orchestra.run.smithi135.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-06-08T03:46:15.298 INFO:teuthology.orchestra.run.smithi135.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-06-08T03:46:15.299 INFO:teuthology.orchestra.run.smithi043.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-06-08T03:46:15.315 INFO:teuthology.orchestra.run.smithi135.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-06-08T03:46:15.323 INFO:teuthology.orchestra.run.smithi043.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-06-08T03:46:15.370 INFO:teuthology.orchestra.run.smithi135.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-06-08T03:46:15.374 INFO:teuthology.orchestra.run.smithi043.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-06-08T03:46:15.391 INFO:teuthology.orchestra.run.smithi135.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-06-08T03:46:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-06-08T03:46:15.408 INFO:teuthology.orchestra.run.smithi135.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 70 kB 00:00 2023-06-08T03:46:15.416 INFO:teuthology.orchestra.run.smithi043.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-06-08T03:46:15.441 INFO:teuthology.orchestra.run.smithi043.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-06-08T03:46:15.467 INFO:teuthology.orchestra.run.smithi043.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 957 kB/s | 48 kB 00:00 2023-06-08T03:46:15.467 INFO:teuthology.orchestra.run.smithi135.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 18 MB/s | 1.7 MB 00:00 2023-06-08T03:46:15.492 INFO:teuthology.orchestra.run.smithi043.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-08T03:46:15.517 INFO:teuthology.orchestra.run.smithi135.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-06-08T03:46:15.518 INFO:teuthology.orchestra.run.smithi043.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 847 kB/s | 43 kB 00:00 2023-06-08T03:46:15.543 INFO:teuthology.orchestra.run.smithi043.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-06-08T03:46:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-06-08T03:46:15.568 INFO:teuthology.orchestra.run.smithi043.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-06-08T03:46:15.601 INFO:teuthology.orchestra.run.smithi135.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-06-08T03:46:15.602 INFO:teuthology.orchestra.run.smithi043.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-06-08T03:46:15.627 INFO:teuthology.orchestra.run.smithi043.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-06-08T03:46:15.643 INFO:teuthology.orchestra.run.smithi135.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-06-08T03:46:15.652 INFO:teuthology.orchestra.run.smithi043.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-06-08T03:46:15.677 INFO:teuthology.orchestra.run.smithi135.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-06-08T03:46:15.719 INFO:teuthology.orchestra.run.smithi043.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.9 MB/s | 5.1 MB 00:00 2023-06-08T03:46:15.736 INFO:teuthology.orchestra.run.smithi135.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-06-08T03:46:15.745 INFO:teuthology.orchestra.run.smithi043.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 195 kB/s | 18 kB 00:00 2023-06-08T03:46:15.778 INFO:teuthology.orchestra.run.smithi043.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-06-08T03:46:15.804 INFO:teuthology.orchestra.run.smithi043.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-06-08T03:46:15.818 INFO:teuthology.orchestra.run.smithi135.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.4 MB/s | 538 kB 00:00 2023-06-08T03:46:15.829 INFO:teuthology.orchestra.run.smithi043.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-06-08T03:46:15.854 INFO:teuthology.orchestra.run.smithi043.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-06-08T03:46:15.861 INFO:teuthology.orchestra.run.smithi135.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.6 MB/s | 157 kB 00:00 2023-06-08T03:46:15.879 INFO:teuthology.orchestra.run.smithi043.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-06-08T03:46:15.896 INFO:teuthology.orchestra.run.smithi043.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-06-08T03:46:15.922 INFO:teuthology.orchestra.run.smithi043.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-06-08T03:46:15.938 INFO:teuthology.orchestra.run.smithi043.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-06-08T03:46:15.955 INFO:teuthology.orchestra.run.smithi043.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-06-08T03:46:15.989 INFO:teuthology.orchestra.run.smithi043.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 12 MB/s | 644 kB 00:00 2023-06-08T03:46:16.003 INFO:teuthology.orchestra.run.smithi135.stdout:(79/131): python3-scipy-1.0.0-21.module+el8.5.0 23 MB/s | 14 MB 00:00 2023-06-08T03:46:16.014 INFO:teuthology.orchestra.run.smithi043.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-06-08T03:46:16.031 INFO:teuthology.orchestra.run.smithi043.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-06-08T03:46:16.037 INFO:teuthology.orchestra.run.smithi135.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-06-08T03:46:16.071 INFO:teuthology.orchestra.run.smithi135.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-06-08T03:46:16.105 INFO:teuthology.orchestra.run.smithi135.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 795 kB/s | 27 kB 00:00 2023-06-08T03:46:16.108 INFO:teuthology.orchestra.run.smithi043.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.0 MB/s | 2.3 MB 00:00 2023-06-08T03:46:16.147 INFO:teuthology.orchestra.run.smithi135.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-06-08T03:46:16.166 INFO:teuthology.orchestra.run.smithi043.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 14 MB/s | 798 kB 00:00 2023-06-08T03:46:16.181 INFO:teuthology.orchestra.run.smithi135.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-06-08T03:46:16.289 INFO:teuthology.orchestra.run.smithi135.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-06-08T03:46:16.331 INFO:teuthology.orchestra.run.smithi135.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-06-08T03:46:16.373 INFO:teuthology.orchestra.run.smithi135.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-06-08T03:46:16.432 INFO:teuthology.orchestra.run.smithi135.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-06-08T03:46:16.449 INFO:teuthology.orchestra.run.smithi135.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 848 kB/s | 64 kB 00:00 2023-06-08T03:46:16.474 INFO:teuthology.orchestra.run.smithi135.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.9 MB/s | 126 kB 00:00 2023-06-08T03:46:16.491 INFO:teuthology.orchestra.run.smithi135.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 474 kB/s | 20 kB 00:00 2023-06-08T03:46:16.517 INFO:teuthology.orchestra.run.smithi135.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-06-08T03:46:16.559 INFO:teuthology.orchestra.run.smithi135.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-06-08T03:46:16.601 INFO:teuthology.orchestra.run.smithi135.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-06-08T03:46:16.727 INFO:teuthology.orchestra.run.smithi135.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 23 MB/s | 4.9 MB 00:00 2023-06-08T03:46:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-06-08T03:46:16.835 INFO:teuthology.orchestra.run.smithi135.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-06-08T03:46:16.860 INFO:teuthology.orchestra.run.smithi135.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2023-06-08T03:46:16.913 INFO:teuthology.orchestra.run.smithi135.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-06-08T03:46:17.003 INFO:teuthology.orchestra.run.smithi135.stdout:(100/131): postgresql-server-10.21-2.module+el8 30 MB/s | 5.1 MB 00:00 2023-06-08T03:46:17.045 INFO:teuthology.orchestra.run.smithi135.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-06-08T03:46:17.070 INFO:teuthology.orchestra.run.smithi135.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 699 kB/s | 47 kB 00:00 2023-06-08T03:46:17.087 INFO:teuthology.orchestra.run.smithi135.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.6 MB/s | 200 kB 00:00 2023-06-08T03:46:17.113 INFO:teuthology.orchestra.run.smithi135.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-06-08T03:46:17.155 INFO:teuthology.orchestra.run.smithi135.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-06-08T03:46:17.180 INFO:teuthology.orchestra.run.smithi135.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 715 kB/s | 48 kB 00:00 2023-06-08T03:46:17.190 INFO:teuthology.orchestra.run.smithi043.stdout:(130/131): librados2-18.0.0-4313.ga02638f8.el8. 3.1 MB/s | 3.7 MB 00:01 2023-06-08T03:46:17.206 INFO:teuthology.orchestra.run.smithi135.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-08T03:46:17.231 INFO:teuthology.orchestra.run.smithi135.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 848 kB/s | 43 kB 00:00 2023-06-08T03:46:17.256 INFO:teuthology.orchestra.run.smithi135.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-06-08T03:46:17.282 INFO:teuthology.orchestra.run.smithi135.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-06-08T03:46:17.324 INFO:teuthology.orchestra.run.smithi135.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-06-08T03:46:17.349 INFO:teuthology.orchestra.run.smithi135.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 279 kB/s | 19 kB 00:00 2023-06-08T03:46:17.374 INFO:teuthology.orchestra.run.smithi135.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-06-08T03:46:17.408 INFO:teuthology.orchestra.run.smithi135.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-06-08T03:46:17.425 INFO:teuthology.orchestra.run.smithi135.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 355 kB/s | 18 kB 00:00 2023-06-08T03:46:17.459 INFO:teuthology.orchestra.run.smithi135.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-06-08T03:46:17.484 INFO:teuthology.orchestra.run.smithi135.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-06-08T03:46:17.518 INFO:teuthology.orchestra.run.smithi135.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-06-08T03:46:17.593 INFO:teuthology.orchestra.run.smithi135.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 17 MB/s | 2.3 MB 00:00 2023-06-08T03:46:17.618 INFO:teuthology.orchestra.run.smithi135.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 823 kB/s | 83 kB 00:00 2023-06-08T03:46:17.644 INFO:teuthology.orchestra.run.smithi135.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.1 MB/s | 60 kB 00:00 2023-06-08T03:46:17.669 INFO:teuthology.orchestra.run.smithi135.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-06-08T03:46:17.694 INFO:teuthology.orchestra.run.smithi135.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-06-08T03:46:17.720 INFO:teuthology.orchestra.run.smithi135.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-06-08T03:46:17.754 INFO:teuthology.orchestra.run.smithi135.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-06-08T03:46:17.779 INFO:teuthology.orchestra.run.smithi135.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.8 MB/s | 171 kB 00:00 2023-06-08T03:46:17.805 INFO:teuthology.orchestra.run.smithi135.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-06-08T03:46:18.037 INFO:teuthology.orchestra.run.smithi135.stdout:(128/131): ceph-mgr-diskprediction-local-18.0.0 1.8 MB/s | 7.4 MB 00:04 2023-06-08T03:46:18.097 INFO:teuthology.orchestra.run.smithi135.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-06-08T03:46:19.639 INFO:teuthology.orchestra.run.smithi135.stdout:(130/131): librados2-18.0.0-4313.ga02638f8.el8. 2.0 MB/s | 3.7 MB 00:01 2023-06-08T03:46:20.277 INFO:teuthology.orchestra.run.smithi135.stdout:(131/131): librbd1-18.0.0-4313.ga02638f8.el8.x8 1.4 MB/s | 3.6 MB 00:02 2023-06-08T03:46:20.277 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:46:20.277 INFO:teuthology.orchestra.run.smithi135.stdout:Total 8.2 MB/s | 197 MB 00:23 2023-06-08T03:46:21.096 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-06-08T03:46:21.216 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-06-08T03:46:21.216 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-06-08T03:46:21.857 INFO:teuthology.orchestra.run.smithi043.stdout:(131/131): librbd1-18.0.0-4313.ga02638f8.el8.x8 626 kB/s | 3.6 MB 00:05 2023-06-08T03:46:21.862 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:46:21.862 INFO:teuthology.orchestra.run.smithi043.stdout:Total 8.4 MB/s | 197 MB 00:23 2023-06-08T03:46:22.308 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-06-08T03:46:22.312 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-06-08T03:46:22.702 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-06-08T03:46:22.835 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-06-08T03:46:22.836 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-06-08T03:46:23.977 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-06-08T03:46:23.982 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-06-08T03:46:27.495 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-06-08T03:46:27.652 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-08T03:46:27.839 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-08T03:46:28.061 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-06-08T03:46:28.262 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-08T03:46:28.373 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-08T03:46:28.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-08T03:46:28.969 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-08T03:46:29.204 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-08T03:46:29.302 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-06-08T03:46:29.509 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-08T03:46:29.606 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-08T03:46:29.661 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-08T03:46:29.812 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-08T03:46:29.844 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-06-08T03:46:29.942 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-08T03:46:29.993 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-08T03:46:30.103 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-08T03:46:30.162 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-08T03:46:30.248 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-08T03:46:30.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-08T03:46:30.493 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-08T03:46:30.698 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-08T03:46:30.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-08T03:46:30.923 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-08T03:46:31.168 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-08T03:46:31.303 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-08T03:46:31.557 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-08T03:46:31.593 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-08T03:46:31.810 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-08T03:46:31.812 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-08T03:46:31.898 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-08T03:46:31.949 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-08T03:46:32.053 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-08T03:46:32.135 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-08T03:46:32.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-08T03:46:32.249 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-08T03:46:32.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-08T03:46:32.419 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-08T03:46:32.428 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-08T03:46:32.553 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-08T03:46:32.683 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-08T03:46:32.922 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-08T03:46:33.170 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-08T03:46:33.341 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-08T03:46:33.345 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-08T03:46:33.564 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-08T03:46:33.767 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-08T03:46:33.881 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-08T03:46:33.946 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-08T03:46:34.026 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-08T03:46:34.108 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-08T03:46:34.251 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-08T03:46:34.381 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-08T03:46:34.394 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-06-08T03:46:34.551 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-08T03:46:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-06-08T03:46:35.195 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-08T03:46:35.367 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-08T03:46:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-06-08T03:46:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-06-08T03:46:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-06-08T03:46:36.009 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-08T03:46:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-06-08T03:46:36.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-06-08T03:46:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-06-08T03:46:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-08T03:46:36.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 26/134 2023-06-08T03:46:36.780 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 27/134 2023-06-08T03:46:36.997 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-06-08T03:46:37.249 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-06-08T03:46:37.483 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-06-08T03:46:37.662 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 28/134 2023-06-08T03:46:37.713 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-06-08T03:46:37.899 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-06-08T03:46:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-06-08T03:46:38.103 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-06-08T03:46:38.295 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-06-08T03:46:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-08T03:46:38.561 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-06-08T03:46:38.599 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 26/134 2023-06-08T03:46:38.719 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-08T03:46:38.739 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 27/134 2023-06-08T03:46:39.687 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 28/134 2023-06-08T03:46:39.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-06-08T03:46:40.256 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-06-08T03:46:40.461 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-08T03:46:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-06-08T03:46:40.708 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-08T03:46:40.812 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-06-08T03:46:41.005 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-08T03:46:41.229 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-08T03:46:41.391 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 36/134 2023-06-08T03:46:41.564 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 37/134 2023-06-08T03:46:41.744 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-06-08T03:46:41.919 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-06-08T03:46:42.129 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-06-08T03:46:42.271 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-06-08T03:46:42.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-06-08T03:46:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-08T03:46:42.678 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-06-08T03:46:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-06-08T03:46:43.020 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-06-08T03:46:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-08T03:46:43.279 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-06-08T03:46:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-08T03:46:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 36/134 2023-06-08T03:46:43.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-06-08T03:46:43.654 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 37/134 2023-06-08T03:46:43.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-06-08T03:46:43.826 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-06-08T03:46:43.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-06-08T03:46:43.994 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-06-08T03:46:44.160 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-06-08T03:46:44.242 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-06-08T03:46:44.322 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-06-08T03:46:44.467 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-06-08T03:46:44.535 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-06-08T03:46:44.702 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-06-08T03:46:44.726 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-06-08T03:46:44.905 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-06-08T03:46:45.075 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-06-08T03:46:45.085 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-06-08T03:46:45.263 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-06-08T03:46:45.371 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-06-08T03:46:45.552 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-06-08T03:46:45.573 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-06-08T03:46:45.776 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-06-08T03:46:45.829 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-06-08T03:46:45.998 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-06-08T03:46:46.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-06-08T03:46:46.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-06-08T03:46:46.352 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-06-08T03:46:46.533 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-06-08T03:46:46.600 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-06-08T03:46:46.686 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-06-08T03:46:46.801 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-06-08T03:46:46.859 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-06-08T03:46:46.945 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-06-08T03:46:47.043 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-06-08T03:46:47.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-06-08T03:46:47.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-06-08T03:46:47.388 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-06-08T03:46:47.421 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-06-08T03:46:47.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-08T03:46:47.633 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-08T03:46:47.750 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-06-08T03:46:47.864 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-06-08T03:46:48.038 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-06-08T03:46:48.043 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-06-08T03:46:48.250 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-08T03:46:48.266 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-06-08T03:46:48.428 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-08T03:46:48.456 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-06-08T03:46:48.648 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-06-08T03:46:48.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-08T03:46:48.809 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-06-08T03:46:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-08T03:46:48.982 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-06-08T03:46:49.058 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-06-08T03:46:49.063 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-08T03:46:49.253 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-08T03:46:49.282 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-06-08T03:46:49.461 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-08T03:46:49.504 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-06-08T03:46:49.649 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-08T03:46:49.697 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-08T03:46:49.713 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-08T03:46:49.871 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-08T03:46:49.924 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-06-08T03:46:50.062 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-08T03:46:50.076 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-06-08T03:46:50.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-08T03:46:50.225 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-08T03:46:50.415 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-08T03:46:50.448 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-08T03:46:50.622 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-08T03:46:50.722 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-08T03:46:50.798 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-08T03:46:50.915 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-08T03:46:51.062 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-08T03:46:51.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-08T03:46:51.244 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-08T03:46:51.308 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-08T03:46:51.429 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-08T03:46:51.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-08T03:46:51.630 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-08T03:46:51.734 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-08T03:46:51.804 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-08T03:46:51.977 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-08T03:46:52.113 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-08T03:46:52.325 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-08T03:46:52.519 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-08T03:46:52.680 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-08T03:46:52.830 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-08T03:46:52.945 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-08T03:46:53.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-08T03:46:53.174 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-08T03:46:53.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-08T03:46:53.341 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-08T03:46:53.579 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-08T03:46:53.616 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-08T03:46:53.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-08T03:46:54.077 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-08T03:46:54.764 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-08T03:46:54.852 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-08T03:46:55.013 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-08T03:46:55.125 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-08T03:46:55.200 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-08T03:46:55.233 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-08T03:46:55.376 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 93/134 2023-06-08T03:46:55.546 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-08T03:46:55.797 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-08T03:46:55.984 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-08T03:46:56.831 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-08T03:46:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-08T03:46:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-08T03:46:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 93/134 2023-06-08T03:46:58.969 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-08T03:46:59.200 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-08T03:46:59.778 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-08T03:47:00.195 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-08T03:47:00.684 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-08T03:47:00.841 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-08T03:47:01.145 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-08T03:47:01.372 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-08T03:47:02.025 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-08T03:47:02.333 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-08T03:47:02.416 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-08T03:47:02.546 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-08T03:47:19.849 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-08T03:47:19.850 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-06-08T03:47:19.850 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-06-08T03:47:19.850 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-06-08T03:47:19.850 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2023-06-08T03:47:19.850 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-06-08T03:47:19.850 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-06-08T03:47:19.851 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-06-08T03:47:19.851 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-06-08T03:47:19.851 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-06-08T03:47:19.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:20.188 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-08T03:47:21.763 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-08T03:47:21.952 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-08T03:47:22.170 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-08T03:47:22.223 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-08T03:47:22.223 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2023-06-08T03:47:22.223 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /run 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2023-06-08T03:47:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2023-06-08T03:47:22.225 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-08T03:47:22.543 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-08T03:47:22.745 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-08T03:47:22.954 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-08T03:47:22.971 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-08T03:47:24.243 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-08T03:47:24.405 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-08T03:47:24.601 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-08T03:47:24.638 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-08T03:47:24.788 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-08T03:47:24.793 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-08T03:47:24.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 102/134 2023-06-08T03:47:25.109 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 103/134 2023-06-08T03:47:25.276 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-08T03:47:25.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-08T03:47:25.460 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-08T03:47:25.477 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-08T03:47:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-08T03:47:25.785 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-08T03:47:26.742 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-08T03:47:26.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-08T03:47:27.019 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-08T03:47:27.283 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-08T03:47:27.362 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 107/134 2023-06-08T03:47:27.474 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-08T03:47:27.552 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-08T03:47:27.586 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-08T03:47:27.599 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 102/134 2023-06-08T03:47:27.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-08T03:47:27.756 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-08T03:47:27.776 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 103/134 2023-06-08T03:47:27.942 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-08T03:47:28.166 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-08T03:47:28.454 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-08T03:47:28.996 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 110/134 2023-06-08T03:47:29.232 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-08T03:47:29.266 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-08T03:47:29.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-08T03:47:29.484 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-08T03:47:29.512 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-08T03:47:29.667 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-08T03:47:29.679 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-08T03:47:29.764 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-08T03:47:30.024 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-08T03:47:30.126 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 107/134 2023-06-08T03:47:30.178 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-08T03:47:30.337 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-08T03:47:30.373 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-08T03:47:30.550 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-08T03:47:30.562 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-08T03:47:31.901 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 110/134 2023-06-08T03:47:32.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-08T03:47:32.186 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-08T03:47:32.334 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-08T03:47:32.377 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-08T03:47:32.534 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-08T03:47:32.904 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-08T03:47:33.083 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-08T03:47:34.094 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-08T03:47:34.415 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 115/134 2023-06-08T03:47:34.569 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-06-08T03:47:34.760 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-06-08T03:47:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-06-08T03:47:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-06-08T03:47:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 119/134 2023-06-08T03:47:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-08T03:47:36.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 121/134 2023-06-08T03:47:36.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-08T03:47:37.312 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-08T03:47:37.599 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 115/134 2023-06-08T03:47:37.749 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-06-08T03:47:37.957 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-06-08T03:47:38.831 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-08T03:47:38.887 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-06-08T03:47:39.060 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-08T03:47:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-08T03:47:39.178 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-06-08T03:47:39.271 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 124/134 2023-06-08T03:47:39.361 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 119/134 2023-06-08T03:47:39.509 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 125/134 2023-06-08T03:47:39.595 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-08T03:47:39.778 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 121/134 2023-06-08T03:47:39.795 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 126/134 2023-06-08T03:47:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-08T03:47:40.128 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-08T03:47:40.268 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-08T03:47:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-08T03:47:40.445 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-06-08T03:47:40.651 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-06-08T03:47:40.732 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-06-08T03:47:40.926 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-06-08T03:47:40.939 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-06-08T03:47:40.939 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-08T03:47:41.163 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-08T03:47:41.163 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-08T03:47:41.441 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-08T03:47:41.608 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-08T03:47:41.891 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-08T03:47:41.891 INFO:teuthology.orchestra.run.smithi135.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-08T03:47:41.891 INFO:teuthology.orchestra.run.smithi135.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-08T03:47:41.891 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:42.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/134 2023-06-08T03:47:42.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/134 2023-06-08T03:47:42.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/134 2023-06-08T03:47:42.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/134 2023-06-08T03:47:42.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/134 2023-06-08T03:47:42.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/134 2023-06-08T03:47:42.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/134 2023-06-08T03:47:42.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/134 2023-06-08T03:47:42.108 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/134 2023-06-08T03:47:42.108 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/134 2023-06-08T03:47:42.108 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/134 2023-06-08T03:47:42.108 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/134 2023-06-08T03:47:42.115 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/134 2023-06-08T03:47:42.115 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/134 2023-06-08T03:47:42.115 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/134 2023-06-08T03:47:42.115 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/134 2023-06-08T03:47:42.116 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-08T03:47:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-08T03:47:42.118 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-08T03:47:42.119 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-08T03:47:42.120 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-06-08T03:47:42.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-06-08T03:47:42.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-06-08T03:47:42.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-06-08T03:47:42.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-06-08T03:47:42.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-06-08T03:47:42.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-08T03:47:42.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-06-08T03:47:42.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-08T03:47:42.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/134 2023-06-08T03:47:42.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-08T03:47:42.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/134 2023-06-08T03:47:42.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-08T03:47:42.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-08T03:47:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-08T03:47:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-08T03:47:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-08T03:47:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 124/134 2023-06-08T03:47:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 125/134 2023-06-08T03:47:43.231 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 126/134 2023-06-08T03:47:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-08T03:47:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-08T03:47:43.649 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-08T03:47:43.873 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-06-08T03:47:44.023 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-06-08T03:47:44.109 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-06-08T03:47:44.315 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-06-08T03:47:44.327 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-06-08T03:47:44.328 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-08T03:47:44.501 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-08T03:47:44.502 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-08T03:47:44.746 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-08T03:47:44.914 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-08T03:47:44.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-08T03:47:44.954 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:00 ago on Thu 08 Jun 2023 03:45:44 AM UTC. 2023-06-08T03:47:45.217 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-08T03:47:45.218 INFO:teuthology.orchestra.run.smithi043.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-08T03:47:45.218 INFO:teuthology.orchestra.run.smithi043.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-08T03:47:45.219 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:45.460 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/134 2023-06-08T03:47:45.460 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/134 2023-06-08T03:47:45.461 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/134 2023-06-08T03:47:45.461 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/134 2023-06-08T03:47:45.461 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/134 2023-06-08T03:47:45.461 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-08T03:47:45.462 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-08T03:47:45.462 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-08T03:47:45.462 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-08T03:47:45.462 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/134 2023-06-08T03:47:45.463 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/134 2023-06-08T03:47:45.463 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/134 2023-06-08T03:47:45.463 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/134 2023-06-08T03:47:45.463 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/134 2023-06-08T03:47:45.464 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/134 2023-06-08T03:47:45.464 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/134 2023-06-08T03:47:45.464 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/134 2023-06-08T03:47:45.465 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/134 2023-06-08T03:47:45.465 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/134 2023-06-08T03:47:45.465 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/134 2023-06-08T03:47:45.465 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/134 2023-06-08T03:47:45.466 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/134 2023-06-08T03:47:45.466 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/134 2023-06-08T03:47:45.466 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/134 2023-06-08T03:47:45.466 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/134 2023-06-08T03:47:45.467 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/134 2023-06-08T03:47:45.467 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/134 2023-06-08T03:47:45.467 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/134 2023-06-08T03:47:45.467 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/134 2023-06-08T03:47:45.468 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/134 2023-06-08T03:47:45.468 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/134 2023-06-08T03:47:45.468 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/134 2023-06-08T03:47:45.468 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/134 2023-06-08T03:47:45.469 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/134 2023-06-08T03:47:45.469 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/134 2023-06-08T03:47:45.469 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/134 2023-06-08T03:47:45.469 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/134 2023-06-08T03:47:45.470 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/134 2023-06-08T03:47:45.470 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-08T03:47:45.470 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-08T03:47:45.470 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-08T03:47:45.471 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-08T03:47:45.471 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-08T03:47:45.471 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-08T03:47:45.471 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-08T03:47:45.472 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-08T03:47:45.472 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-08T03:47:45.472 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-08T03:47:45.472 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-08T03:47:45.473 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-08T03:47:45.473 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-08T03:47:45.473 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-08T03:47:45.473 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-08T03:47:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-08T03:47:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-08T03:47:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-08T03:47:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-08T03:47:45.475 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-08T03:47:45.475 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-08T03:47:45.475 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-08T03:47:45.475 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-08T03:47:45.476 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-08T03:47:45.476 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-08T03:47:45.476 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-08T03:47:45.477 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-08T03:47:45.477 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-08T03:47:45.477 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-08T03:47:45.477 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-08T03:47:45.478 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-08T03:47:45.478 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-08T03:47:45.478 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-08T03:47:45.478 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-06-08T03:47:45.479 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-06-08T03:47:45.479 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-06-08T03:47:45.479 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-06-08T03:47:45.479 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-06-08T03:47:45.480 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-06-08T03:47:45.480 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-06-08T03:47:45.480 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-06-08T03:47:45.480 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-06-08T03:47:45.481 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-06-08T03:47:45.481 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-06-08T03:47:45.481 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-06-08T03:47:45.481 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-06-08T03:47:45.482 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-06-08T03:47:45.482 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-06-08T03:47:45.482 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-06-08T03:47:45.482 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-06-08T03:47:45.483 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-06-08T03:47:45.483 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-06-08T03:47:45.483 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-06-08T03:47:45.483 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-06-08T03:47:45.484 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-06-08T03:47:45.484 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-06-08T03:47:45.484 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-06-08T03:47:45.484 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-06-08T03:47:45.485 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-06-08T03:47:45.485 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-06-08T03:47:45.485 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-06-08T03:47:45.485 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-06-08T03:47:45.486 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-06-08T03:47:45.486 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-06-08T03:47:45.486 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-06-08T03:47:45.486 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-06-08T03:47:45.487 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-06-08T03:47:45.487 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-06-08T03:47:45.487 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-06-08T03:47:45.487 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-06-08T03:47:45.488 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-06-08T03:47:45.488 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-06-08T03:47:45.488 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-06-08T03:47:45.489 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-06-08T03:47:45.489 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-06-08T03:47:45.489 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-06-08T03:47:45.489 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-06-08T03:47:45.490 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-06-08T03:47:45.490 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-06-08T03:47:45.490 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-06-08T03:47:45.490 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-06-08T03:47:45.491 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-08T03:47:45.491 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-06-08T03:47:45.491 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-08T03:47:45.491 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-06-08T03:47:45.492 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-06-08T03:47:45.492 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-06-08T03:47:45.492 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-06-08T03:47:45.492 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-06-08T03:47:45.493 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-08T03:47:45.493 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/134 2023-06-08T03:47:45.493 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-08T03:47:45.493 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/134 2023-06-08T03:47:45.494 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-08T03:47:45.494 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-08T03:47:47.576 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-06-08T03:47:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-06-08T03:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-08T03:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.811 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-06-08T03:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-08T03:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-7.el8.noarch 2023-06-08T03:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2023-06-08T03:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-3.el8.x86_64 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-08T03:47:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-08T03:47:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: libpq-13.5-1.el8.x86_64 2023-06-08T03:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-08T03:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-08T03:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-08T03:47:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-08T03:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-08T03:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-08T03:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-08T03:47:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-08T03:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-08T03:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-08T03:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-08T03:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-08T03:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-08T03:47:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-08T03:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-08T03:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-08T03:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-08T03:47:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-08T03:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-08T03:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-08T03:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-08T03:47:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-08T03:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-08T03:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-08T03:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-08T03:47:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-08T03:47:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-08T03:47:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-08T03:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-08T03:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-08T03:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-08T03:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-08T03:47:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-08T03:47:47.827 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-08T03:47:47.828 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-08T03:47:47.829 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-08T03:47:47.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-08T03:47:47.831 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-08T03:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-08T03:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-08T03:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-08T03:47:47.832 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-08T03:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:47.833 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-06-08T03:47:48.101 DEBUG:teuthology.parallel:result is None 2023-06-08T03:47:48.181 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-08T03:47:48.181 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:03 ago on Thu 08 Jun 2023 03:45:45 AM UTC. 2023-06-08T03:47:50.944 INFO:teuthology.orchestra.run.smithi043.stdout:Installed products updated. 2023-06-08T03:47:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:51.184 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2023-06-08T03:47:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-08T03:47:51.184 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.1-7.el8.noarch 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.0.4-10.el8.x86_64 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.185 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.186 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.1-9.el8.x86_64 2023-06-08T03:47:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: jq-1.6-3.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.189 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: libpq-13.5-1.el8.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-08T03:47:51.190 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-08T03:47:51.191 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-08T03:47:51.192 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-08T03:47:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-08T03:47:51.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-08T03:47:51.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-08T03:47:51.196 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-2.6-1.el8.noarch 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-08T03:47:51.197 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-08T03:47:51.198 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-08T03:47:51.199 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:47:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-08T03:47:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-08T03:47:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-08T03:47:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-08T03:47:51.201 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-08T03:47:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-08T03:47:51.202 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:51.202 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-06-08T03:47:51.394 DEBUG:teuthology.parallel:result is None 2023-06-08T03:47:51.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:47:51.611 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-08T03:47:51.636 INFO:teuthology.orchestra.run.smithi043.stdout:18.0.0-4313.ga02638f8.el8 2023-06-08T03:47:51.637 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-08T03:47:51.637 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-08T03:47:51.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:47:51.771 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-08T03:47:51.799 INFO:teuthology.orchestra.run.smithi135.stdout:18.0.0-4313.ga02638f8.el8 2023-06-08T03:47:51.800 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-08T03:47:51.800 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-08T03:47:51.800 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-08T03:47:51.801 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:51.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-08T03:47:51.843 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:51.844 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-08T03:47:51.889 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-08T03:47:51.890 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:51.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2023-06-08T03:47:51.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-08T03:47:51.983 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:51.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-06-08T03:47:52.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-08T03:47:52.085 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-08T03:47:52.086 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:52.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-08T03:47:52.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-08T03:47:52.182 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:52.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-08T03:47:52.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-08T03:47:52.281 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-08T03:47:52.282 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:52.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2023-06-08T03:47:52.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-08T03:47:52.377 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:52.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-06-08T03:47:52.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-08T03:47:52.476 INFO:teuthology.run_tasks:Running task ceph... 2023-06-08T03:47:52.552 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-08T03:47:52.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2023-06-08T03:47:52.555 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2023-06-08T03:47:52.584 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-08T03:47:52.584 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-08T03:47:52.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-08T03:47:52.651 INFO:tasks.ceph:Creating extra log directories... 2023-06-08T03:47:52.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-08T03:47:52.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-08T03:47:52.725 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-08T03:47:52.725 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-08T03:47:52.725 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-08T03:47:52.726 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:52.726 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-08T03:47:52.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-08T03:47:52.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-08T03:47:52.930 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:52.931 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-08T03:47:52.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-08T03:47:53.088 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-08T03:47:53.119 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-08T03:47:53.120 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-08T03:47:53.120 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298111', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7298111', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi135.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-08_03:32:08', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-08T03:47:53.121 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-08T03:47:53.123 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-08T03:47:53.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2023-06-08T03:47:53.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2023-06-08T03:47:53.238 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:53.238 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2023-06-08T03:47:53.261 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-08T03:47:53.261 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2023-06-08T03:47:53.317 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-08T03:47:53.318 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 366530 Links: 1 2023-06-08T03:47:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-06-08 03:47:45.130695194 +0000 2023-06-08T03:47:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-06-08 03:44:53.044753728 +0000 2023-06-08T03:47:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-06-08 03:44:53.044753728 +0000 2023-06-08T03:47:53.319 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-06-08T03:47:53.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-08T03:47:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-06-08T03:47:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-06-08T03:47:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000106589 s, 4.8 MB/s 2023-06-08T03:47:53.384 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-08T03:47:53.441 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2023-06-08T03:47:53.499 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-08T03:47:53.499 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:53.500 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 375114 Links: 1 2023-06-08T03:47:53.500 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:53.500 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:53.501 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-06-08 03:47:45.130695194 +0000 2023-06-08T03:47:53.501 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-06-08 03:44:53.606746311 +0000 2023-06-08T03:47:53.501 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-06-08 03:44:53.606746311 +0000 2023-06-08T03:47:53.501 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-06-08T03:47:53.501 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-08T03:47:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-06-08T03:47:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-06-08T03:47:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000108671 s, 4.7 MB/s 2023-06-08T03:47:53.565 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-08T03:47:53.624 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2023-06-08T03:47:53.681 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 375252 Links: 1 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-06-08 03:47:45.130695194 +0000 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-06-08 03:44:54.141739250 +0000 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-06-08 03:44:54.141739250 +0000 2023-06-08T03:47:53.682 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-06-08T03:47:53.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-08T03:47:53.747 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-06-08T03:47:53.747 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-06-08T03:47:53.747 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000107417 s, 4.8 MB/s 2023-06-08T03:47:53.748 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-08T03:47:53.806 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2023-06-08T03:47:53.864 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-08T03:47:53.864 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:53.864 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 375411 Links: 1 2023-06-08T03:47:53.865 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:53.865 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:53.865 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-06-08 03:47:45.130695194 +0000 2023-06-08T03:47:53.865 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-06-08 03:44:54.680732136 +0000 2023-06-08T03:47:53.866 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-06-08 03:44:54.680732136 +0000 2023-06-08T03:47:53.866 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-06-08T03:47:53.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-08T03:47:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-06-08T03:47:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-06-08T03:47:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000111628 s, 4.6 MB/s 2023-06-08T03:47:53.930 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-08T03:47:53.988 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T03:47:53.989 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:53.989 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-06-08T03:47:54.010 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-08T03:47:54.010 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-06-08T03:47:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-08T03:47:54.070 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:54.070 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 371876 Links: 1 2023-06-08T03:47:54.071 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:54.071 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:54.071 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-06-08 03:47:41.809250069 +0000 2023-06-08T03:47:54.071 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-06-08 03:44:37.904552317 +0000 2023-06-08T03:47:54.071 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-06-08 03:44:37.904552317 +0000 2023-06-08T03:47:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-06-08T03:47:54.072 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-08T03:47:54.139 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-06-08T03:47:54.140 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-06-08T03:47:54.140 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000253124 s, 2.0 MB/s 2023-06-08T03:47:54.141 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-08T03:47:54.200 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-06-08T03:47:54.259 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-08T03:47:54.259 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:54.259 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 374195 Links: 1 2023-06-08T03:47:54.259 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:54.259 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:54.260 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-06-08 03:47:41.809250069 +0000 2023-06-08T03:47:54.260 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-06-08 03:44:38.430540650 +0000 2023-06-08T03:47:54.260 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-06-08 03:44:38.430540650 +0000 2023-06-08T03:47:54.260 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-06-08T03:47:54.260 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-08T03:47:54.325 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-06-08T03:47:54.326 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-06-08T03:47:54.326 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000210839 s, 2.4 MB/s 2023-06-08T03:47:54.327 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-08T03:47:54.385 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-06-08T03:47:54.442 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 372924 Links: 1 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-06-08 03:47:41.810250048 +0000 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-06-08 03:44:38.949529138 +0000 2023-06-08T03:47:54.443 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-06-08 03:44:38.949529138 +0000 2023-06-08T03:47:54.444 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-06-08T03:47:54.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-08T03:47:54.508 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-06-08T03:47:54.509 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-06-08T03:47:54.509 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000187812 s, 2.7 MB/s 2023-06-08T03:47:54.510 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-08T03:47:54.568 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-06-08T03:47:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-08T03:47:54.625 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T03:47:54.625 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 372285 Links: 1 2023-06-08T03:47:54.625 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T03:47:54.626 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T03:47:54.626 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-06-08 03:47:41.810250048 +0000 2023-06-08T03:47:54.626 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-06-08 03:44:39.477517427 +0000 2023-06-08T03:47:54.626 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-06-08 03:44:39.477517427 +0000 2023-06-08T03:47:54.626 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-06-08T03:47:54.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-08T03:47:54.691 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-06-08T03:47:54.691 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-06-08T03:47:54.691 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000248856 s, 2.1 MB/s 2023-06-08T03:47:54.692 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-08T03:47:54.749 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T03:47:54.750 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-08T03:47:54.750 INFO:tasks.ceph:Generating config... 2023-06-08T03:47:54.751 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-08T03:47:54.751 INFO:tasks.ceph:[client] debug client = 20 2023-06-08T03:47:54.751 INFO:tasks.ceph:[client] debug ms = 1 2023-06-08T03:47:54.752 INFO:tasks.ceph:[client] pid file = 2023-06-08T03:47:54.752 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-08T03:47:54.752 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-08T03:47:54.752 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-08T03:47:54.752 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-08T03:47:54.753 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-08T03:47:54.753 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-08T03:47:54.753 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-08T03:47:54.753 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-08T03:47:54.753 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-08T03:47:54.754 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-08T03:47:54.754 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-08T03:47:54.754 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-08T03:47:54.754 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-08T03:47:54.754 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-08T03:47:54.755 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-08T03:47:54.755 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-08T03:47:54.755 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-08T03:47:54.755 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-08T03:47:54.755 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-08T03:47:54.756 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-08T03:47:54.756 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-08T03:47:54.756 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-08T03:47:54.756 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-08T03:47:54.756 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-08T03:47:54.757 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-08T03:47:54.757 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-08T03:47:54.757 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-08T03:47:54.757 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-08T03:47:54.757 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-08T03:47:54.758 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-08T03:47:54.758 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-08T03:47:54.758 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-08T03:47:54.758 INFO:tasks.ceph:Setting up mon.a... 2023-06-08T03:47:54.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-08T03:47:54.822 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2023-06-08T03:47:54.825 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-08T03:47:54.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-08T03:47:54.945 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2023-06-08T03:47:54.946 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-08T03:47:54.947 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:54.947 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-08T03:47:55.003 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:47:55.093 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:47:55.093 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 5ca92cbd-c0c8-4573-b70a-f139aab8d7d6 2023-06-08T03:47:55.093 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = pacific 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 5ca92cbd-c0c8-4573-b70a-f139aab8d7d6 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2023-06-08T03:47:55.090873+0000 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-06-08T03:47:55.090873+0000 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 16 (pacific) 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2023-06-08T03:47:55.094 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2023-06-08T03:47:55.095 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2023-06-08T03:47:55.095 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2023-06-08T03:47:55.095 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-08T03:47:55.096 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-08T03:47:55.112 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5ca92cbd-c0c8-4573-b70a-f139aab8d7d6... 2023-06-08T03:47:55.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-08T03:47:55.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-08T03:47:55.199 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2023-06-08T03:47:55.199 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2023-06-08T03:47:55.199 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-08T03:47:55.199 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2023-06-08T03:47:55.199 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.199 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.200 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2023-06-08T03:47:55.201 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2023-06-08T03:47:55.202 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2023-06-08T03:47:55.203 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.204 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-08T03:47:55.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.204 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2023-06-08T03:47:55.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.204 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2023-06-08T03:47:55.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 5ca92cbd-c0c8-4573-b70a-f139aab8d7d6 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.205 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2023-06-08T03:47:55.206 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2023-06-08T03:47:55.207 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2023-06-08T03:47:55.208 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 20 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 20 2023-06-08T03:47:55.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 10 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2023-06-08T03:47:55.210 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2023-06-08T03:47:55.211 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2023-06-08T03:47:55.212 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-08T03:47:55.214 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2023-06-08T03:47:55.214 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2023-06-08T03:47:55.214 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.214 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2023-06-08T03:47:55.214 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-08T03:47:55.215 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-08T03:47:55.215 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.215 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2023-06-08T03:47:55.215 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: mon op complaint time = 120 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2023-06-08T03:47:55.216 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: client mount timeout = 600 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2023-06-08T03:47:55.217 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2023-06-08T03:47:55.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds = 20 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds balancer = 20 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug frag = True 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = True 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: mds op complaint time = 180 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = True 2023-06-08T03:47:55.219 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2023-06-08T03:47:55.220 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2023-06-08T03:47:55.220 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2023-06-08T03:47:55.221 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2023-06-08T03:47:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2023-06-08T03:47:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-08T03:47:55.221 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2023-06-08T03:47:55.222 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.223 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2023-06-08T03:47:55.224 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2023-06-08T03:47:55.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-08T03:47:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2023-06-08T03:47:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2023-06-08T03:47:55.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.43,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on skipped message = False 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 5ca92cbd-c0c8-4573-b70a-f139aab8d7d6 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.227 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2023-06-08T03:47:55.228 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2023-06-08T03:47:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2023-06-08T03:47:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2023-06-08T03:47:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.230 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2023-06-08T03:47:55.231 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2023-06-08T03:47:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2023-06-08T03:47:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2023-06-08T03:47:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2023-06-08T03:47:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-06-08T03:47:55.232 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-06-08T03:47:55.233 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-06-08T03:47:55.234 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2023-06-08T03:47:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2023-06-08T03:47:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-06-08T03:47:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2023-06-08T03:47:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2023-06-08T03:47:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-06-08T03:47:55.236 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-08T03:47:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2023-06-08T03:47:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2023-06-08T03:47:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2023-06-08T03:47:55.237 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2023-06-08T03:47:55.238 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2023-06-08T03:47:55.239 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2023-06-08T03:47:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-06-08T03:47:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = "" 2023-06-08T03:47:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-06-08T03:47:55.240 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-06-08T03:47:55.240 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2023-06-08T03:47:55.240 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2023-06-08T03:47:55.241 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2023-06-08T03:47:55.241 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-06-08T03:47:55.241 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-06-08T03:47:55.241 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-06-08T03:47:55.241 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds balancer = 20 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2023-06-08T03:47:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2023-06-08T03:47:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-06-08T03:47:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-06-08T03:47:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-06-08T03:47:55.243 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-08T03:47:55.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-08T03:47:55.319 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-08T03:47:55.319 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:55.319 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-08T03:47:55.335 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:55.336 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-08T03:47:55.393 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:47:55.393 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:55.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-08T03:47:55.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-08T03:47:55.469 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:47:55.470 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:47:55.526 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:47:55.526 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:55.527 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-08T03:47:55.527 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-08T03:47:55.570 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:47:55.570 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:47:55.629 INFO:tasks.ceph:Setting up mon nodes... 2023-06-08T03:47:55.629 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-08T03:47:55.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-08T03:47:55.683 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-08T03:47:55.686 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-08T03:47:55.807 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-08T03:47:55.810 INFO:tasks.ceph:Setting up mds nodes... 2023-06-08T03:47:55.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-08T03:47:55.866 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-08T03:47:55.868 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-08T03:47:55.895 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-08T03:47:55.990 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-08T03:47:55.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-08T03:47:56.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-08T03:47:56.076 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-08T03:47:56.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-08T03:47:56.106 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-08T03:47:56.199 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-08T03:47:56.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-08T03:47:56.227 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-08T03:47:56.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-08T03:47:56.273 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-08T03:47:56.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-08T03:47:56.329 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-08T03:47:56.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-08T03:47:56.385 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-08T03:47:56.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-08T03:47:56.480 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-08T03:47:56.493 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-08T03:47:56.493 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-08T03:47:56.493 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-08T03:47:56.521 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T03:47:56.522 INFO:tasks.ceph:role: osd.0 2023-06-08T03:47:56.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:47:56.522 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-08T03:47:56.588 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:47:56.589 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:47:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:47:56.590 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:47:56.611 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-06-08T03:47:56.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-06-08T03:47:56.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-08T03:47:56.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-08T03:47:56.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-08T03:47:56.833 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T03:47:56.833 INFO:tasks.ceph:role: osd.1 2023-06-08T03:47:56.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:47:56.834 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-08T03:47:56.899 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:47:56.899 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:47:56.899 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:47:56.899 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:47:56.899 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:47:56.900 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:47:56.900 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:47:56.900 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:47:56.900 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:47:56.900 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:47:56.921 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-06-08T03:47:56.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-06-08T03:47:56.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-08T03:47:57.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-08T03:47:57.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-08T03:47:57.141 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T03:47:57.141 INFO:tasks.ceph:role: osd.2 2023-06-08T03:47:57.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:47:57.142 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-08T03:47:57.208 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:47:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:47:57.210 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:47:57.231 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-06-08T03:47:57.233 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-06-08T03:47:57.233 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-08T03:47:57.312 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-08T03:47:57.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-08T03:47:57.450 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T03:47:57.451 INFO:tasks.ceph:role: osd.3 2023-06-08T03:47:57.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:47:57.451 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-08T03:47:57.516 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:47:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:47:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:47:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:47:57.517 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:47:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:47:57.518 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:47:57.518 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:47:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:47:57.518 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:47:57.542 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-06-08T03:47:57.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-06-08T03:47:57.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-08T03:47:57.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-08T03:47:57.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:47:58.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:47:58.036+0000 7fd54474d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-08T03:47:58.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:47:58.037+0000 7fd54474d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-08T03:47:58.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:47:58.037+0000 7fd54474d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-08T03:47:58.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:47:58.037+0000 7fd54474d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-08T03:47:58.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:47:58.037+0000 7fd54474d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-08T03:47:58.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:47:58.037+0000 7fd54474d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-08T03:48:00.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-08T03:48:00.935 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:01.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:01.025+0000 7f2f5bad4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-08T03:48:01.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:01.025+0000 7f2f5bad4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-08T03:48:01.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:01.025+0000 7f2f5bad4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-08T03:48:01.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:01.025+0000 7f2f5bad4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-08T03:48:01.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:01.025+0000 7f2f5bad4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-08T03:48:01.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:01.025+0000 7f2f5bad4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-08T03:48:03.898 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-08T03:48:03.930 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:04.020+0000 7f9323fa2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-08T03:48:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:04.020+0000 7f9323fa2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-08T03:48:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:04.020+0000 7f9323fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-08T03:48:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:04.020+0000 7f9323fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-08T03:48:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:04.020+0000 7f9323fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-08T03:48:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:04.021+0000 7f9323fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-08T03:48:06.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-08T03:48:06.912 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:07.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:07.003+0000 7ff2a64bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-08T03:48:07.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:07.003+0000 7ff2a64bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-08T03:48:07.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:07.003+0000 7ff2a64bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-08T03:48:07.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:07.003+0000 7ff2a64bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-08T03:48:07.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:07.003+0000 7ff2a64bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-08T03:48:07.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:07.003+0000 7ff2a64bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-08T03:48:09.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-08T03:48:09.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-08T03:48:09.939 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T03:48:09.940 INFO:tasks.ceph:role: osd.4 2023-06-08T03:48:09.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:48:09.940 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-08T03:48:10.016 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:48:10.017 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:48:10.017 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:48:10.017 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:48:10.017 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:48:10.017 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:48:10.017 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:48:10.018 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:48:10.018 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:48:10.018 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:48:10.447 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-06-08T03:48:10.449 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-06-08T03:48:10.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-08T03:48:10.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-08T03:48:10.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-08T03:48:10.713 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T03:48:10.714 INFO:tasks.ceph:role: osd.5 2023-06-08T03:48:10.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:48:10.715 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-08T03:48:10.788 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:48:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:48:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:48:10.790 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:48:11.212 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-06-08T03:48:11.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-06-08T03:48:11.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-08T03:48:11.325 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-08T03:48:11.358 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-08T03:48:11.426 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T03:48:11.427 INFO:tasks.ceph:role: osd.6 2023-06-08T03:48:11.427 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:48:11.427 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-08T03:48:11.501 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:48:11.501 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:48:11.502 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:48:11.503 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:48:11.955 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-06-08T03:48:11.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-06-08T03:48:11.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-08T03:48:12.118 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-08T03:48:12.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-08T03:48:12.223 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T03:48:12.224 INFO:tasks.ceph:role: osd.7 2023-06-08T03:48:12.224 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:48:12.224 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-08T03:48:12.300 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T03:48:12.301 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T03:48:12.301 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T03:48:12.301 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T03:48:12.301 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T03:48:12.301 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-06-08T03:48:12.301 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T03:48:12.302 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T03:48:12.302 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T03:48:12.302 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T03:48:12.740 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-06-08T03:48:12.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-06-08T03:48:12.742 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-08T03:48:12.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-08T03:48:12.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:13.049+0000 7fe8f50ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-08T03:48:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:13.050+0000 7fe8f50ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-08T03:48:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:13.050+0000 7fe8f50ba640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-08T03:48:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:13.050+0000 7fe8f50ba640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-08T03:48:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:13.050+0000 7fe8f50ba640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-08T03:48:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:13.050+0000 7fe8f50ba640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-08T03:48:15.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-08T03:48:15.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:16.052 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:16.048+0000 7f477275a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-08T03:48:16.052 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:16.048+0000 7f477275a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-08T03:48:16.052 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:16.048+0000 7f477275a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-08T03:48:16.052 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:16.048+0000 7f477275a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-08T03:48:16.053 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:16.048+0000 7f477275a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-08T03:48:16.053 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:16.048+0000 7f477275a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-08T03:48:18.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-08T03:48:18.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:19.027 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:19.023+0000 7fb6bc998640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-08T03:48:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:19.024+0000 7fb6bc998640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-08T03:48:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:19.024+0000 7fb6bc998640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-08T03:48:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:19.024+0000 7fb6bc998640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-08T03:48:19.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:19.024+0000 7fb6bc998640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-08T03:48:19.029 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:19.024+0000 7fb6bc998640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-08T03:48:21.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-08T03:48:21.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:22.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:22.018+0000 7f79c44fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-08T03:48:22.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:22.018+0000 7f79c44fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-08T03:48:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:22.018+0000 7f79c44fc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-08T03:48:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:22.018+0000 7f79c44fc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-08T03:48:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:22.018+0000 7f79c44fc640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-08T03:48:22.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:22.019+0000 7f79c44fc640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-08T03:48:23.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:48:23.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:48:24.885 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-08T03:48:24.914 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-08T03:48:24.914 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:24.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-08T03:48:24.947 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:24.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-08T03:48:25.019 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-08T03:48:25.090 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.090 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-08T03:48:25.160 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-08T03:48:25.230 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.230 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-08T03:48:25.298 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-08T03:48:25.367 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-08T03:48:25.399 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-08T03:48:25.469 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-08T03:48:25.538 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.538 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-08T03:48:25.605 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.611 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-08T03:48:25.672 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-08T03:48:25.738 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.739 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-08T03:48:25.805 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.805 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-08T03:48:25.825 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:25.826 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-08T03:48:25.885 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.886 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-08T03:48:25.902 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:25.902 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-08T03:48:25.959 INFO:tasks.ceph:Adding keys to all mons... 2023-06-08T03:48:25.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-08T03:48:25.961 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-08T03:48:26.001 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2023-06-08T03:48:26.001 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBrT4FkcFWbKBAAKJwsoOM1M5+SlmlDcmoRKA== 2023-06-08T03:48:26.001 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2023-06-08T03:48:26.001 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBrT4FkRbqAMxAAb1xXZ6xpWX9IxphDY5qpbQ== 2023-06-08T03:48:26.001 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBrT4FkrXXiOhAA8ge5yE3ibQ9u8gx2OcIJDA== 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBuT4Fkbc9IAhAAjcZD8BAbTkpr24sZHAbktw== 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBxT4FkOeeZARAAtqvpTgpAg7x3uHwa4JNl9g== 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2023-06-08T03:48:26.002 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQB0T4Fk+W5AARAAHZmRacIDqlSDYcQJ7yTmwA== 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQB3T4Fkx9A5ABAAPOuOIGIPE3usp7z1esiJHQ== 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBrT4Fkplz/LxAA/ARPDBVyq9+psvFze755gA== 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBsT4FkTQBxBBAAmjFn4oMv2yOuQrgwHoQFxg== 2023-06-08T03:48:26.003 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBsT4FkZhfGCxAAMX7udJGKGbW3VqGQQrSmEg== 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQB9T4FklBQQAxAApClzyQ51rJ4JtKZakgEytw== 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCAT4Fk3+zzAhAAjzKxRRnDKcVL12ugDwrSiw== 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCDT4FkNO2CARAAeNJEEseMvNRbNX8P4V6d4Q== 2023-06-08T03:48:26.004 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCGT4FkSY0eARAApjaMySd/L+omX0G2YP2QBw== 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBsT4FkencoEBAAcpys0kmXwP74aLrF4W9p1w== 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout:[client.2] 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBsT4FkE52GExAAbRMeRSg8R7gClkaWmbJ6ig== 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout:[client.1] 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBsT4Fkf9TZFhAAgWNrBZGBv2mqEtW9n8uLEg== 2023-06-08T03:48:26.005 INFO:teuthology.orchestra.run.smithi043.stdout:[client.3] 2023-06-08T03:48:26.006 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBsT4FkkVmBHBAAyUdxTs7RLUOEeMXWpwl9mw== 2023-06-08T03:48:26.023 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2023-06-08T03:48:26.023 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBrT4FkcFWbKBAAKJwsoOM1M5+SlmlDcmoRKA== 2023-06-08T03:48:26.023 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBrT4FkRbqAMxAAb1xXZ6xpWX9IxphDY5qpbQ== 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBrT4FkrXXiOhAA8ge5yE3ibQ9u8gx2OcIJDA== 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBuT4Fkbc9IAhAAjcZD8BAbTkpr24sZHAbktw== 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2023-06-08T03:48:26.024 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBxT4FkOeeZARAAtqvpTgpAg7x3uHwa4JNl9g== 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB0T4Fk+W5AARAAHZmRacIDqlSDYcQJ7yTmwA== 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB3T4Fkx9A5ABAAPOuOIGIPE3usp7z1esiJHQ== 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBrT4Fkplz/LxAA/ARPDBVyq9+psvFze755gA== 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-06-08T03:48:26.025 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBsT4FkTQBxBBAAmjFn4oMv2yOuQrgwHoQFxg== 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBsT4FkZhfGCxAAMX7udJGKGbW3VqGQQrSmEg== 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB9T4FklBQQAxAApClzyQ51rJ4JtKZakgEytw== 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCAT4Fk3+zzAhAAjzKxRRnDKcVL12ugDwrSiw== 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2023-06-08T03:48:26.026 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCDT4FkNO2CARAAeNJEEseMvNRbNX8P4V6d4Q== 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCGT4FkSY0eARAApjaMySd/L+omX0G2YP2QBw== 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBsT4FkencoEBAAcpys0kmXwP74aLrF4W9p1w== 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout:[client.2] 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBsT4FkE52GExAAbRMeRSg8R7gClkaWmbJ6ig== 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2023-06-08T03:48:26.027 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBsT4Fkf9TZFhAAgWNrBZGBv2mqEtW9n8uLEg== 2023-06-08T03:48:26.028 INFO:teuthology.orchestra.run.smithi135.stdout:[client.3] 2023-06-08T03:48:26.028 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBsT4FkkVmBHBAAyUdxTs7RLUOEeMXWpwl9mw== 2023-06-08T03:48:26.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T03:48:26.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T03:48:26.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.123 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.181 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.241 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.295 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.404 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.456 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T03:48:26.458 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T03:48:26.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.568 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.570 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T03:48:26.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.681 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.733 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T03:48:26.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:26.844 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:26.900 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:26.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:26.958 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:26.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:27.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:27.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T03:48:27.071 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-08T03:48:27.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-08T03:48:27.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-08T03:48:27.195 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-08T03:48:27.222 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-08T03:48:27.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-08T03:48:27.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-08T03:48:27.369 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-08T03:48:27.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-08T03:48:27.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-08T03:48:27.557 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:27.559 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-08T03:48:27.613 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-08T03:48:27.614 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-08T03:48:27.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-08T03:48:27.616 INFO:tasks.ceph.mon.a:Started 2023-06-08T03:48:27.617 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-08T03:48:27.617 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-08T03:48:27.655 INFO:tasks.ceph.mon.b:Started 2023-06-08T03:48:27.656 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-08T03:48:27.656 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-08T03:48:27.657 INFO:tasks.ceph.mon.c:Started 2023-06-08T03:48:27.658 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-08T03:48:27.658 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-08T03:48:27.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-08T03:48:27.660 INFO:tasks.ceph.mgr.y:Started 2023-06-08T03:48:27.660 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-08T03:48:27.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-08T03:48:27.662 INFO:tasks.ceph.mgr.x:Started 2023-06-08T03:48:27.662 INFO:tasks.ceph:Setting crush tunables to default 2023-06-08T03:48:27.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2023-06-08T03:48:27.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.785+0000 7f40b409b700 1 Processor -- start 2023-06-08T03:48:27.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.785+0000 7f40b409b700 1 -- start start 2023-06-08T03:48:27.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b409b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:27.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b409b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:27.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b409b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b409b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0b6470 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b409b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0cda20 con 0x7f40ac0b60a0 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b409b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac15a520 con 0x7f40ac15e170 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b1636700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b1636700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57248/0 (socket says 172.21.15.43:57248) 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b1636700 1 -- 172.21.15.43:0/3184356089 learned_addr learned my addr 172.21.15.43:0/3184356089 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:27.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b1636700 1 -- 172.21.15.43:0/3184356089 >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 msgr2=0x7f40ac15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.786+0000 7f40b1636700 1 -- 172.21.15.43:0/3184356089 >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 msgr2=0x7f40ac15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1636700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1636700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b2638700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1e37700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b2638700 1 -- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 msgr2=0x7f40ac0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-08T03:48:27.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b2638700 1 -- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 msgr2=0x7f40ac0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-08T03:48:27.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b2638700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-08T03:48:27.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b2638700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-08T03:48:27.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1e37700 1 -- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 msgr2=0x7f40ac0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-08T03:48:27.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1e37700 1 -- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 msgr2=0x7f40ac0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-08T03:48:27.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1e37700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-08T03:48:27.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.787+0000 7f40b1e37700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-08T03:48:27.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.43:3300/0 conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b2638700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1e37700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 -- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 msgr2=0x7f40ac0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:27.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 -- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 msgr2=0x7f40ac0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:27.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 -- 172.21.15.43:0/3184356089 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac15ea40 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b1636700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac15dc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06f5e0 tx=0x7f40a8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbacb77041ceb7c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:27.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b0e35700 1 -- 172.21.15.43:0/3184356089 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8004230 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b0e35700 1 -- 172.21.15.43:0/3184356089 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8004390 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.988+0000 7f40b0e35700 1 -- 172.21.15.43:0/3184356089 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80036a0 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 -- 172.21.15.43:0/3184356089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 msgr2=0x7f40ac15dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:27.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac15dc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06f5e0 tx=0x7f40a8009c30 comp rx=0 tx=0).stop 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 -- 172.21.15.43:0/3184356089 shutdown_connections 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 --2- 172.21.15.43:0/3184356089 >> v2:172.21.15.135:3300/0 conn(0x7f40ac0b60a0 0x7f40ac0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 --2- 172.21.15.43:0/3184356089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac15dc30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 -- 172.21.15.43:0/3184356089 >> 172.21.15.43:0/3184356089 conn(0x7f40ac069db0 msgr2=0x7f40ac06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 -- 172.21.15.43:0/3184356089 shutdown_connections 2023-06-08T03:48:27.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.989+0000 7f40b409b700 1 -- 172.21.15.43:0/3184356089 wait complete. 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.990+0000 7f40b409b700 1 Processor -- start 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.990+0000 7f40b409b700 1 -- start start 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b409b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ac0b60a0 0x7f40ac14eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b409b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac06c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b409b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b409b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac06bb70 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b409b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac06af60 con 0x7f40ac0b60a0 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b409b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac06b240 con 0x7f40ac15e170 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b1636700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b1636700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac06c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57278/0 (socket says 172.21.15.43:57278) 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b1636700 1 -- 172.21.15.43:0/217648036 learned_addr learned my addr 172.21.15.43:0/217648036 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b1e37700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ac0b60a0 0x7f40ac14eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.991+0000 7f40b2638700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1636700 1 -- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 msgr2=0x7f40ac0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:27.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1636700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1636700 1 -- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ac0b60a0 msgr2=0x7f40ac14eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1636700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ac0b60a0 0x7f40ac14eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1636700 1 -- 172.21.15.43:0/217648036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80095b0 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1e37700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ac0b60a0 0x7f40ac14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b1636700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac06c730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06f750 tx=0x7f40a80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8013b10 con 0x7f40ac0cf5b0 2023-06-08T03:48:27.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8013c70 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac06b520 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8025650 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac15bee0 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f40a8025ab0 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.992+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f40a802fa00 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.993+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac073fa0 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:27.996+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f40a802a070 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.072+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f40ac15a1e0 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.074+0000 7f40a27fc700 1 -- 172.21.15.43:0/217648036 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f40a800c070 con 0x7f40ac0cf5b0 2023-06-08T03:48:28.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 msgr2=0x7f40ac06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac06c730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06f750 tx=0x7f40a80047c0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 shutdown_connections 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40ac15e170 0x7f40ac0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ac0b60a0 0x7f40ac14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 --2- 172.21.15.43:0/217648036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ac0cf5b0 0x7f40ac06c730 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 >> 172.21.15.43:0/217648036 conn(0x7f40ac069db0 msgr2=0x7f40ac06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.075+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 shutdown_connections 2023-06-08T03:48:28.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:28.076+0000 7f40b409b700 1 -- 172.21.15.43:0/217648036 wait complete. 2023-06-08T03:48:28.080 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2023-06-08T03:48:28.083 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.080+0000 7fab68d3d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-08T03:48:28.090 INFO:tasks.ceph:check_enable_crimson: False 2023-06-08T03:48:28.091 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-08T03:48:28.091 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:28.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-08T03:48:28.096 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.093+0000 7f657efd3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-08T03:48:28.118 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:28.118 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-08T03:48:28.148 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.145+0000 7fab68d3d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-08T03:48:28.165 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.163+0000 7f657efd3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-08T03:48:28.184 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:28.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-08T03:48:28.222 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.219+0000 7fab68d3d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-08T03:48:28.246 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.243+0000 7f657efd3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-08T03:48:28.250 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:28.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-08T03:48:28.300 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.297+0000 7fab68d3d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-08T03:48:28.316 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:28.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-08T03:48:28.329 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.326+0000 7f657efd3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-08T03:48:28.342 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:28.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-08T03:48:28.406 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:28.407 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-08T03:48:28.447 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.445+0000 7fab68d3d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-08T03:48:28.471 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:48:28.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-08T03:48:28.478 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.475+0000 7f657efd3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-08T03:48:28.537 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 0f68c8e5-fc12-4bd9-9101-7aacbeba17a9 0 2023-06-08T03:48:28.695 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.693+0000 7f5860b6b700 1 Processor -- start 2023-06-08T03:48:28.696 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.693+0000 7f5860b6b700 1 -- start start 2023-06-08T03:48:28.697 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5860b6b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f585c0b60a0 0x7f585c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5860b6b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 0x7f585c15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5860b6b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0cda20 con 0x7f585c15e170 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5860b6b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0b6470 con 0x7f585c0b60a0 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5860b6b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15a520 con 0x7f585c0cf5b0 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 0x7f585c15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 0x7f585c15dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33904/0 (socket says 172.21.15.135:33904) 2023-06-08T03:48:28.698 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 -- 172.21.15.135:0/288723427 learned_addr learned my addr 172.21.15.135:0/288723427 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f585a59c700 1 --2- 172.21.15.135:0/288723427 >> v2:172.21.15.43:3300/0 conn(0x7f585c0b60a0 0x7f585c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 -- 172.21.15.135:0/288723427 >> v2:172.21.15.43:3300/0 conn(0x7f585c0b60a0 msgr2=0x7f585c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 --2- 172.21.15.135:0/288723427 >> v2:172.21.15.43:3300/0 conn(0x7f585c0b60a0 0x7f585c0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 -- 172.21.15.135:0/288723427 >> v1:172.21.15.43:6789/0 conn(0x7f585c15e170 legacy=0x7f585c0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 -- 172.21.15.135:0/288723427 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c15ea40 con 0x7f585c0cf5b0 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f5859d9b700 1 --2- 172.21.15.135:0/288723427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 0x7f585c15dc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58500098f0 tx=0x7f5850009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a130c54b0d111b36 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.694+0000 7f585959a700 1 -- 172.21.15.135:0/288723427 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011830 con 0x7f585c0cf5b0 2023-06-08T03:48:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f585959a700 1 -- 172.21.15.135:0/288723427 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850011990 con 0x7f585c0cf5b0 2023-06-08T03:48:28.700 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f585959a700 1 -- 172.21.15.135:0/288723427 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011d20 con 0x7f585c0cf5b0 2023-06-08T03:48:28.702 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 -- 172.21.15.135:0/288723427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 msgr2=0x7f585c15dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.702 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 --2- 172.21.15.135:0/288723427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 0x7f585c15dc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58500098f0 tx=0x7f5850009c00 comp rx=0 tx=0).stop 2023-06-08T03:48:28.702 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 -- 172.21.15.135:0/288723427 shutdown_connections 2023-06-08T03:48:28.702 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 --2- 172.21.15.135:0/288723427 >> v2:172.21.15.43:3300/0 conn(0x7f585c0b60a0 0x7f585c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.702 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 --2- 172.21.15.135:0/288723427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c0cf5b0 0x7f585c15dc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 -- 172.21.15.135:0/288723427 >> 172.21.15.135:0/288723427 conn(0x7f585c069db0 msgr2=0x7f585c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 -- 172.21.15.135:0/288723427 shutdown_connections 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.695+0000 7f5860b6b700 1 -- 172.21.15.135:0/288723427 wait complete. 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 Processor -- start 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 -- start start 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 0x7f585c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.703 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c0cf5b0 0x7f585c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 0x7f585c14cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c156f00 con 0x7f585c0cf5b0 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c14d0c0 con 0x7f585c0b60a0 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5860b6b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15ad00 con 0x7f585c15e170 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f585a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 0x7f585c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f585ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 0x7f585c14cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f585a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 0x7f585c15a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46134/0 (socket says 172.21.15.135:46134) 2023-06-08T03:48:28.704 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f585ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 0x7f585c14cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33912/0 (socket says 172.21.15.135:33912) 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f585a59c700 1 -- 172.21.15.135:0/656190573 learned_addr learned my addr 172.21.15.135:0/656190573 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.697+0000 7f5859d9b700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c0cf5b0 0x7f585c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585ad9d700 1 -- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 msgr2=0x7f585c15a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585ad9d700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 0x7f585c15a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585ad9d700 1 -- 172.21.15.135:0/656190573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c0cf5b0 msgr2=0x7f585c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585ad9d700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c0cf5b0 0x7f585c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585ad9d700 1 -- 172.21.15.135:0/656190573 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850009550 con 0x7f585c15e170 2023-06-08T03:48:28.705 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585a59c700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 0x7f585c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f5859d9b700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c0cf5b0 0x7f585c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f585ad9d700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 0x7f585c14cb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f585400cb90 tx=0x7f585400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854003c00 con 0x7f585c15e170 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5854003d60 con 0x7f585c15e170 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c15afe0 con 0x7f585c15e170 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400aa80 con 0x7f585c15e170 2023-06-08T03:48:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c15b5a0 con 0x7f585c15e170 2023-06-08T03:48:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58540050d0 con 0x7f585c15e170 2023-06-08T03:48:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.698+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f58540128a0 con 0x7f585c15e170 2023-06-08T03:48:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.699+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c073fa0 con 0x7f585c15e170 2023-06-08T03:48:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.701+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5854005510 con 0x7f585c15e170 2023-06-08T03:48:28.783 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.781+0000 7fab68d3d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-08T03:48:28.788 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.785+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f68c8e5-fc12-4bd9-9101-7aacbeba17a9", "id": 0} v 0) v1 -- 0x7f585c0b2790 con 0x7f585c15e170 2023-06-08T03:48:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.791+0000 7f584affd700 1 -- 172.21.15.135:0/656190573 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f68c8e5-fc12-4bd9-9101-7aacbeba17a9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58540056b0 con 0x7f585c15e170 2023-06-08T03:48:28.794 INFO:teuthology.orchestra.run.smithi135.stdout:0 2023-06-08T03:48:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 msgr2=0x7f585c14cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 0x7f585c14cb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f585400cb90 tx=0x7f585400cea0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 shutdown_connections 2023-06-08T03:48:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f585c15e170 0x7f585c14cb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f585c0b60a0 0x7f585c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 --2- 172.21.15.135:0/656190573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f585c0cf5b0 0x7f585c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 >> 172.21.15.135:0/656190573 conn(0x7f585c069db0 msgr2=0x7f585c0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 shutdown_connections 2023-06-08T03:48:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.792+0000 7f5860b6b700 1 -- 172.21.15.135:0/656190573 wait complete. 2023-06-08T03:48:28.806 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 983fd425-38b1-42fd-92a9-8bd5825a2470 1 2023-06-08T03:48:28.823 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.820+0000 7f657efd3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-08T03:48:28.863 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:28.860+0000 7fab68d3d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-08T03:48:28.901 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:28.898+0000 7f657efd3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-08T03:48:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.925+0000 7fd297b0f700 1 Processor -- start 2023-06-08T03:48:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.925+0000 7fd297b0f700 1 -- start start 2023-06-08T03:48:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd297b0f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 0x7fd2900cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd297b0f700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900c9f30 con 0x7fd29015a300 2023-06-08T03:48:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd297b0f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900cbbc0 con 0x7fd290069db0 2023-06-08T03:48:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd297b0f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900cbea0 con 0x7fd2900cb690 2023-06-08T03:48:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd2950aa700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 0x7fd2900cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd2960ac700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd290069db0 0x7fd2900b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:52708/0 (socket says 172.21.15.135:52708) 2023-06-08T03:48:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd2960ac700 1 -- 172.21.15.135:0/1582786207 learned_addr learned my addr 172.21.15.135:0/1582786207 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-06-08T03:48:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.926+0000 7fd2950aa700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 0x7fd2900cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33916/0 (socket says 172.21.15.135:33916) 2023-06-08T03:48:28.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2948a9700 1 -- 172.21.15.135:0/1582786207 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545141734 0 0) 0x7fd2900cbbc0 con 0x7fd290069db0 2023-06-08T03:48:28.932 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2948a9700 1 -- 172.21.15.135:0/1582786207 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c0035b0 con 0x7fd290069db0 2023-06-08T03:48:28.932 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2948a9700 1 -- 172.21.15.135:0/1582786207 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103045237 0 0) 0x7fd2900c9f30 con 0x7fd29015a300 2023-06-08T03:48:28.932 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2950aa700 1 -- 172.21.15.135:0/1582786207 >> v1:172.21.15.135:6789/0 conn(0x7fd290069db0 legacy=0x7fd2900b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.932 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2950aa700 1 -- 172.21.15.135:0/1582786207 >> v1:172.21.15.43:6789/0 conn(0x7fd29015a300 legacy=0x7fd290071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.932 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2950aa700 1 -- 172.21.15.135:0/1582786207 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290071390 con 0x7fd2900cb690 2023-06-08T03:48:28.932 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2950aa700 1 --2- 172.21.15.135:0/1582786207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 0x7fd2900cca70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd280009870 tx=0x7fd280009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48c61ed86b0f0554 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2948a9700 1 -- 172.21.15.135:0/1582786207 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280011830 con 0x7fd2900cb690 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2948a9700 1 -- 172.21.15.135:0/1582786207 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280011990 con 0x7fd2900cb690 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.927+0000 7fd2948a9700 1 -- 172.21.15.135:0/1582786207 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280011d20 con 0x7fd2900cb690 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 -- 172.21.15.135:0/1582786207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 msgr2=0x7fd2900cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 --2- 172.21.15.135:0/1582786207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 0x7fd2900cca70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd280009870 tx=0x7fd280009b80 comp rx=0 tx=0).stop 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 -- 172.21.15.135:0/1582786207 shutdown_connections 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 --2- 172.21.15.135:0/1582786207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2900cb690 0x7fd2900cca70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 -- 172.21.15.135:0/1582786207 >> 172.21.15.135:0/1582786207 conn(0x7fd29006aec0 msgr2=0x7fd29006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:28.934 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 -- 172.21.15.135:0/1582786207 shutdown_connections 2023-06-08T03:48:28.934 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.928+0000 7fd297b0f700 1 -- 172.21.15.135:0/1582786207 wait complete. 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.930+0000 7fd297b0f700 1 Processor -- start 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.930+0000 7fd297b0f700 1 -- start start 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd297b0f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd290069db0 0x7fd2900ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd297b0f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 0x7fd2901efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd297b0f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd29015a300 0x7fd2901435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd297b0f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900aed50 con 0x7fd29015a300 2023-06-08T03:48:28.936 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd297b0f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900af030 con 0x7fd2900cb690 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd297b0f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900af310 con 0x7fd290069db0 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd2950aa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 0x7fd2901efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd2958ab700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd290069db0 0x7fd2900ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd2950aa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 0x7fd2901efc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46148/0 (socket says 172.21.15.135:46148) 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd2950aa700 1 -- 172.21.15.135:0/2899180958 learned_addr learned my addr 172.21.15.135:0/2899180958 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.931+0000 7fd2960ac700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd29015a300 0x7fd2901435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2950aa700 1 -- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd290069db0 msgr2=0x7fd2900ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2950aa700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd290069db0 0x7fd2900ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2950aa700 1 -- 172.21.15.135:0/2899180958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd29015a300 msgr2=0x7fd2901435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2950aa700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd29015a300 0x7fd2901435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2950aa700 1 -- 172.21.15.135:0/2899180958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800094a0 con 0x7fd2900cb690 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2960ac700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd29015a300 0x7fd2901435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2950aa700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 0x7fd2901efc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd2800090b0 tx=0x7fd280004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28001a860 con 0x7fd2900cb690 2023-06-08T03:48:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28001a9c0 con 0x7fd2900cb690 2023-06-08T03:48:28.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2900af5f0 con 0x7fd2900cb690 2023-06-08T03:48:28.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28001ad30 con 0x7fd2900cb690 2023-06-08T03:48:28.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd290143ae0 con 0x7fd2900cb690 2023-06-08T03:48:28.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd280022070 con 0x7fd2900cb690 2023-06-08T03:48:28.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.932+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd280024420 con 0x7fd2900cb690 2023-06-08T03:48:28.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.933+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2900afb10 con 0x7fd2900cb690 2023-06-08T03:48:28.940 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:28.937+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd2900afb10 con 0x7fd2900cb690 2023-06-08T03:48:29.006 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:29.004+0000 7fab68d3d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-08T03:48:29.024 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.021+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "983fd425-38b1-42fd-92a9-8bd5825a2470", "id": 1} v 0) v1 -- 0x7fd290073fa0 con 0x7fd2900cb690 2023-06-08T03:48:29.027 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.024+0000 7fd2867fc700 1 -- 172.21.15.135:0/2899180958 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "983fd425-38b1-42fd-92a9-8bd5825a2470", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd280029070 con 0x7fd2900cb690 2023-06-08T03:48:29.027 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-06-08T03:48:29.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 msgr2=0x7fd2901efc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 0x7fd2901efc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd2800090b0 tx=0x7fd280004750 comp rx=0 tx=0).stop 2023-06-08T03:48:29.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 shutdown_connections 2023-06-08T03:48:29.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd29015a300 0x7fd2901435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.028 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd290069db0 0x7fd2900ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.029 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 --2- 172.21.15.135:0/2899180958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2900cb690 0x7fd2901efc00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.029 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 >> 172.21.15.135:0/2899180958 conn(0x7fd29006aec0 msgr2=0x7fd29006f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.029 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 shutdown_connections 2023-06-08T03:48:29.029 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.025+0000 7fd297b0f700 1 -- 172.21.15.135:0/2899180958 wait complete. 2023-06-08T03:48:29.031 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:29.028+0000 7f657efd3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-08T03:48:29.040 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new b9e12cdf-8822-4c74-b9a1-84534b4e3de1 2 2023-06-08T03:48:29.093 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:29.090+0000 7fab68d3d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-08T03:48:29.115 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:29.112+0000 7f657efd3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-08T03:48:29.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.157+0000 7faac3b3a700 1 Processor -- start 2023-06-08T03:48:29.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.158+0000 7faac3b3a700 1 -- start start 2023-06-08T03:48:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.158+0000 7faac3b3a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.158+0000 7faac3b3a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faabc1591d0 0x7faabc071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.158+0000 7faac3b3a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0716e0 con 0x7faabc0cded0 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.158+0000 7faac3b3a700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc06f4a0 con 0x7faabc1591d0 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.158+0000 7faac3b3a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0ce7e0 con 0x7faabc0cd300 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac10d5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac18d6700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faabc0cded0 0x7faabc15d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:52716/0 (socket says 172.21.15.135:52716) 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac18d6700 1 -- 172.21.15.135:0/2247165965 learned_addr learned my addr 172.21.15.135:0/2247165965 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac20d7700 1 --2- 172.21.15.135:0/2247165965 >> v2:172.21.15.43:3300/0 conn(0x7faabc1591d0 0x7faabc071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac08d4700 1 -- 172.21.15.135:0/2247165965 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276734662 0 0) 0x7faabc0716e0 con 0x7faabc0cded0 2023-06-08T03:48:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac10d5700 1 -- 172.21.15.135:0/2247165965 >> v2:172.21.15.43:3300/0 conn(0x7faabc1591d0 msgr2=0x7faabc071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac10d5700 1 --2- 172.21.15.135:0/2247165965 >> v2:172.21.15.43:3300/0 conn(0x7faabc1591d0 0x7faabc071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac10d5700 1 -- 172.21.15.135:0/2247165965 >> v1:172.21.15.135:6789/0 conn(0x7faabc0cded0 legacy=0x7faabc15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac10d5700 1 -- 172.21.15.135:0/2247165965 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc06f6b0 con 0x7faabc0cd300 2023-06-08T03:48:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac10d5700 1 --2- 172.21.15.135:0/2247165965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0ce2a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faaac009840 tx=0x7faaac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e0d4eccbf43025 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac08d4700 1 -- 172.21.15.135:0/2247165965 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011830 con 0x7faabc0cd300 2023-06-08T03:48:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac08d4700 1 -- 172.21.15.135:0/2247165965 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac011990 con 0x7faabc0cd300 2023-06-08T03:48:29.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.159+0000 7faac08d4700 1 -- 172.21.15.135:0/2247165965 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011d20 con 0x7faabc0cd300 2023-06-08T03:48:29.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 -- 172.21.15.135:0/2247165965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 msgr2=0x7faabc0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 --2- 172.21.15.135:0/2247165965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0ce2a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faaac009840 tx=0x7faaac009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:29.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 -- 172.21.15.135:0/2247165965 shutdown_connections 2023-06-08T03:48:29.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 --2- 172.21.15.135:0/2247165965 >> v2:172.21.15.43:3300/0 conn(0x7faabc1591d0 0x7faabc071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 --2- 172.21.15.135:0/2247165965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0ce2a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 -- 172.21.15.135:0/2247165965 >> 172.21.15.135:0/2247165965 conn(0x7faabc06aec0 msgr2=0x7faabc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 -- 172.21.15.135:0/2247165965 shutdown_connections 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.160+0000 7faac3b3a700 1 -- 172.21.15.135:0/2247165965 wait complete. 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.161+0000 7faac3b3a700 1 Processor -- start 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.161+0000 7faac3b3a700 1 -- start start 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac3b3a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac3b3a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faabc0cded0 0x7faabc149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.168 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac3b3a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc1591d0 0x7faabc1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac3b3a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc156fd0 con 0x7faabc0cded0 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac3b3a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc155f30 con 0x7faabc1591d0 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac3b3a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc156210 con 0x7faabc0cd300 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33932/0 (socket says 172.21.15.135:33932) 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 -- 172.21.15.135:0/3121334292 learned_addr learned my addr 172.21.15.135:0/3121334292 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:29.169 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac20d7700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc1591d0 0x7faabc1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac10d5700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faabc0cded0 0x7faabc149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 -- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc1591d0 msgr2=0x7faabc1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc1591d0 0x7faabc1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 -- 172.21.15.135:0/3121334292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faabc0cded0 msgr2=0x7faabc149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faabc0cded0 0x7faabc149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac18d6700 1 -- 172.21.15.135:0/3121334292 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0094a0 con 0x7faabc0cd300 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.162+0000 7faac20d7700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc1591d0 0x7faabc1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:29.170 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faac18d6700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0c5270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faab80011e0 tx=0x7faab800ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8004c80 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8004e00 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc1564f0 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8007310 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc156ab0 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faab801d3f0 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.163+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7faab80137e0 con 0x7faabc0cd300 2023-06-08T03:48:29.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.164+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc156ca0 con 0x7faabc0cd300 2023-06-08T03:48:29.172 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.166+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faab8013470 con 0x7faabc0cd300 2023-06-08T03:48:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.248+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b9e12cdf-8822-4c74-b9a1-84534b4e3de1", "id": 2} v 0) v1 -- 0x7faabc073fa0 con 0x7faabc0cd300 2023-06-08T03:48:29.255 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.252+0000 7faab27fc700 1 -- 172.21.15.135:0/3121334292 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9e12cdf-8822-4c74-b9a1-84534b4e3de1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7faab8013a40 con 0x7faabc0cd300 2023-06-08T03:48:29.255 INFO:teuthology.orchestra.run.smithi135.stdout:2 2023-06-08T03:48:29.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 msgr2=0x7faabc0c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0c5270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faab80011e0 tx=0x7faab800ca30 comp rx=0 tx=0).stop 2023-06-08T03:48:29.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 shutdown_connections 2023-06-08T03:48:29.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faabc1591d0 0x7faabc1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc0cd300 0x7faabc0c5270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 --2- 172.21.15.135:0/3121334292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faabc0cded0 0x7faabc149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 >> 172.21.15.135:0/3121334292 conn(0x7faabc06aec0 msgr2=0x7faabc153ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 shutdown_connections 2023-06-08T03:48:29.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.253+0000 7faac3b3a700 1 -- 172.21.15.135:0/3121334292 wait complete. 2023-06-08T03:48:29.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 327aacbb-559b-48be-a085-e226135fca5b 3 2023-06-08T03:48:29.389 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.386+0000 7f9af5026700 1 Processor -- start 2023-06-08T03:48:29.389 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.386+0000 7f9af5026700 1 -- start start 2023-06-08T03:48:29.391 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9af5026700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af0071d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.391 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9af5026700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9af00aeb40 0x7f9af00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.391 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9af5026700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af00cb720 con 0x7f9af0069db0 2023-06-08T03:48:29.391 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9af5026700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af00ca220 con 0x7f9af00aeb40 2023-06-08T03:48:29.391 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9af5026700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00c9ca0 con 0x7f9af015a400 2023-06-08T03:48:29.391 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aef59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9af00aeb40 0x7f9af00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aee59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af0071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aeed9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9af0069db0 0x7f9af006a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:52728/0 (socket says 172.21.15.135:52728) 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aeed9d700 1 -- 172.21.15.135:0/2478003232 learned_addr learned my addr 172.21.15.135:0/2478003232 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aef59e700 1 -- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 msgr2=0x7f9af0071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aef59e700 1 --2- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af0071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aef59e700 1 -- 172.21.15.135:0/2478003232 >> v1:172.21.15.135:6789/0 conn(0x7f9af0069db0 legacy=0x7f9af006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aef59e700 1 -- 172.21.15.135:0/2478003232 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af00c9f40 con 0x7f9af00aeb40 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aedd9b700 1 -- 172.21.15.135:0/2478003232 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260862793 0 0) 0x7f9af00cb720 con 0x7f9af0069db0 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aee59c700 1 --2- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af0071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aef59e700 1 --2- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af00b24a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009d90 tx=0x7f9ae800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a84cbc79eaa3a317 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aedd9b700 1 -- 172.21.15.135:0/2478003232 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800e070 con 0x7f9af00aeb40 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aedd9b700 1 -- 172.21.15.135:0/2478003232 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800bb20 con 0x7f9af00aeb40 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.387+0000 7f9aedd9b700 1 -- 172.21.15.135:0/2478003232 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8012430 con 0x7f9af00aeb40 2023-06-08T03:48:29.393 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 -- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 msgr2=0x7f9af00b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 --2- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af00b24a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009d90 tx=0x7f9ae800b330 comp rx=0 tx=0).stop 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 -- 172.21.15.135:0/2478003232 shutdown_connections 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 --2- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af00b24a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 --2- 172.21.15.135:0/2478003232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af0071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 -- 172.21.15.135:0/2478003232 >> 172.21.15.135:0/2478003232 conn(0x7f9af006aec0 msgr2=0x7f9af006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 -- 172.21.15.135:0/2478003232 shutdown_connections 2023-06-08T03:48:29.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.388+0000 7f9af5026700 1 -- 172.21.15.135:0/2478003232 wait complete. 2023-06-08T03:48:29.396 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.390+0000 7f9af5026700 1 Processor -- start 2023-06-08T03:48:29.396 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.390+0000 7f9af5026700 1 -- start start 2023-06-08T03:48:29.396 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af0069db0 0x7f9af00b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af0144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af00b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00b44b0 con 0x7f9af0069db0 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0144ff0 con 0x7f9af00aeb40 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00b2ed0 con 0x7f9af015a400 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af0144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aef59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af00b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af0144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46172/0 (socket says 172.21.15.135:46172) 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 -- 172.21.15.135:0/2012662823 learned_addr learned my addr 172.21.15.135:0/2012662823 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aeed9d700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af0069db0 0x7f9af00b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 -- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 msgr2=0x7f9af00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af00b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 -- 172.21.15.135:0/2012662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af0069db0 msgr2=0x7f9af00b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.398 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af0069db0 0x7f9af00b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 -- 172.21.15.135:0/2012662823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40094a0 con 0x7f9af00aeb40 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9aee59c700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af0144ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400ebe0 tx=0x7f9ae400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400c850 con 0x7f9af00aeb40 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae400c9b0 con 0x7f9af00aeb40 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae8009a70 con 0x7f9af00aeb40 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.391+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400cd40 con 0x7f9af00aeb40 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.392+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af00b3490 con 0x7f9af00aeb40 2023-06-08T03:48:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.392+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9ae4013770 con 0x7f9af00aeb40 2023-06-08T03:48:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.392+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f9ae401c6d0 con 0x7f9af00aeb40 2023-06-08T03:48:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.392+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af0073fa0 con 0x7f9af00aeb40 2023-06-08T03:48:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.395+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9ae4021060 con 0x7f9af00aeb40 2023-06-08T03:48:29.481 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.478+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "327aacbb-559b-48be-a085-e226135fca5b", "id": 3} v 0) v1 -- 0x7f9af00c9a80 con 0x7f9af00aeb40 2023-06-08T03:48:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.481+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2012662823 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "327aacbb-559b-48be-a085-e226135fca5b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ae402a020 con 0x7f9af00aeb40 2023-06-08T03:48:29.484 INFO:teuthology.orchestra.run.smithi135.stdout:3 2023-06-08T03:48:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 msgr2=0x7f9af0144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af0144ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400ebe0 tx=0x7f9ae400eef0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 shutdown_connections 2023-06-08T03:48:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af0069db0 0x7f9af00b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9af015a400 0x7f9af00b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 --2- 172.21.15.135:0/2012662823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9af00aeb40 0x7f9af0144ab0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 >> 172.21.15.135:0/2012662823 conn(0x7f9af006aec0 msgr2=0x7f9af0159650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 shutdown_connections 2023-06-08T03:48:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.482+0000 7f9af5026700 1 -- 172.21.15.135:0/2012662823 wait complete. 2023-06-08T03:48:29.497 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new c6393406-01f1-41ac-9b24-c5976e6222f4 4 2023-06-08T03:48:29.553 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:29.550+0000 7fab68d3d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-08T03:48:29.559 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:29.557+0000 7f657efd3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-08T03:48:29.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.618+0000 7f4e1db8e700 1 Processor -- start 2023-06-08T03:48:29.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.618+0000 7f4e1db8e700 1 -- start start 2023-06-08T03:48:29.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.618+0000 7f4e1db8e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e1806a4c0 0x7f4e1815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.618+0000 7f4e1db8e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180c9300 con 0x7f4e18159150 2023-06-08T03:48:29.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.618+0000 7f4e1db8e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180ade90 con 0x7f4e18070a10 2023-06-08T03:48:29.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.618+0000 7f4e1db8e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18159520 con 0x7f4e1806a4c0 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e16ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e1806a4c0 0x7f4e1815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e17fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4e18070a10 0x7f4e1815d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:52740/0 (socket says 172.21.15.135:52740) 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e17fff700 1 -- 172.21.15.135:0/2548182783 learned_addr learned my addr 172.21.15.135:0/2548182783 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e167fc700 1 -- 172.21.15.135:0/2548182783 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583633898 0 0) 0x7f4e180ade90 con 0x7f4e18070a10 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e16ffd700 1 -- 172.21.15.135:0/2548182783 >> v1:172.21.15.135:6789/0 conn(0x7f4e18070a10 legacy=0x7f4e1815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e16ffd700 1 -- 172.21.15.135:0/2548182783 >> v1:172.21.15.43:6789/0 conn(0x7f4e18159150 legacy=0x7f4e18069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e16ffd700 1 -- 172.21.15.135:0/2548182783 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180adbb0 con 0x7f4e1806a4c0 2023-06-08T03:48:29.624 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e16ffd700 1 --2- 172.21.15.135:0/2548182783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e1806a4c0 0x7f4e1815cc60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009870 tx=0x7f4e0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe2e4b0729d20f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.624 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.619+0000 7f4e167fc700 1 -- 172.21.15.135:0/2548182783 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c011830 con 0x7f4e1806a4c0 2023-06-08T03:48:29.624 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e167fc700 1 -- 172.21.15.135:0/2548182783 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c011990 con 0x7f4e1806a4c0 2023-06-08T03:48:29.624 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e167fc700 1 -- 172.21.15.135:0/2548182783 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c011d20 con 0x7f4e1806a4c0 2023-06-08T03:48:29.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 -- 172.21.15.135:0/2548182783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e1806a4c0 msgr2=0x7f4e1815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 --2- 172.21.15.135:0/2548182783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e1806a4c0 0x7f4e1815cc60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009870 tx=0x7f4e0c009b80 comp rx=0 tx=0).stop 2023-06-08T03:48:29.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 -- 172.21.15.135:0/2548182783 shutdown_connections 2023-06-08T03:48:29.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 --2- 172.21.15.135:0/2548182783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e1806a4c0 0x7f4e1815cc60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.625 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 -- 172.21.15.135:0/2548182783 >> 172.21.15.135:0/2548182783 conn(0x7f4e180cf220 msgr2=0x7f4e180cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 -- 172.21.15.135:0/2548182783 shutdown_connections 2023-06-08T03:48:29.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.620+0000 7f4e1db8e700 1 -- 172.21.15.135:0/2548182783 wait complete. 2023-06-08T03:48:29.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 Processor -- start 2023-06-08T03:48:29.626 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 -- start start 2023-06-08T03:48:29.628 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 0x7f4e18141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.628 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e18070a10 0x7f4e1813f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.628 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e18159150 0x7f4e1815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.628 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815b2f0 con 0x7f4e18070a10 2023-06-08T03:48:29.628 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815a6b0 con 0x7f4e1806a4c0 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.622+0000 7f4e1db8e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815a950 con 0x7f4e18159150 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 0x7f4e18141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 0x7f4e18141b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46180/0 (socket says 172.21.15.135:46180) 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e17fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e18159150 0x7f4e1815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 -- 172.21.15.135:0/1012139505 learned_addr learned my addr 172.21.15.135:0/1012139505 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e16ffd700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e18070a10 0x7f4e1813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 -- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e18159150 msgr2=0x7f4e1815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.629 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e18159150 0x7f4e1815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 -- 172.21.15.135:0/1012139505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e18070a10 msgr2=0x7f4e1813f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e18070a10 0x7f4e1813f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 -- 172.21.15.135:0/1012139505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0094a0 con 0x7f4e1806a4c0 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e17fff700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e18159150 0x7f4e1815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e177fe700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 0x7f4e18141b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4e08001ed0 tx=0x7f4e080021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08003c00 con 0x7f4e1806a4c0 2023-06-08T03:48:29.630 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08003d60 con 0x7f4e1806a4c0 2023-06-08T03:48:29.631 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800ab40 con 0x7f4e1806a4c0 2023-06-08T03:48:29.631 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1815ac30 con 0x7f4e1806a4c0 2023-06-08T03:48:29.631 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e18142090 con 0x7f4e1806a4c0 2023-06-08T03:48:29.631 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.623+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e080050d0 con 0x7f4e1806a4c0 2023-06-08T03:48:29.631 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.624+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4e08005890 con 0x7f4e1806a4c0 2023-06-08T03:48:29.631 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.624+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1815b430 con 0x7f4e1806a4c0 2023-06-08T03:48:29.632 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.626+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4e1815b430 con 0x7f4e1806a4c0 2023-06-08T03:48:29.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.711+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6393406-01f1-41ac-9b24-c5976e6222f4", "id": 4} v 0) v1 -- 0x7f4e1815c9c0 con 0x7f4e1806a4c0 2023-06-08T03:48:29.716 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.713+0000 7f4dfffff700 1 -- 172.21.15.135:0/1012139505 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6393406-01f1-41ac-9b24-c5976e6222f4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e08005450 con 0x7f4e1806a4c0 2023-06-08T03:48:29.716 INFO:teuthology.orchestra.run.smithi135.stdout:4 2023-06-08T03:48:29.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 msgr2=0x7f4e18141b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 0x7f4e18141b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4e08001ed0 tx=0x7f4e080021e0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 shutdown_connections 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e18159150 0x7f4e1815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e1806a4c0 0x7f4e18141b50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 --2- 172.21.15.135:0/1012139505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e18070a10 0x7f4e1813f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 >> 172.21.15.135:0/1012139505 conn(0x7f4e180cf220 msgr2=0x7f4e180b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 shutdown_connections 2023-06-08T03:48:29.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.714+0000 7f4e1db8e700 1 -- 172.21.15.135:0/1012139505 wait complete. 2023-06-08T03:48:29.729 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 4bc55935-612a-4552-869e-86c3b79ed7ed 5 2023-06-08T03:48:29.849 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.846+0000 7f19db5ec700 1 Processor -- start 2023-06-08T03:48:29.849 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.846+0000 7f19db5ec700 1 -- start start 2023-06-08T03:48:29.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19db5ec700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19d415c090 0x7f19d4070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19db5ec700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19d40ce2b0 0x7f19d40ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19db5ec700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d40cec10 con 0x7f19d4070e40 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19db5ec700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40712c0 con 0x7f19d40ce2b0 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19db5ec700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40715a0 con 0x7f19d415c090 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19d415c090 0x7f19d4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19d415c090 0x7f19d4070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46186/0 (socket says 172.21.15.135:46186) 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 -- 172.21.15.135:0/1953741314 learned_addr learned my addr 172.21.15.135:0/1953741314 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9b89700 1 --2- 172.21.15.135:0/1953741314 >> v2:172.21.15.43:3300/0 conn(0x7f19d40ce2b0 0x7f19d40ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 -- 172.21.15.135:0/1953741314 >> v2:172.21.15.43:3300/0 conn(0x7f19d40ce2b0 msgr2=0x7f19d40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 --2- 172.21.15.135:0/1953741314 >> v2:172.21.15.43:3300/0 conn(0x7f19d40ce2b0 0x7f19d40ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 -- 172.21.15.135:0/1953741314 >> v1:172.21.15.43:6789/0 conn(0x7f19d4070e40 legacy=0x7f19d4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 -- 172.21.15.135:0/1953741314 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4071880 con 0x7f19d415c090 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19d9388700 1 --2- 172.21.15.135:0/1953741314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d415c090 0x7f19d4070900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19d4072260 tx=0x7f19d0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29fb18141fe7e024 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19cbfff700 1 -- 172.21.15.135:0/1953741314 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0011830 con 0x7f19d415c090 2023-06-08T03:48:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19cbfff700 1 -- 172.21.15.135:0/1953741314 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0011990 con 0x7f19d415c090 2023-06-08T03:48:29.853 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.847+0000 7f19cbfff700 1 -- 172.21.15.135:0/1953741314 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0011d20 con 0x7f19d415c090 2023-06-08T03:48:29.854 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 -- 172.21.15.135:0/1953741314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d415c090 msgr2=0x7f19d4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1953741314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d415c090 0x7f19d4070900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19d4072260 tx=0x7f19d0009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 -- 172.21.15.135:0/1953741314 shutdown_connections 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1953741314 >> v2:172.21.15.43:3300/0 conn(0x7f19d40ce2b0 0x7f19d40ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1953741314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d415c090 0x7f19d4070900 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 -- 172.21.15.135:0/1953741314 >> 172.21.15.135:0/1953741314 conn(0x7f19d40cee30 msgr2=0x7f19d40cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 -- 172.21.15.135:0/1953741314 shutdown_connections 2023-06-08T03:48:29.855 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.848+0000 7f19db5ec700 1 -- 172.21.15.135:0/1953741314 wait complete. 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.849+0000 7f19db5ec700 1 Processor -- start 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 -- start start 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d40ce2b0 0x7f19d40af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d415c090 0x7f19d40af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 0x7f19d41f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d41f33d0 con 0x7f19d415c090 2023-06-08T03:48:29.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d41e4a40 con 0x7f19d41f5440 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19db5ec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d41e4d20 con 0x7f19d40ce2b0 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19d9b89700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 0x7f19d41f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19d9b89700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 0x7f19d41f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46194/0 (socket says 172.21.15.135:46194) 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19d9b89700 1 -- 172.21.15.135:0/1062283636 learned_addr learned my addr 172.21.15.135:0/1062283636 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19d9388700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d40ce2b0 0x7f19d40af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.850+0000 7f19d8b87700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d415c090 0x7f19d40af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9b89700 1 -- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d40ce2b0 msgr2=0x7f19d40af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.857 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9b89700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d40ce2b0 0x7f19d40af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9b89700 1 -- 172.21.15.135:0/1062283636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d415c090 msgr2=0x7f19d40af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9b89700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d415c090 0x7f19d40af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9b89700 1 -- 172.21.15.135:0/1062283636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0009550 con 0x7f19d41f5440 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9388700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d40ce2b0 0x7f19d40af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19d9b89700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 0x7f19d41f58c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00efc0 tx=0x7f19cc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc009ea0 con 0x7f19d41f5440 2023-06-08T03:48:29.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00f040 con 0x7f19d41f5440 2023-06-08T03:48:29.859 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d41e5000 con 0x7f19d41f5440 2023-06-08T03:48:29.859 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00ced0 con 0x7f19d41f5440 2023-06-08T03:48:29.859 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d40afe10 con 0x7f19d41f5440 2023-06-08T03:48:29.859 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f19cc014780 con 0x7f19d41f5440 2023-06-08T03:48:29.859 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.851+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f19cc013960 con 0x7f19d41f5440 2023-06-08T03:48:29.859 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.852+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d41f3510 con 0x7f19d41f5440 2023-06-08T03:48:29.860 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.854+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f19d41f3510 con 0x7f19d41f5440 2023-06-08T03:48:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.941+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4bc55935-612a-4552-869e-86c3b79ed7ed", "id": 5} v 0) v1 -- 0x7f19d4073fa0 con 0x7f19d41f5440 2023-06-08T03:48:29.949 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.946+0000 7f19c9ffb700 1 -- 172.21.15.135:0/1062283636 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4bc55935-612a-4552-869e-86c3b79ed7ed", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f19cc018020 con 0x7f19d41f5440 2023-06-08T03:48:29.950 INFO:teuthology.orchestra.run.smithi135.stdout:5 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.947+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 msgr2=0x7f19d41f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.947+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 0x7f19d41f58c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00efc0 tx=0x7f19cc00c3a0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 shutdown_connections 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d41f5440 0x7f19d41f58c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d40ce2b0 0x7f19d40af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 --2- 172.21.15.135:0/1062283636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d415c090 0x7f19d40af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 >> 172.21.15.135:0/1062283636 conn(0x7f19d40cee30 msgr2=0x7f19d409e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 shutdown_connections 2023-06-08T03:48:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:29.948+0000 7f19db5ec700 1 -- 172.21.15.135:0/1062283636 wait complete. 2023-06-08T03:48:29.965 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new b2edbaa1-7cab-4272-8c70-6226536fbdb0 6 2023-06-08T03:48:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.116+0000 7efdbaebb700 1 Processor -- start 2023-06-08T03:48:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdbaebb700 1 -- start start 2023-06-08T03:48:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdbaebb700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efdb415c320 0x7efdb40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdbaebb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 0x7efdb40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdbaebb700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb4071290 con 0x7efdb4071770 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdbaebb700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb40b2050 con 0x7efdb415c320 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdbaebb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40cd2c0 con 0x7efdb406a4c0 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.117+0000 7efdb9458700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 0x7efdb40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 0x7efdb40b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33974/0 (socket says 172.21.15.135:33974) 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 -- 172.21.15.135:0/1829599686 learned_addr learned my addr 172.21.15.135:0/1829599686 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb8c57700 1 --2- 172.21.15.135:0/1829599686 >> v2:172.21.15.43:3300/0 conn(0x7efdb415c320 0x7efdb40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 -- 172.21.15.135:0/1829599686 >> v2:172.21.15.43:3300/0 conn(0x7efdb415c320 msgr2=0x7efdb40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 --2- 172.21.15.135:0/1829599686 >> v2:172.21.15.43:3300/0 conn(0x7efdb415c320 0x7efdb40cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 -- 172.21.15.135:0/1829599686 >> v1:172.21.15.43:6789/0 conn(0x7efdb4071770 legacy=0x7efdb4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 -- 172.21.15.135:0/1829599686 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb40cd5a0 con 0x7efdb406a4c0 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb9458700 1 --2- 172.21.15.135:0/1829599686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 0x7efdb40b24a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efdac009e50 tx=0x7efdac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6ea5aa3ec237bef server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb37fe700 1 -- 172.21.15.135:0/1829599686 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00e070 con 0x7efdb406a4c0 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb37fe700 1 -- 172.21.15.135:0/1829599686 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00b910 con 0x7efdb406a4c0 2023-06-08T03:48:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.118+0000 7efdb37fe700 1 -- 172.21.15.135:0/1829599686 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00bcc0 con 0x7efdb406a4c0 2023-06-08T03:48:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 -- 172.21.15.135:0/1829599686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 msgr2=0x7efdb40b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 --2- 172.21.15.135:0/1829599686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 0x7efdb40b24a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efdac009e50 tx=0x7efdac00b330 comp rx=0 tx=0).stop 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 -- 172.21.15.135:0/1829599686 shutdown_connections 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 --2- 172.21.15.135:0/1829599686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb406a4c0 0x7efdb40b24a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 --2- 172.21.15.135:0/1829599686 >> v2:172.21.15.43:3300/0 conn(0x7efdb415c320 0x7efdb40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 -- 172.21.15.135:0/1829599686 >> 172.21.15.135:0/1829599686 conn(0x7efdb406aec0 msgr2=0x7efdb406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 -- 172.21.15.135:0/1829599686 shutdown_connections 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.119+0000 7efdbaebb700 1 -- 172.21.15.135:0/1829599686 wait complete. 2023-06-08T03:48:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.120+0000 7efdbaebb700 1 Processor -- start 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.120+0000 7efdbaebb700 1 -- start start 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdbaebb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 0x7efdb40cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdbaebb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb4071770 0x7efdb40ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdbaebb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb415c320 0x7efdb40b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdbaebb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40cc680 con 0x7efdb4071770 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdbaebb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40cbbf0 con 0x7efdb406a4c0 2023-06-08T03:48:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdbaebb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4153f40 con 0x7efdb415c320 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb8c57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 0x7efdb40cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb9458700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb415c320 0x7efdb40b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb8c57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 0x7efdb40cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46202/0 (socket says 172.21.15.135:46202) 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb8c57700 1 -- 172.21.15.135:0/3542246615 learned_addr learned my addr 172.21.15.135:0/3542246615 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb3fff700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb4071770 0x7efdb40ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb9458700 1 -- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 msgr2=0x7efdb40cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb9458700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 0x7efdb40cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb9458700 1 -- 172.21.15.135:0/3542246615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb4071770 msgr2=0x7efdb40ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb9458700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb4071770 0x7efdb40ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb9458700 1 -- 172.21.15.135:0/3542246615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009b30 con 0x7efdb415c320 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.121+0000 7efdb8c57700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 0x7efdb40cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdb9458700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb415c320 0x7efdb40b2480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdac015000 tx=0x7efdac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac004780 con 0x7efdb415c320 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0092e0 con 0x7efdb415c320 2023-06-08T03:48:30.129 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb40ae770 con 0x7efdb415c320 2023-06-08T03:48:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac01c680 con 0x7efdb415c320 2023-06-08T03:48:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb40cc0c0 con 0x7efdb415c320 2023-06-08T03:48:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efdac01cae0 con 0x7efdb415c320 2023-06-08T03:48:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.122+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7efdac0123f0 con 0x7efdb415c320 2023-06-08T03:48:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.123+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb4073fa0 con 0x7efdb415c320 2023-06-08T03:48:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.127+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7efdac020070 con 0x7efdb415c320 2023-06-08T03:48:30.141 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:30.138+0000 7fab68d3d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-08T03:48:30.151 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:30.148+0000 7f657efd3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-08T03:48:30.213 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.210+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b2edbaa1-7cab-4272-8c70-6226536fbdb0", "id": 6} v 0) v1 -- 0x7efdb40b55d0 con 0x7efdb415c320 2023-06-08T03:48:30.220 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.217+0000 7efdb17fa700 1 -- 172.21.15.135:0/3542246615 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2edbaa1-7cab-4272-8c70-6226536fbdb0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdac025450 con 0x7efdb415c320 2023-06-08T03:48:30.220 INFO:teuthology.orchestra.run.smithi135.stdout:6 2023-06-08T03:48:30.221 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb415c320 msgr2=0x7efdb40b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.221 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb415c320 0x7efdb40b2480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdac015000 tx=0x7efdac004ad0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 shutdown_connections 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdb415c320 0x7efdb40b2480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb406a4c0 0x7efdb40cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 --2- 172.21.15.135:0/3542246615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb4071770 0x7efdb40ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 >> 172.21.15.135:0/3542246615 conn(0x7efdb406aec0 msgr2=0x7efdb4159910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 shutdown_connections 2023-06-08T03:48:30.222 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.218+0000 7efdbaebb700 1 -- 172.21.15.135:0/3542246615 wait complete. 2023-06-08T03:48:30.233 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 4dceacb1-95cd-4129-b311-c10613533047 7 2023-06-08T03:48:30.304 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:30.302+0000 7fab68d3d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-08T03:48:30.313 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:30.310+0000 7f657efd3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-08T03:48:30.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.351+0000 7f52ee461700 1 Processor -- start 2023-06-08T03:48:30.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52ee461700 1 -- start start 2023-06-08T03:48:30.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52ee461700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 0x7f52e815a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52ee461700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f52e80ae0e0 0x7f52e815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52ee461700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e815dad0 con 0x7f52e815e7f0 2023-06-08T03:48:30.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52ee461700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e815adc0 con 0x7f52e80ae0e0 2023-06-08T03:48:30.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52ee461700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e815b0a0 con 0x7f52e80ce040 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52e7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 0x7f52e815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52e7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 0x7f52e815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33982/0 (socket says 172.21.15.135:33982) 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52e7fff700 1 -- 172.21.15.135:0/1673418432 learned_addr learned my addr 172.21.15.135:0/1673418432 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.352+0000 7f52e77fe700 1 --2- 172.21.15.135:0/1673418432 >> v2:172.21.15.135:3300/0 conn(0x7f52e80ae0e0 0x7f52e815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e7fff700 1 -- 172.21.15.135:0/1673418432 >> v2:172.21.15.135:3300/0 conn(0x7f52e80ae0e0 msgr2=0x7f52e815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e7fff700 1 --2- 172.21.15.135:0/1673418432 >> v2:172.21.15.135:3300/0 conn(0x7f52e80ae0e0 0x7f52e815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e7fff700 1 -- 172.21.15.135:0/1673418432 >> v1:172.21.15.43:6789/0 conn(0x7f52e815e7f0 legacy=0x7f52e8070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e7fff700 1 -- 172.21.15.135:0/1673418432 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e815b380 con 0x7f52e80ce040 2023-06-08T03:48:30.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e77fe700 1 --2- 172.21.15.135:0/1673418432 >> v2:172.21.15.135:3300/0 conn(0x7f52e80ae0e0 0x7f52e815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:30.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e7fff700 1 --2- 172.21.15.135:0/1673418432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 0x7f52e815a500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52d80098f0 tx=0x7f52d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52d94b63249274a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:30.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e6ffd700 1 -- 172.21.15.135:0/1673418432 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8011830 con 0x7f52e80ce040 2023-06-08T03:48:30.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e6ffd700 1 -- 172.21.15.135:0/1673418432 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d8011990 con 0x7f52e80ce040 2023-06-08T03:48:30.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.353+0000 7f52e6ffd700 1 -- 172.21.15.135:0/1673418432 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8011d20 con 0x7f52e80ce040 2023-06-08T03:48:30.360 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 -- 172.21.15.135:0/1673418432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 msgr2=0x7f52e815a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 --2- 172.21.15.135:0/1673418432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 0x7f52e815a500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52d80098f0 tx=0x7f52d8009c00 comp rx=0 tx=0).stop 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 -- 172.21.15.135:0/1673418432 shutdown_connections 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 --2- 172.21.15.135:0/1673418432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e80ce040 0x7f52e815a500 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 --2- 172.21.15.135:0/1673418432 >> v2:172.21.15.135:3300/0 conn(0x7f52e80ae0e0 0x7f52e815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 -- 172.21.15.135:0/1673418432 >> 172.21.15.135:0/1673418432 conn(0x7f52e80cee30 msgr2=0x7f52e80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 -- 172.21.15.135:0/1673418432 shutdown_connections 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.354+0000 7f52ee461700 1 -- 172.21.15.135:0/1673418432 wait complete. 2023-06-08T03:48:30.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.355+0000 7f52ee461700 1 Processor -- start 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.355+0000 7f52ee461700 1 -- start start 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ee461700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e80ae0e0 0x7f52e814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ee461700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 0x7f52e80b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ee461700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 0x7f52e80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ee461700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e814d040 con 0x7f52e80ae0e0 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ee461700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80b31e0 con 0x7f52e80ce040 2023-06-08T03:48:30.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ee461700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e80b34c0 con 0x7f52e815e7f0 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 0x7f52e80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 0x7f52e80b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 0x7f52e80b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33990/0 (socket says 172.21.15.135:33990) 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 0x7f52e80b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46214/0 (socket says 172.21.15.135:46214) 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 -- 172.21.15.135:0/972686060 learned_addr learned my addr 172.21.15.135:0/972686060 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52e7fff700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e80ae0e0 0x7f52e814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 -- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 msgr2=0x7f52e80b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 0x7f52e80b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 -- 172.21.15.135:0/972686060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e80ae0e0 msgr2=0x7f52e814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e80ae0e0 0x7f52e814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52ec9fe700 1 -- 172.21.15.135:0/972686060 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0094a0 con 0x7f52e815e7f0 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.356+0000 7f52e77fe700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 0x7f52e80b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52ec9fe700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 0x7f52e80b2bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52e000cbc0 tx=0x7f52e000ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0003c00 con 0x7f52e815e7f0 2023-06-08T03:48:30.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e0003d60 con 0x7f52e815e7f0 2023-06-08T03:48:30.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000aa80 con 0x7f52e815e7f0 2023-06-08T03:48:30.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d8009550 con 0x7f52e815e7f0 2023-06-08T03:48:30.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e81e3c10 con 0x7f52e815e7f0 2023-06-08T03:48:30.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f52e00050d0 con 0x7f52e815e7f0 2023-06-08T03:48:30.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.357+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f52e0012b70 con 0x7f52e815e7f0 2023-06-08T03:48:30.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.358+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e80cb6b0 con 0x7f52e815e7f0 2023-06-08T03:48:30.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.360+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f52e0012dd0 con 0x7f52e815e7f0 2023-06-08T03:48:30.444 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.442+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4dceacb1-95cd-4129-b311-c10613533047", "id": 7} v 0) v1 -- 0x7f52e8073fa0 con 0x7f52e815e7f0 2023-06-08T03:48:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.453+0000 7f52e4ff9700 1 -- 172.21.15.135:0/972686060 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dceacb1-95cd-4129-b311-c10613533047", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f52e0005510 con 0x7f52e815e7f0 2023-06-08T03:48:30.456 INFO:teuthology.orchestra.run.smithi135.stdout:7 2023-06-08T03:48:30.457 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 msgr2=0x7f52e80b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.457 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 0x7f52e80b2bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52e000cbc0 tx=0x7f52e000ced0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.457 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 shutdown_connections 2023-06-08T03:48:30.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e80ae0e0 0x7f52e814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e815e7f0 0x7f52e80b2bb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 --2- 172.21.15.135:0/972686060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e80ce040 0x7f52e80b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 >> 172.21.15.135:0/972686060 conn(0x7f52e80cee30 msgr2=0x7f52e80cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:30.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 shutdown_connections 2023-06-08T03:48:30.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-06-08T03:48:30.454+0000 7f52ee461700 1 -- 172.21.15.135:0/972686060 wait complete. 2023-06-08T03:48:30.473 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-08T03:48:30.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-08T03:48:30.475 INFO:tasks.ceph.osd.0:Started 2023-06-08T03:48:30.476 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-08T03:48:30.476 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-08T03:48:30.478 INFO:tasks.ceph.osd.1:Started 2023-06-08T03:48:30.478 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-08T03:48:30.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-08T03:48:30.480 INFO:tasks.ceph.osd.2:Started 2023-06-08T03:48:30.480 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-08T03:48:30.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-08T03:48:30.482 INFO:tasks.ceph.osd.3:Started 2023-06-08T03:48:30.483 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-08T03:48:30.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-08T03:48:30.485 INFO:tasks.ceph.osd.4:Started 2023-06-08T03:48:30.485 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-08T03:48:30.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-08T03:48:30.487 INFO:tasks.ceph.osd.5:Started 2023-06-08T03:48:30.488 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-08T03:48:30.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-08T03:48:30.490 INFO:tasks.ceph.osd.6:Started 2023-06-08T03:48:30.490 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-08T03:48:30.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-08T03:48:30.492 INFO:tasks.ceph.osd.7:Started 2023-06-08T03:48:30.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:30.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.645+0000 7fb9a1410700 1 Processor -- start 2023-06-08T03:48:30.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.645+0000 7fb9a1410700 1 -- start start 2023-06-08T03:48:30.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.645+0000 7fb9a1410700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb99c0b5000 0x7fb99c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.645+0000 7fb9a1410700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c0cf1d0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.645+0000 7fb9a1410700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c0cd790 con 0x7fb99c0b80d0 2023-06-08T03:48:30.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.645+0000 7fb9a1410700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c0ccfc0 con 0x7fb99c0b5000 2023-06-08T03:48:30.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb99c0cfba0 0x7fb99c0b43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52214/0 (socket says 172.21.15.43:52214) 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99b7fe700 1 -- 172.21.15.43:0/2718738367 learned_addr learned my addr 172.21.15.43:0/2718738367 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99a7fc700 1 --2- 172.21.15.43:0/2718738367 >> v2:172.21.15.135:3300/0 conn(0x7fb99c0b5000 0x7fb99c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb999ffb700 1 -- 172.21.15.43:0/2718738367 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210992516 0 0) 0x7fb99c0cf1d0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb999ffb700 1 -- 172.21.15.43:0/2718738367 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9840035b0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99a7fc700 1 -- 172.21.15.43:0/2718738367 >> v1:172.21.15.135:6789/0 conn(0x7fb99c0b80d0 legacy=0x7fb99c1606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99a7fc700 1 -- 172.21.15.43:0/2718738367 >> v1:172.21.15.43:6789/0 conn(0x7fb99c0cfba0 legacy=0x7fb99c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99a7fc700 1 -- 172.21.15.43:0/2718738367 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c0cebc0 con 0x7fb99c0b5000 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb999ffb700 1 -- 172.21.15.43:0/2718738367 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086529960 0 0) 0x7fb99c0cd790 con 0x7fb99c0b80d0 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb99a7fc700 1 --2- 172.21.15.43:0/2718738367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b5000 0x7fb99c0cf660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb990009840 tx=0x7fb990009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262132e102a28273 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb999ffb700 1 -- 172.21.15.43:0/2718738367 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990011830 con 0x7fb99c0b5000 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb999ffb700 1 -- 172.21.15.43:0/2718738367 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990011990 con 0x7fb99c0b5000 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.646+0000 7fb999ffb700 1 -- 172.21.15.43:0/2718738367 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990011d20 con 0x7fb99c0b5000 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 -- 172.21.15.43:0/2718738367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b5000 msgr2=0x7fb99c0cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 --2- 172.21.15.43:0/2718738367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b5000 0x7fb99c0cf660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb990009840 tx=0x7fb990009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:30.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 -- 172.21.15.43:0/2718738367 shutdown_connections 2023-06-08T03:48:30.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 --2- 172.21.15.43:0/2718738367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b5000 0x7fb99c0cf660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 -- 172.21.15.43:0/2718738367 >> 172.21.15.43:0/2718738367 conn(0x7fb99c072120 msgr2=0x7fb99c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:30.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 -- 172.21.15.43:0/2718738367 shutdown_connections 2023-06-08T03:48:30.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.647+0000 7fb9a1410700 1 -- 172.21.15.43:0/2718738367 wait complete. 2023-06-08T03:48:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.649+0000 7fb9a1410700 1 Processor -- start 2023-06-08T03:48:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.649+0000 7fb9a1410700 1 -- start start 2023-06-08T03:48:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb9a1410700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb99c0b5000 0x7fb99c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb9a1410700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b80d0 0x7fb99c1e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb9a1410700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 0x7fb99c1e5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb9a1410700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1e7110 con 0x7fb99c0cfba0 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb9a1410700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c154040 con 0x7fb99c0b80d0 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb9a1410700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1e5f70 con 0x7fb99c0b5000 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 0x7fb99c1e5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 0x7fb99c1e5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57316/0 (socket says 172.21.15.43:57316) 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 -- 172.21.15.43:0/2539526081 learned_addr learned my addr 172.21.15.43:0/2539526081 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99a7fc700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b80d0 0x7fb99c1e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99affd700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb99c0b5000 0x7fb99c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 -- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb99c0b5000 msgr2=0x7fb99c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb99c0b5000 0x7fb99c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 -- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b80d0 msgr2=0x7fb99c1e6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b80d0 0x7fb99c1e6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 -- 172.21.15.43:0/2539526081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900094a0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.650+0000 7fb99b7fe700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 0x7fb99c1e5390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb99400ca70 tx=0x7fb99400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400a9e0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99400ab40 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c1e6250 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994012400 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c0c9dc0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb994012560 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.651+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb99401c4e0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.652+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c066710 con 0x7fb99c0cfba0 2023-06-08T03:48:30.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.654+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb99c066710 con 0x7fb99c0cfba0 2023-06-08T03:48:30.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.725+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb99c073fa0 con 0x7fb99c0cfba0 2023-06-08T03:48:30.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.725+0000 7fb9837fe700 1 -- 172.21.15.43:0/2539526081 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb994021060 con 0x7fb99c0cfba0 2023-06-08T03:48:30.729 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:30.729 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:30.443323+0000","last_up_change":"0.000000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:30.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 msgr2=0x7fb99c1e5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:30.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 0x7fb99c1e5390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb99400ca70 tx=0x7fb99400cd80 comp rx=0 tx=0).stop 2023-06-08T03:48:30.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 shutdown_connections 2023-06-08T03:48:30.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb99c0cfba0 0x7fb99c1e5390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb99c0b5000 0x7fb99c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 --2- 172.21.15.43:0/2539526081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c0b80d0 0x7fb99c1e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.726+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 >> 172.21.15.43:0/2539526081 conn(0x7fb99c072120 msgr2=0x7fb99c0d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.727+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 shutdown_connections 2023-06-08T03:48:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:30.727+0000 7fb9a1410700 1 -- 172.21.15.43:0/2539526081 wait complete. 2023-06-08T03:48:30.742 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-08T03:48:30.742 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-08T03:48:31.047 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:31.044+0000 7fab68d3d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-08T03:48:31.078 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:31.075+0000 7f657efd3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-08T03:48:31.094 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T03:48:31.091+0000 7f0a46b04640 -1 Falling back to public interface 2023-06-08T03:48:31.097 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T03:48:31.094+0000 7f3a5a329640 -1 Falling back to public interface 2023-06-08T03:48:31.100 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T03:48:31.098+0000 7f0e569f9640 -1 Falling back to public interface 2023-06-08T03:48:31.103 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T03:48:31.100+0000 7f81b6423640 -1 Falling back to public interface 2023-06-08T03:48:31.108 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T03:48:31.106+0000 7f6c3405a640 -1 Falling back to public interface 2023-06-08T03:48:31.116 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T03:48:31.113+0000 7fa7fa4e4640 -1 Falling back to public interface 2023-06-08T03:48:31.116 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T03:48:31.113+0000 7f17821f7640 -1 Falling back to public interface 2023-06-08T03:48:31.117 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T03:48:31.114+0000 7f2adac9a640 -1 Falling back to public interface 2023-06-08T03:48:31.131 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:31.128+0000 7fab68d3d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-08T03:48:31.160 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:31.157+0000 7f657efd3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-08T03:48:31.270 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:31.268+0000 7fab68d3d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-08T03:48:31.303 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:31.301+0000 7f657efd3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-08T03:48:31.503 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:31.500+0000 7fab68d3d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-08T03:48:31.545 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:31.542+0000 7f657efd3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-08T03:48:31.548 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:31.576 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:31.573+0000 7fab68d3d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-08T03:48:31.623 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:31.620+0000 7f657efd3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-08T03:48:31.663 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.660+0000 7f9d94f2b700 1 Processor -- start 2023-06-08T03:48:31.663 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.660+0000 7f9d94f2b700 1 -- start start 2023-06-08T03:48:31.665 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.661+0000 7f9d94f2b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d900717f0 0x7f9d901670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:31.665 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.661+0000 7f9d94f2b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900cfdc0 con 0x7f9d90069db0 2023-06-08T03:48:31.665 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.661+0000 7f9d94f2b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d90071d30 con 0x7f9d900cd350 2023-06-08T03:48:31.665 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.661+0000 7f9d94f2b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900cba80 con 0x7f9d900717f0 2023-06-08T03:48:31.665 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.661+0000 7f9d8ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d900717f0 0x7f9d901670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:31.665 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8e59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9d90069db0 0x7f9d9006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52222/0 (socket says 172.21.15.43:52222) 2023-06-08T03:48:31.666 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8e59c700 1 -- 172.21.15.43:0/3476394086 learned_addr learned my addr 172.21.15.43:0/3476394086 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:31.666 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8ed9d700 1 -- 172.21.15.43:0/3476394086 >> v1:172.21.15.135:6789/0 conn(0x7f9d900cd350 legacy=0x7f9d9006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:31.666 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8ed9d700 1 -- 172.21.15.43:0/3476394086 >> v1:172.21.15.43:6789/0 conn(0x7f9d90069db0 legacy=0x7f9d9006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:31.666 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8ed9d700 1 -- 172.21.15.43:0/3476394086 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900ccf60 con 0x7f9d900717f0 2023-06-08T03:48:31.666 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8d59a700 1 -- 172.21.15.43:0/3476394086 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524261314 0 0) 0x7f9d80001110 con 0x7f9d90069db0 2023-06-08T03:48:31.666 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8ed9d700 1 --2- 172.21.15.43:0/3476394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d901670a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009d90 tx=0x7f9d8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2f100790d23c0b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:31.667 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8d59a700 1 -- 172.21.15.43:0/3476394086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800e070 con 0x7f9d900717f0 2023-06-08T03:48:31.667 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8d59a700 1 -- 172.21.15.43:0/3476394086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800bbd0 con 0x7f9d900717f0 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.662+0000 7f9d8d59a700 1 -- 172.21.15.43:0/3476394086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88012430 con 0x7f9d900717f0 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 -- 172.21.15.43:0/3476394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 msgr2=0x7f9d901670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 --2- 172.21.15.43:0/3476394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d901670a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009d90 tx=0x7f9d8800b330 comp rx=0 tx=0).stop 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 -- 172.21.15.43:0/3476394086 shutdown_connections 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 --2- 172.21.15.43:0/3476394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d901670a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 -- 172.21.15.43:0/3476394086 >> 172.21.15.43:0/3476394086 conn(0x7f9d900b1290 msgr2=0x7f9d900b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:31.668 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 -- 172.21.15.43:0/3476394086 shutdown_connections 2023-06-08T03:48:31.669 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.663+0000 7f9d94f2b700 1 -- 172.21.15.43:0/3476394086 wait complete. 2023-06-08T03:48:31.669 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.664+0000 7f9d94f2b700 1 Processor -- start 2023-06-08T03:48:31.669 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.664+0000 7f9d94f2b700 1 -- start start 2023-06-08T03:48:31.670 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d94f2b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d90069db0 0x7f9d901435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d94f2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d90143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d94f2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d900cd350 0x7f9d900ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d94f2b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9015cfc0 con 0x7f9d900717f0 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d94f2b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900b5540 con 0x7f9d900cd350 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d94f2b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90144040 con 0x7f9d90069db0 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d8dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d90143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:31.671 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d8dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d90143b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57324/0 (socket says 172.21.15.43:57324) 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d8dd9b700 1 -- 172.21.15.43:0/4038364559 learned_addr learned my addr 172.21.15.43:0/4038364559 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d8e59c700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d90069db0 0x7f9d901435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.665+0000 7f9d8ed9d700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d900cd350 0x7f9d900ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d8dd9b700 1 -- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d90069db0 msgr2=0x7f9d901435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d8dd9b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d90069db0 0x7f9d901435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d8dd9b700 1 -- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d900cd350 msgr2=0x7f9d900ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d8dd9b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d900cd350 0x7f9d900ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:31.672 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d8dd9b700 1 -- 172.21.15.43:0/4038364559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009a70 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d8dd9b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d90143b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400c510 tx=0x7f9d8400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840052d0 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d84005430 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9015c940 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840038c0 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9015cbe0 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9d84003d20 con 0x7f9d900717f0 2023-06-08T03:48:31.673 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.666+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9d84011d60 con 0x7f9d900717f0 2023-06-08T03:48:31.674 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.667+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9015c7a0 con 0x7f9d900717f0 2023-06-08T03:48:31.674 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.669+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9d9015c7a0 con 0x7f9d900717f0 2023-06-08T03:48:31.743 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.740+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d90074000 con 0x7f9d900717f0 2023-06-08T03:48:31.744 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.741+0000 7f9d7effd700 1 -- 172.21.15.43:0/4038364559 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9d84017070 con 0x7f9d900717f0 2023-06-08T03:48:31.744 INFO:teuthology.misc.health.smithi043.stdout: 2023-06-08T03:48:31.744 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:30.443323+0000","last_up_change":"0.000000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:31.745 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 msgr2=0x7f9d90143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:31.745 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d90143b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400c510 tx=0x7f9d8400c820 comp rx=0 tx=0).stop 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 shutdown_connections 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d900cd350 0x7f9d900ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d90069db0 0x7f9d901435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 --2- 172.21.15.43:0/4038364559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d900717f0 0x7f9d90143b00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 >> 172.21.15.43:0/4038364559 conn(0x7f9d900b1290 msgr2=0x7f9d9006f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 shutdown_connections 2023-06-08T03:48:31.746 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:31.742+0000 7f9d94f2b700 1 -- 172.21.15.43:0/4038364559 wait complete. 2023-06-08T03:48:31.756 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-08T03:48:31.849 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:31.846+0000 7fab68d3d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-08T03:48:31.907 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:31.904+0000 7f657efd3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-08T03:48:32.066 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:32.064+0000 7fab68d3d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-08T03:48:32.134 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:32.131+0000 7f657efd3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-08T03:48:32.223 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:32.220+0000 7fab68d3d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-08T03:48:32.294 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:32.291+0000 7f657efd3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-08T03:48:32.336 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:32.333+0000 7fab68d3d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-08T03:48:32.413 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:32.410+0000 7f657efd3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-08T03:48:32.658 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:32.655+0000 7fab68d3d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-08T03:48:32.747 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:32.744+0000 7f657efd3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-08T03:48:32.760 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:32.757+0000 7fab68d3d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-08T03:48:32.850 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:32.847+0000 7f657efd3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-08T03:48:32.944 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:32.941+0000 7fab68d3d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-08T03:48:33.041 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:33.038+0000 7f657efd3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-08T03:48:33.538 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:33.535+0000 7fab68d3d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-08T03:48:33.667 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-06-08T03:48:33.663+0000 7f657efd3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-08T03:48:34.364 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T03:48:34.361+0000 7f6c3405a640 -1 osd.6 0 log_to_monitors true 2023-06-08T03:48:34.563 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:34.561+0000 7fab20f69700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-08T03:48:34.567 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-06-08T03:48:34.564+0000 7fab20f69700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-08T03:48:34.621 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T03:48:34.618+0000 7f17821f7640 -1 osd.0 0 log_to_monitors true 2023-06-08T03:48:34.623 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T03:48:34.621+0000 7f81b6423640 -1 osd.2 0 log_to_monitors true 2023-06-08T03:48:34.630 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T03:48:34.627+0000 7fa7fa4e4640 -1 osd.7 0 log_to_monitors true 2023-06-08T03:48:34.632 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T03:48:34.629+0000 7f2adac9a640 -1 osd.3 0 log_to_monitors true 2023-06-08T03:48:34.636 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T03:48:34.633+0000 7f0a46b04640 -1 osd.4 0 log_to_monitors true 2023-06-08T03:48:34.637 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T03:48:34.634+0000 7f0e569f9640 -1 osd.5 0 log_to_monitors true 2023-06-08T03:48:34.643 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T03:48:34.640+0000 7f3a5a329640 -1 osd.1 0 log_to_monitors true 2023-06-08T03:48:37.116 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T03:48:37.112+0000 7f3a4e6e1700 -1 osd.1 0 waiting for initial osdmap 2023-06-08T03:48:37.130 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T03:48:37.126+0000 7f81aa7db700 -1 osd.2 0 waiting for initial osdmap 2023-06-08T03:48:37.131 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T03:48:37.128+0000 7f3a462bb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.136 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T03:48:37.133+0000 7f17765af700 -1 osd.0 0 waiting for initial osdmap 2023-06-08T03:48:37.138 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T03:48:37.135+0000 7f2acf052700 -1 osd.3 0 waiting for initial osdmap 2023-06-08T03:48:37.142 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T03:48:37.139+0000 7f81a23b5700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.154 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T03:48:37.151+0000 7f2ac6c2c700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.155 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T03:48:37.152+0000 7f176e189700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.759 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T03:48:37.756+0000 7f0e4adb1700 -1 osd.5 0 waiting for initial osdmap 2023-06-08T03:48:37.764 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T03:48:37.760+0000 7f6c28412700 -1 osd.6 0 waiting for initial osdmap 2023-06-08T03:48:37.774 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T03:48:37.771+0000 7f0e4298b700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.782 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T03:48:37.779+0000 7f6c1ffec700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.800 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T03:48:37.797+0000 7f0a3b6bd700 -1 osd.4 0 waiting for initial osdmap 2023-06-08T03:48:37.807 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T03:48:37.804+0000 7fa7ee89c700 -1 osd.7 0 waiting for initial osdmap 2023-06-08T03:48:37.812 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T03:48:37.810+0000 7f0a32a96700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:37.826 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T03:48:37.823+0000 7fa7e6476700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T03:48:38.562 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:38.691 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.687+0000 7fcd99a0d700 1 Processor -- start 2023-06-08T03:48:38.691 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.687+0000 7fcd99a0d700 1 -- start start 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd99a0d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcd940ced40 0x7fcd940cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd99a0d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940d1af0 con 0x7fcd940cf490 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd99a0d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940cd900 con 0x7fcd940d1f80 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd99a0d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940cf190 con 0x7fcd940ced40 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd927fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcd940ced40 0x7fcd940cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd92ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcd940cf490 0x7fcd940cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52396/0 (socket says 172.21.15.43:52396) 2023-06-08T03:48:38.693 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd92ffd700 1 -- 172.21.15.43:0/327411921 learned_addr learned my addr 172.21.15.43:0/327411921 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd927fc700 1 -- 172.21.15.43:0/327411921 >> v1:172.21.15.135:6789/0 conn(0x7fcd940d1f80 legacy=0x7fcd940b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd927fc700 1 -- 172.21.15.43:0/327411921 >> v1:172.21.15.43:6789/0 conn(0x7fcd940cf490 legacy=0x7fcd940cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.688+0000 7fcd927fc700 1 -- 172.21.15.43:0/327411921 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940d11e0 con 0x7fcd940ced40 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd927fc700 1 --2- 172.21.15.43:0/327411921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd940cd0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009840 tx=0x7fcd84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35039df2acdfbaec server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd91ffb700 1 -- 172.21.15.43:0/327411921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84011830 con 0x7fcd940ced40 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd91ffb700 1 -- 172.21.15.43:0/327411921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84011990 con 0x7fcd940ced40 2023-06-08T03:48:38.694 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd91ffb700 1 -- 172.21.15.43:0/327411921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84011d20 con 0x7fcd940ced40 2023-06-08T03:48:38.696 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 -- 172.21.15.43:0/327411921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 msgr2=0x7fcd940cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.697 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/327411921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd940cd0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009840 tx=0x7fcd84009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:38.697 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 -- 172.21.15.43:0/327411921 shutdown_connections 2023-06-08T03:48:38.697 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/327411921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd940cd0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.697 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 -- 172.21.15.43:0/327411921 >> 172.21.15.43:0/327411921 conn(0x7fcd940714e0 msgr2=0x7fcd940718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:38.697 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 -- 172.21.15.43:0/327411921 shutdown_connections 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.689+0000 7fcd99a0d700 1 -- 172.21.15.43:0/327411921 wait complete. 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.690+0000 7fcd99a0d700 1 Processor -- start 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 -- start start 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd94155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd940cf490 0x7fcd940ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd940d1f80 0x7fcd94159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:38.698 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940cb540 con 0x7fcd940ced40 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940cb820 con 0x7fcd940cf490 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd99a0d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940c9bf0 con 0x7fcd940d1f80 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd92ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd94155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.691+0000 7fcd92ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd94155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57498/0 (socket says 172.21.15.43:57498) 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 -- 172.21.15.43:0/3176612048 learned_addr learned my addr 172.21.15.43:0/3176612048 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd927fc700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd940cf490 0x7fcd940ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd937fe700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd940d1f80 0x7fcd94159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:38.699 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 -- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd940d1f80 msgr2=0x7fcd94159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd940d1f80 0x7fcd94159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 -- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd940cf490 msgr2=0x7fcd940ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd940cf490 0x7fcd940ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 -- 172.21.15.43:0/3176612048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840094a0 con 0x7fcd940ced40 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd927fc700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd940cf490 0x7fcd940ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd92ffd700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd94155620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800c520 tx=0x7fcd8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:38.700 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88005d70 con 0x7fcd940ced40 2023-06-08T03:48:38.701 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd880070d0 con 0x7fcd940ced40 2023-06-08T03:48:38.701 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd940c9ed0 con 0x7fcd940ced40 2023-06-08T03:48:38.701 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88007440 con 0x7fcd940ced40 2023-06-08T03:48:38.701 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.692+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd940cb1a0 con 0x7fcd940ced40 2023-06-08T03:48:38.702 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.693+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd940ca3f0 con 0x7fcd940ced40 2023-06-08T03:48:38.702 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.694+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fcd880075a0 con 0x7fcd940ced40 2023-06-08T03:48:38.702 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.694+0000 7fcd7bfff700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcd8006ac50 0x7fcd8006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:38.702 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.694+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fcd88088150 con 0x7fcd940ced40 2023-06-08T03:48:38.702 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.694+0000 7fcd927fc700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcd8006ac50 0x7fcd8006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:38.703 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.695+0000 7fcd927fc700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcd8006ac50 0x7fcd8006d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcd840090b0 tx=0x7fcd84008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:38.703 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.699+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd940ca3f0 con 0x7fcd940ced40 2023-06-08T03:48:38.904 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.900+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd940ca3f0 con 0x7fcd940ced40 2023-06-08T03:48:38.904 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.900+0000 7fcd7bfff700 1 -- 172.21.15.43:0/3176612048 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10908 (secure 0 0 0) 0x7fcd940ca3f0 con 0x7fcd940ced40 2023-06-08T03:48:38.905 INFO:teuthology.misc.health.smithi043.stdout: 2023-06-08T03:48:38.905 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":13,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:38.146227+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:38.907 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.902+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcd8006ac50 msgr2=0x7fcd8006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.907 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.902+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcd8006ac50 0x7fcd8006d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcd840090b0 tx=0x7fcd84008030 comp rx=0 tx=0).stop 2023-06-08T03:48:38.907 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.902+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 msgr2=0x7fcd94155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:38.907 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd94155620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800c520 tx=0x7fcd8800c8e0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.907 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 shutdown_connections 2023-06-08T03:48:38.907 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcd8006ac50 0x7fcd8006d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.908 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd940ced40 0x7fcd94155620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.908 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd940d1f80 0x7fcd94159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.908 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 --2- 172.21.15.43:0/3176612048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd940cf490 0x7fcd940ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:38.908 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 >> 172.21.15.43:0/3176612048 conn(0x7fcd940714e0 msgr2=0x7fcd940b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:38.908 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 shutdown_connections 2023-06-08T03:48:38.908 INFO:teuthology.misc.health.smithi043.stderr:2023-06-08T03:48:38.903+0000 7fcd99a0d700 1 -- 172.21.15.43:0/3176612048 wait complete. 2023-06-08T03:48:38.918 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-08T03:48:38.918 INFO:tasks.ceph:Creating RBD pool 2023-06-08T03:48:38.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-08T03:48:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.038+0000 7f48f43b3700 1 Processor -- start 2023-06-08T03:48:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.038+0000 7f48f43b3700 1 -- start start 2023-06-08T03:48:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f43b3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f48ec06d9b0 0x7f48ec06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f43b3700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec06c4c0 con 0x7f48ec06d1f0 2023-06-08T03:48:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f43b3700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec0cd110 con 0x7f48ec15cf00 2023-06-08T03:48:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f43b3700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec06e310 con 0x7f48ec06d9b0 2023-06-08T03:48:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f194e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f48ec06d1f0 0x7f48ec0cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52430/0 (socket says 172.21.15.43:52430) 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f194e700 1 -- 172.21.15.43:0/3175862118 learned_addr learned my addr 172.21.15.43:0/3175862118 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f2950700 1 --2- 172.21.15.43:0/3175862118 >> v2:172.21.15.135:3300/0 conn(0x7f48ec06d9b0 0x7f48ec06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568255834 0 0) 0x7f48ec06c4c0 con 0x7f48ec06d1f0 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.039+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d80035b0 con 0x7f48ec06d1f0 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 267917020 0 0) 0x7f48d80035b0 con 0x7f48ec06d1f0 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 >> v2:172.21.15.135:3300/0 conn(0x7f48ec06d9b0 msgr2=0x7f48ec06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 --2- 172.21.15.43:0/3175862118 >> v2:172.21.15.135:3300/0 conn(0x7f48ec06d9b0 0x7f48ec06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 >> v1:172.21.15.135:6789/0 conn(0x7f48ec15cf00 legacy=0x7f48ec15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0cd370 con 0x7f48ec06d1f0 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f48dc001670 con 0x7f48ec06d1f0 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 >> v1:172.21.15.43:6789/0 conn(0x7f48ec06d1f0 legacy=0x7f48ec0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8003a00 0x7f48d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d80043f0 0x7f48d80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48d8005150 0x7f48d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec06e310 con 0x7f48d8005150 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d800c080 con 0x7f48d8003a00 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d800c240 con 0x7f48d80043f0 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48d8005150 0x7f48d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f194e700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d80043f0 0x7f48d80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f214f700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8003a00 0x7f48d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 -- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d80043f0 msgr2=0x7f48d80048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d80043f0 0x7f48d80048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 -- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8003a00 msgr2=0x7f48d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8003a00 0x7f48d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 -- 172.21.15.43:0/3175862118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80035b0 con 0x7f48d8005150 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 -- 172.21.15.43:0/3175862118 reap_dead start 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.040+0000 7f48f2950700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48d8005150 0x7f48d800ba10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009fc0 tx=0x7f48d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced00d8bbf15b173 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4003a20 con 0x7f48d8005150 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400f040 con 0x7f48d8005150 2023-06-08T03:48:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f114d700 1 -- 172.21.15.43:0/3175862118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4003de0 con 0x7f48d8005150 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 -- 172.21.15.43:0/3175862118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48d8005150 msgr2=0x7f48d800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48d8005150 0x7f48d800ba10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009fc0 tx=0x7f48d8005880 comp rx=0 tx=0).stop 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 -- 172.21.15.43:0/3175862118 shutdown_connections 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 --2- 172.21.15.43:0/3175862118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48d8005150 0x7f48d800ba10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 -- 172.21.15.43:0/3175862118 >> 172.21.15.43:0/3175862118 conn(0x7f48ec0cee30 msgr2=0x7f48ec0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 -- 172.21.15.43:0/3175862118 shutdown_connections 2023-06-08T03:48:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.041+0000 7f48f43b3700 1 -- 172.21.15.43:0/3175862118 wait complete. 2023-06-08T03:48:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.042+0000 7f48f43b3700 1 Processor -- start 2023-06-08T03:48:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.042+0000 7f48f43b3700 1 -- start start 2023-06-08T03:48:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f43b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8005150 0x7f48ec159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f43b3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48ec0c7470 0x7f48ec15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f43b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 0x7f48ec15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f43b3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c7c70 con 0x7f48ec159340 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f43b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c7f30 con 0x7f48d8005150 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f43b3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c8210 con 0x7f48ec0c7470 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 0x7f48ec15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 0x7f48ec15b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57540/0 (socket says 172.21.15.43:57540) 2023-06-08T03:48:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 -- 172.21.15.43:0/826263028 learned_addr learned my addr 172.21.15.43:0/826263028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 -- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48ec0c7470 msgr2=0x7f48ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48ec0c7470 0x7f48ec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 -- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8005150 msgr2=0x7f48ec159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8005150 0x7f48ec159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.043+0000 7f48f2950700 1 -- 172.21.15.43:0/826263028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0c84f0 con 0x7f48ec159340 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.044+0000 7f48f2950700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 0x7f48ec15b4f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48ec070890 tx=0x7f48e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.044+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4003e90 con 0x7f48ec159340 2023-06-08T03:48:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.044+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e4004230 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.044+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec0c87d0 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.044+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40045e0 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.044+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec0c8cf0 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.045+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec073fa0 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.045+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f48e4004740 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.046+0000 7f48e2ffd700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f48d006ac50 0x7f48d006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.046+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f48e4089f40 con 0x7f48ec159340 2023-06-08T03:48:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.046+0000 7f48f214f700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f48d006ac50 0x7f48d006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:39.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.046+0000 7f48f214f700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f48d006ac50 0x7f48d006d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007fd0 tx=0x7f48e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:39.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.050+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f48e4055790 con 0x7f48ec159340 2023-06-08T03:48:39.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:39.249+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f48ec065e40 con 0x7f48ec159340 2023-06-08T03:48:40.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.163+0000 7f48e2ffd700 1 -- 172.21.15.43:0/826263028 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f48e40180a0 con 0x7f48ec159340 2023-06-08T03:48:40.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f48d006ac50 msgr2=0x7f48d006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:40.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f48d006ac50 0x7f48d006d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007fd0 tx=0x7f48e8009040 comp rx=0 tx=0).stop 2023-06-08T03:48:40.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 msgr2=0x7f48ec15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:40.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 0x7f48ec15b4f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48ec070890 tx=0x7f48e4009750 comp rx=0 tx=0).stop 2023-06-08T03:48:40.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 shutdown_connections 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f48d006ac50 0x7f48d006d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48ec159340 0x7f48ec15b4f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d8005150 0x7f48ec159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 --2- 172.21.15.43:0/826263028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48ec0c7470 0x7f48ec15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.166+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 >> 172.21.15.43:0/826263028 conn(0x7f48ec0cee30 msgr2=0x7f48ec0c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.167+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 shutdown_connections 2023-06-08T03:48:40.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.167+0000 7f48f43b3700 1 -- 172.21.15.43:0/826263028 wait complete. 2023-06-08T03:48:40.173 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2023-06-08T03:48:40.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-08T03:48:40.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.314+0000 7faf6bd40700 1 Processor -- start 2023-06-08T03:48:40.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.314+0000 7faf6bd40700 1 -- start start 2023-06-08T03:48:40.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6bd40700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf6415d5c0 0x7faf6406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6bd40700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faf640d00a0 0x7faf6406a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6bd40700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6406cd70 0x7faf6406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6bd40700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6406d730 con 0x7faf6415d5c0 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6bd40700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6415d990 con 0x7faf640d00a0 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6bd40700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6406e080 con 0x7faf6406cd70 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf69adc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf6415d5c0 0x7faf6406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf69adc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf6415d5c0 0x7faf6406daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57590/0 (socket says 172.21.15.43:57590) 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf69adc700 1 -- 172.21.15.43:0/2450507916 learned_addr learned my addr 172.21.15.43:0/2450507916 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf6a2dd700 1 --2- 172.21.15.43:0/2450507916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6406cd70 0x7faf6406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.315+0000 7faf69adc700 1 -- 172.21.15.43:0/2450507916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6406cd70 msgr2=0x7faf6406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf69adc700 1 --2- 172.21.15.43:0/2450507916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6406cd70 0x7faf6406d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf69adc700 1 -- 172.21.15.43:0/2450507916 >> v2:172.21.15.135:3300/0 conn(0x7faf640d00a0 msgr2=0x7faf6406a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf692db700 1 --2- 172.21.15.43:0/2450507916 >> v2:172.21.15.135:3300/0 conn(0x7faf640d00a0 0x7faf6406a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf69adc700 1 --2- 172.21.15.43:0/2450507916 >> v2:172.21.15.135:3300/0 conn(0x7faf640d00a0 0x7faf6406a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf69adc700 1 -- 172.21.15.43:0/2450507916 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6406e360 con 0x7faf6415d5c0 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf692db700 1 --2- 172.21.15.43:0/2450507916 >> v2:172.21.15.135:3300/0 conn(0x7faf640d00a0 0x7faf6406a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf69adc700 1 --2- 172.21.15.43:0/2450507916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf6415d5c0 0x7faf6406daa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf640709d0 tx=0x7faf54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf640fd52709f7ca server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf68ada700 1 -- 172.21.15.43:0/2450507916 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54005e30 con 0x7faf6415d5c0 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf68ada700 1 -- 172.21.15.43:0/2450507916 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54004030 con 0x7faf6415d5c0 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf68ada700 1 -- 172.21.15.43:0/2450507916 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540043e0 con 0x7faf6415d5c0 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf6bd40700 1 -- 172.21.15.43:0/2450507916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf6415d5c0 msgr2=0x7faf6406daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:40.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.316+0000 7faf6bd40700 1 --2- 172.21.15.43:0/2450507916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf6415d5c0 0x7faf6406daa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf640709d0 tx=0x7faf54009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 -- 172.21.15.43:0/2450507916 shutdown_connections 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 --2- 172.21.15.43:0/2450507916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6406cd70 0x7faf6406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 --2- 172.21.15.43:0/2450507916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf6415d5c0 0x7faf6406daa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 --2- 172.21.15.43:0/2450507916 >> v2:172.21.15.135:3300/0 conn(0x7faf640d00a0 0x7faf6406a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 -- 172.21.15.43:0/2450507916 >> 172.21.15.43:0/2450507916 conn(0x7faf64098b20 msgr2=0x7faf6406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 -- 172.21.15.43:0/2450507916 shutdown_connections 2023-06-08T03:48:40.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.317+0000 7faf6bd40700 1 -- 172.21.15.43:0/2450507916 wait complete. 2023-06-08T03:48:40.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.318+0000 7faf6bd40700 1 Processor -- start 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.318+0000 7faf6bd40700 1 -- start start 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.318+0000 7faf6bd40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6406cd70 0x7faf640ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 0x7faf6415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6415d5c0 0x7faf640af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640cecd0 con 0x7faf640d00a0 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640af610 con 0x7faf6406cd70 2023-06-08T03:48:40.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6415a3d0 con 0x7faf6415d5c0 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 0x7faf6415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 0x7faf6415c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57598/0 (socket says 172.21.15.43:57598) 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6a2dd700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6415d5c0 0x7faf640af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 -- 172.21.15.43:0/4125937633 learned_addr learned my addr 172.21.15.43:0/4125937633 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf69adc700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6406cd70 0x7faf640ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 -- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6415d5c0 msgr2=0x7faf640af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6415d5c0 0x7faf640af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 -- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6406cd70 msgr2=0x7faf640ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6406cd70 0x7faf640ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 -- 172.21.15.43:0/4125937633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009500 con 0x7faf640d00a0 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf692db700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 0x7faf6415c7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf6000c750 tx=0x7faf6000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60011800 con 0x7faf640d00a0 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60011960 con 0x7faf640d00a0 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60011cd0 con 0x7faf640d00a0 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf64154590 con 0x7faf640d00a0 2023-06-08T03:48:40.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.319+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6415a560 con 0x7faf640d00a0 2023-06-08T03:48:40.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.320+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6415a6f0 con 0x7faf640d00a0 2023-06-08T03:48:40.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.321+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7faf60021350 con 0x7faf640d00a0 2023-06-08T03:48:40.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.321+0000 7faf5a7fc700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7faf4806ac50 0x7faf4806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:40.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.321+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7faf60088d20 con 0x7faf640d00a0 2023-06-08T03:48:40.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.321+0000 7faf69adc700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7faf4806ac50 0x7faf4806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:40.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.322+0000 7faf69adc700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7faf4806ac50 0x7faf4806d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf640709d0 tx=0x7faf54008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:40.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.326+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faf60054210 con 0x7faf640d00a0 2023-06-08T03:48:40.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:40.528+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf64154570 con 0x7faf640d00a0 2023-06-08T03:48:41.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.165+0000 7faf5a7fc700 1 -- 172.21.15.43:0/4125937633 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7faf6001e0c0 con 0x7faf640d00a0 2023-06-08T03:48:41.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7faf4806ac50 msgr2=0x7faf4806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7faf4806ac50 0x7faf4806d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf640709d0 tx=0x7faf54008070 comp rx=0 tx=0).stop 2023-06-08T03:48:41.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 msgr2=0x7faf6415c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 0x7faf6415c7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf6000c750 tx=0x7faf6000ca60 comp rx=0 tx=0).stop 2023-06-08T03:48:41.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 shutdown_connections 2023-06-08T03:48:41.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7faf4806ac50 0x7faf4806d100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6415d5c0 0x7faf640af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6406cd70 0x7faf640ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 --2- 172.21.15.43:0/4125937633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf640d00a0 0x7faf6415c7b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.168+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 >> 172.21.15.43:0/4125937633 conn(0x7faf64098b20 msgr2=0x7faf640b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:41.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.169+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 shutdown_connections 2023-06-08T03:48:41.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.169+0000 7faf6bd40700 1 -- 172.21.15.43:0/4125937633 wait complete. 2023-06-08T03:48:41.175 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-08T03:48:41.189 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-08T03:48:41.190 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-08T03:48:41.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-08T03:48:41.192 INFO:tasks.ceph.mds.a:Started 2023-06-08T03:48:41.192 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-08T03:48:41.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-08T03:48:41.194 INFO:tasks.ceph.mds.c:Started 2023-06-08T03:48:41.195 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-08T03:48:41.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-08T03:48:41.197 INFO:tasks.ceph.mds.b:Started 2023-06-08T03:48:41.197 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-08T03:48:41.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-08T03:48:41.199 INFO:tasks.ceph.mds.d:Started 2023-06-08T03:48:41.200 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-08T03:48:41.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:41.288 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-06-08T03:48:41.290 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-06-08T03:48:41.290 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-06-08T03:48:41.300 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-06-08T03:48:41.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.353+0000 7f297199b700 1 Processor -- start 2023-06-08T03:48:41.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.353+0000 7f297199b700 1 -- start start 2023-06-08T03:48:41.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f297199b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f296c0b5000 0x7f296c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f297199b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f296c0cfba0 0x7f296c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f297199b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296c0cf1d0 con 0x7f296c0b80d0 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f297199b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c0ccfc0 con 0x7f296c0cfba0 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f297199b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c0cd790 con 0x7f296c0b5000 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f296c0cfba0 0x7f296c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f296c0cfba0 0x7f296c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57632/0 (socket says 172.21.15.43:57632) 2023-06-08T03:48:41.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 -- 172.21.15.43:0/1588560456 learned_addr learned my addr 172.21.15.43:0/1588560456 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296affd700 1 --1- 172.21.15.43:0/1588560456 >> v1:172.21.15.43:6789/0 conn(0x7f296c0b80d0 0x7f296c1606f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52532/0 (socket says 172.21.15.43:52532) 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296a7fc700 1 --2- 172.21.15.43:0/1588560456 >> v2:172.21.15.135:3300/0 conn(0x7f296c0b5000 0x7f296c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 -- 172.21.15.43:0/1588560456 >> v2:172.21.15.135:3300/0 conn(0x7f296c0b5000 msgr2=0x7f296c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 --2- 172.21.15.43:0/1588560456 >> v2:172.21.15.135:3300/0 conn(0x7f296c0b5000 0x7f296c0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 -- 172.21.15.43:0/1588560456 >> v1:172.21.15.43:6789/0 conn(0x7f296c0b80d0 legacy=0x7f296c1606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f2969ffb700 1 -- 172.21.15.43:0/1588560456 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709899263 0 0) 0x7f296c0cf1d0 con 0x7f296c0b80d0 2023-06-08T03:48:41.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 -- 172.21.15.43:0/1588560456 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c0cebc0 con 0x7f296c0cfba0 2023-06-08T03:48:41.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f296b7fe700 1 --2- 172.21.15.43:0/1588560456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cfba0 0x7f296c0b43f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f296c15d860 tx=0x7f296400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1688747dd70e7f30 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:41.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f2969ffb700 1 -- 172.21.15.43:0/1588560456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400e070 con 0x7f296c0cfba0 2023-06-08T03:48:41.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.354+0000 7f2969ffb700 1 -- 172.21.15.43:0/1588560456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296400b9c0 con 0x7f296c0cfba0 2023-06-08T03:48:41.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f2969ffb700 1 -- 172.21.15.43:0/1588560456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400bd70 con 0x7f296c0cfba0 2023-06-08T03:48:41.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 -- 172.21.15.43:0/1588560456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cfba0 msgr2=0x7f296c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 --2- 172.21.15.43:0/1588560456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cfba0 0x7f296c0b43f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f296c15d860 tx=0x7f296400b330 comp rx=0 tx=0).stop 2023-06-08T03:48:41.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 -- 172.21.15.43:0/1588560456 shutdown_connections 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 --2- 172.21.15.43:0/1588560456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0cfba0 0x7f296c0b43f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 --2- 172.21.15.43:0/1588560456 >> v2:172.21.15.135:3300/0 conn(0x7f296c0b5000 0x7f296c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 -- 172.21.15.43:0/1588560456 >> 172.21.15.43:0/1588560456 conn(0x7f296c072120 msgr2=0x7f296c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 -- 172.21.15.43:0/1588560456 shutdown_connections 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.355+0000 7f297199b700 1 -- 172.21.15.43:0/1588560456 wait complete. 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.356+0000 7f297199b700 1 Processor -- start 2023-06-08T03:48:41.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.356+0000 7f297199b700 1 -- start start 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f297199b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 0x7f296c1e5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f297199b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f296c0b80d0 0x7f296c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f297199b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f296c0cfba0 0x7f296c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f297199b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c14fa60 con 0x7f296c0b5000 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f297199b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c1e5e60 con 0x7f296c0b80d0 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f297199b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c1e6140 con 0x7f296c0cfba0 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f296affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 0x7f296c1e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f296affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 0x7f296c1e5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57634/0 (socket says 172.21.15.43:57634) 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f296affd700 1 -- 172.21.15.43:0/3540206202 learned_addr learned my addr 172.21.15.43:0/3540206202 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f296b7fe700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f296c0cfba0 0x7f296c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.357+0000 7f296a7fc700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f296c0b80d0 0x7f296c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f296affd700 1 -- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f296c0cfba0 msgr2=0x7f296c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f296affd700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f296c0cfba0 0x7f296c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f296affd700 1 -- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f296c0b80d0 msgr2=0x7f296c14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f296affd700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f296c0b80d0 0x7f296c14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f296affd700 1 -- 172.21.15.43:0/3540206202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009b30 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f296affd700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 0x7f296c1e5760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f295c0011e0 tx=0x7f295c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c004c80 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c004e00 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c1e6420 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c007310 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.358+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c1e69e0 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.359+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c1e6c00 con 0x7f296c0b5000 2023-06-08T03:48:41.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.359+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f295c007470 con 0x7f296c0b5000 2023-06-08T03:48:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.360+0000 7f2953fff700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f295806ac50 0x7f295806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.360+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f295c088d60 con 0x7f296c0b5000 2023-06-08T03:48:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.360+0000 7f296a7fc700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f295806ac50 0x7f295806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.360+0000 7f296a7fc700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f295806ac50 0x7f295806d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f296c0aa850 tx=0x7f2960008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.365+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f295c0541b0 con 0x7f296c0b5000 2023-06-08T03:48:41.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.570+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f296c073fa0 con 0x7f296c0b5000 2023-06-08T03:48:41.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.571+0000 7f2953fff700 1 -- 172.21.15.43:0/3540206202 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14605 (secure 0 0 0) 0x7f295c0577d0 con 0x7f296c0b5000 2023-06-08T03:48:41.575 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:41.575 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":16,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:41.162733+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f295806ac50 msgr2=0x7f295806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f295806ac50 0x7f295806d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f296c0aa850 tx=0x7f2960008040 comp rx=0 tx=0).stop 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 msgr2=0x7f296c1e5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 0x7f296c1e5760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f295c0011e0 tx=0x7f295c00ca30 comp rx=0 tx=0).stop 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 shutdown_connections 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f295806ac50 0x7f295806d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f296c0b5000 0x7f296c1e5760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f296c0cfba0 0x7f296c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 --2- 172.21.15.43:0/3540206202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f296c0b80d0 0x7f296c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 >> 172.21.15.43:0/3540206202 conn(0x7f296c072120 msgr2=0x7f296c0d1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 shutdown_connections 2023-06-08T03:48:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.575+0000 7f297199b700 1 -- 172.21.15.43:0/3540206202 wait complete. 2023-06-08T03:48:41.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T03:48:41.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:48:41.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.720+0000 7efd75959700 1 Processor -- start 2023-06-08T03:48:41.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.720+0000 7efd75959700 1 -- start start 2023-06-08T03:48:41.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd75959700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd70071560 0x7efd70069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd75959700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7015c8f0 con 0x7efd7015c520 2023-06-08T03:48:41.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd75959700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd700719b0 con 0x7efd7006a2f0 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd75959700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700cd940 con 0x7efd70071560 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd6effd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7efd7015c520 0x7efd700cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52548/0 (socket says 172.21.15.43:52548) 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd6effd700 1 -- 172.21.15.43:0/2229824823 learned_addr learned my addr 172.21.15.43:0/2229824823 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.721+0000 7efd6e7fc700 1 --2- 172.21.15.43:0/2229824823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd70071560 0x7efd70069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990133 0 0) 0x7efd60001110 con 0x7efd7015c520 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd580035b0 con 0x7efd7015c520 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804548660 0 0) 0x7efd700719b0 con 0x7efd7006a2f0 2023-06-08T03:48:41.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd60001110 con 0x7efd7006a2f0 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6e7fc700 1 -- 172.21.15.43:0/2229824823 >> v1:172.21.15.135:6789/0 conn(0x7efd7006a2f0 legacy=0x7efd700b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6e7fc700 1 -- 172.21.15.43:0/2229824823 >> v1:172.21.15.43:6789/0 conn(0x7efd7015c520 legacy=0x7efd700cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6e7fc700 1 -- 172.21.15.43:0/2229824823 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700cd3c0 con 0x7efd70071560 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6e7fc700 1 --2- 172.21.15.43:0/2229824823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd70071560 0x7efd70069db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd64009870 tx=0x7efd64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48e66a7b7b194b93 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64011830 con 0x7efd70071560 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64011990 con 0x7efd70071560 2023-06-08T03:48:41.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.722+0000 7efd6dffb700 1 -- 172.21.15.43:0/2229824823 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64011d20 con 0x7efd70071560 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 -- 172.21.15.43:0/2229824823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd70071560 msgr2=0x7efd70069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 --2- 172.21.15.43:0/2229824823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd70071560 0x7efd70069db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd64009870 tx=0x7efd64009b80 comp rx=0 tx=0).stop 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 -- 172.21.15.43:0/2229824823 shutdown_connections 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 --2- 172.21.15.43:0/2229824823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd70071560 0x7efd70069db0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 -- 172.21.15.43:0/2229824823 >> 172.21.15.43:0/2229824823 conn(0x7efd7006aec0 msgr2=0x7efd7006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 -- 172.21.15.43:0/2229824823 shutdown_connections 2023-06-08T03:48:41.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.723+0000 7efd75959700 1 -- 172.21.15.43:0/2229824823 wait complete. 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.724+0000 7efd75959700 1 Processor -- start 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.724+0000 7efd75959700 1 -- start start 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd75959700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7006a2f0 0x7efd70152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd75959700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 0x7efd700ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd75959700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7015c520 0x7efd700b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd75959700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700ac3a0 con 0x7efd70071560 2023-06-08T03:48:41.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd75959700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700ac610 con 0x7efd7006a2f0 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd75959700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700ac8f0 con 0x7efd7015c520 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 0x7efd700ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 0x7efd700ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57652/0 (socket says 172.21.15.43:57652) 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 -- 172.21.15.43:0/666122149 learned_addr learned my addr 172.21.15.43:0/666122149 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6effd700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7006a2f0 0x7efd70152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6f7fe700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7015c520 0x7efd700b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 -- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7015c520 msgr2=0x7efd700b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7015c520 0x7efd700b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 -- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7006a2f0 msgr2=0x7efd70152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7006a2f0 0x7efd70152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 -- 172.21.15.43:0/666122149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640094a0 con 0x7efd70071560 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6effd700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7006a2f0 0x7efd70152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.725+0000 7efd6e7fc700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 0x7efd700ae0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efd640090b0 tx=0x7efd64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.726+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6401a860 con 0x7efd70071560 2023-06-08T03:48:41.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.726+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6401a9c0 con 0x7efd70071560 2023-06-08T03:48:41.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.726+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700acbd0 con 0x7efd70071560 2023-06-08T03:48:41.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.726+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6401ad30 con 0x7efd70071560 2023-06-08T03:48:41.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.726+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700ad3d0 con 0x7efd70071560 2023-06-08T03:48:41.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.727+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd70072060 con 0x7efd70071560 2023-06-08T03:48:41.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.727+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7efd64022070 con 0x7efd70071560 2023-06-08T03:48:41.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.728+0000 7efd57fff700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efd5c06ac50 0x7efd5c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:41.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.728+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efd6408a640 con 0x7efd70071560 2023-06-08T03:48:41.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.728+0000 7efd6effd700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efd5c06ac50 0x7efd5c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:41.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.728+0000 7efd6effd700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efd5c06ac50 0x7efd5c06d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd60000f60 tx=0x7efd60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:41.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.738+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd64055b90 con 0x7efd70071560 2023-06-08T03:48:41.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.937+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd700ad0f0 con 0x7efd70071560 2023-06-08T03:48:41.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.938+0000 7efd57fff700 1 -- 172.21.15.43:0/666122149 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd64029020 con 0x7efd70071560 2023-06-08T03:48:41.942 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:48:41.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efd5c06ac50 msgr2=0x7efd5c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efd5c06ac50 0x7efd5c06d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd60000f60 tx=0x7efd60009040 comp rx=0 tx=0).stop 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 msgr2=0x7efd700ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 0x7efd700ae0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efd640090b0 tx=0x7efd64004750 comp rx=0 tx=0).stop 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 shutdown_connections 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efd5c06ac50 0x7efd5c06d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7015c520 0x7efd700b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7006a2f0 0x7efd70152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 --2- 172.21.15.43:0/666122149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd70071560 0x7efd700ae0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:41.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 >> 172.21.15.43:0/666122149 conn(0x7efd7006aec0 msgr2=0x7efd701533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:41.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 shutdown_connections 2023-06-08T03:48:41.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:41.940+0000 7efd75959700 1 -- 172.21.15.43:0/666122149 wait complete. 2023-06-08T03:48:41.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:48:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.079+0000 7f53a49bf700 1 Processor -- start 2023-06-08T03:48:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.079+0000 7f53a49bf700 1 -- start start 2023-06-08T03:48:42.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f53a49bf700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f53a49bf700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 0x7f53a00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f53a49bf700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a00cda20 con 0x7f53a00b60a0 2023-06-08T03:48:42.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f53a49bf700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a00b6470 con 0x7f53a015e340 2023-06-08T03:48:42.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f53a49bf700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a015e7c0 con 0x7f53a00cf5b0 2023-06-08T03:48:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539dd9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539ed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 0x7f53a00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539dd9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a00cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51116/0 (socket says 172.21.15.43:51116) 2023-06-08T03:48:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539e59c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f53a00b60a0 0x7f53a015dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:39782/0 (socket says 172.21.15.43:39782) 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539dd9b700 1 -- 172.21.15.43:0/1791412815 learned_addr learned my addr 172.21.15.43:0/1791412815 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539ed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 0x7f53a00cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:39278/0 (socket says 172.21.15.43:39278) 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.080+0000 7f539d59a700 1 -- 172.21.15.43:0/1791412815 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965422336 0 0) 0x7f53a00cda20 con 0x7f53a00b60a0 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539d59a700 1 -- 172.21.15.43:0/1791412815 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53880035b0 con 0x7f53a00b60a0 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539dd9b700 1 -- 172.21.15.43:0/1791412815 >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 msgr2=0x7f53a00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539dd9b700 1 --2- 172.21.15.43:0/1791412815 >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 0x7f53a00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539dd9b700 1 -- 172.21.15.43:0/1791412815 >> v1:172.21.15.135:6789/0 conn(0x7f53a00b60a0 legacy=0x7f53a015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539dd9b700 1 -- 172.21.15.43:0/1791412815 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a015a520 con 0x7f53a00cf5b0 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539ed9d700 1 --2- 172.21.15.43:0/1791412815 >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 0x7f53a00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539dd9b700 1 --2- 172.21.15.43:0/1791412815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a00cad90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53940098f0 tx=0x7f5394009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f67a574bda12519 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539d59a700 1 -- 172.21.15.43:0/1791412815 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011830 con 0x7f53a00cf5b0 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539d59a700 1 -- 172.21.15.43:0/1791412815 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394011990 con 0x7f53a00cf5b0 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f539d59a700 1 -- 172.21.15.43:0/1791412815 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011d20 con 0x7f53a00cf5b0 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f53a49bf700 1 -- 172.21.15.43:0/1791412815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 msgr2=0x7f53a00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.081+0000 7f53a49bf700 1 --2- 172.21.15.43:0/1791412815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a00cad90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53940098f0 tx=0x7f5394009c00 comp rx=0 tx=0).stop 2023-06-08T03:48:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.082+0000 7f53a49bf700 1 -- 172.21.15.43:0/1791412815 shutdown_connections 2023-06-08T03:48:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.082+0000 7f53a49bf700 1 --2- 172.21.15.43:0/1791412815 >> v2:172.21.15.135:3300/0 conn(0x7f53a015e340 0x7f53a00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.082+0000 7f53a49bf700 1 --2- 172.21.15.43:0/1791412815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a00cad90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.082+0000 7f53a49bf700 1 -- 172.21.15.43:0/1791412815 >> 172.21.15.43:0/1791412815 conn(0x7f53a0069db0 msgr2=0x7f53a006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.082+0000 7f53a49bf700 1 -- 172.21.15.43:0/1791412815 shutdown_connections 2023-06-08T03:48:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.082+0000 7f53a49bf700 1 -- 172.21.15.43:0/1791412815 wait complete. 2023-06-08T03:48:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.083+0000 7f53a49bf700 1 Processor -- start 2023-06-08T03:48:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.083+0000 7f53a49bf700 1 -- start start 2023-06-08T03:48:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.084+0000 7f53a49bf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a00b60a0 0x7f53a00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.084+0000 7f53a49bf700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.084+0000 7f53a49bf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a015e340 0x7f53a00b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.084+0000 7f53a49bf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00c6df0 con 0x7f53a015e340 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.084+0000 7f53a49bf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00c5d50 con 0x7f53a00b60a0 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.084+0000 7f53a49bf700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00c6030 con 0x7f53a00cf5b0 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a015e340 0x7f53a00b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a00b60a0 0x7f53a00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539dd9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a015e340 0x7f53a00b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57668/0 (socket says 172.21.15.43:57668) 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539ed9d700 1 -- 172.21.15.43:0/3616173365 learned_addr learned my addr 172.21.15.43:0/3616173365 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 -- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 msgr2=0x7f53a006ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a006ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 -- 172.21.15.43:0/3616173365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a015e340 msgr2=0x7f53a00b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a015e340 0x7f53a00b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 -- 172.21.15.43:0/3616173365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398009a70 con 0x7f53a00b60a0 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539dd9b700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a006ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f539e59c700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a00b60a0 0x7f53a00c5670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f539000c430 tx=0x7f539000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390005ab0 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5390005c10 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394009550 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.085+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900070d0 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.086+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a00c65f0 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.086+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0073fa0 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.087+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f5390007230 con 0x7f53a00b60a0 2023-06-08T03:48:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.087+0000 7f538effd700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f538006ac50 0x7f538006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.087+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5390088240 con 0x7f53a00b60a0 2023-06-08T03:48:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.087+0000 7f539dd9b700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f538006ac50 0x7f538006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.088+0000 7f539dd9b700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f538006ac50 0x7f538006d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5394000c00 tx=0x7f5394008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.092+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5390053720 con 0x7f53a00b60a0 2023-06-08T03:48:42.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.293+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53a00d1440 con 0x7f53a00b60a0 2023-06-08T03:48:42.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.294+0000 7f538effd700 1 -- 172.21.15.43:0/3616173365 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5390056d40 con 0x7f53a00b60a0 2023-06-08T03:48:42.298 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:48:42.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f538006ac50 msgr2=0x7f538006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f538006ac50 0x7f538006d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5394000c00 tx=0x7f5394008030 comp rx=0 tx=0).stop 2023-06-08T03:48:42.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a00b60a0 msgr2=0x7f53a00c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a00b60a0 0x7f53a00c5670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f539000c430 tx=0x7f539000c740 comp rx=0 tx=0).stop 2023-06-08T03:48:42.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 shutdown_connections 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f538006ac50 0x7f538006d100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a015e340 0x7f53a00b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a00b60a0 0x7f53a00c5670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 --2- 172.21.15.43:0/3616173365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53a00cf5b0 0x7f53a006ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 >> 172.21.15.43:0/3616173365 conn(0x7f53a0069db0 msgr2=0x7f53a006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 shutdown_connections 2023-06-08T03:48:42.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.296+0000 7f53a49bf700 1 -- 172.21.15.43:0/3616173365 wait complete. 2023-06-08T03:48:42.312 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:48:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.435+0000 7f440ebd9700 1 Processor -- start 2023-06-08T03:48:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.435+0000 7f440ebd9700 1 -- start start 2023-06-08T03:48:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440ebd9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4408157d30 0x7f44080cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440ebd9700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44080ce3a0 0x7f44080ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440ebd9700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44080cd770 con 0x7f440815a6a0 2023-06-08T03:48:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440ebd9700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080ced50 con 0x7f44080ce3a0 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440ebd9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4408158100 con 0x7f4408157d30 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440d176700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f440815a6a0 0x7f440815ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52582/0 (socket says 172.21.15.43:52582) 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440d176700 1 -- 172.21.15.43:0/2668662297 learned_addr learned my addr 172.21.15.43:0/2668662297 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f440c975700 1 --2- 172.21.15.43:0/2668662297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4408157d30 0x7f44080cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f4407fff700 1 --2- 172.21.15.43:0/2668662297 >> v2:172.21.15.135:3300/0 conn(0x7f44080ce3a0 0x7f44080ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f44077fe700 1 -- 172.21.15.43:0/2668662297 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900147957 0 0) 0x7f44080cd770 con 0x7f440815a6a0 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.436+0000 7f44077fe700 1 -- 172.21.15.43:0/2668662297 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f40035b0 con 0x7f440815a6a0 2023-06-08T03:48:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440c975700 1 -- 172.21.15.43:0/2668662297 >> v2:172.21.15.135:3300/0 conn(0x7f44080ce3a0 msgr2=0x7f44080ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440c975700 1 --2- 172.21.15.43:0/2668662297 >> v2:172.21.15.135:3300/0 conn(0x7f44080ce3a0 0x7f44080ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440c975700 1 -- 172.21.15.43:0/2668662297 >> v1:172.21.15.43:6789/0 conn(0x7f440815a6a0 legacy=0x7f440815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440c975700 1 -- 172.21.15.43:0/2668662297 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440815b2d0 con 0x7f4408157d30 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f4407fff700 1 --2- 172.21.15.43:0/2668662297 >> v2:172.21.15.135:3300/0 conn(0x7f44080ce3a0 0x7f44080ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440c975700 1 --2- 172.21.15.43:0/2668662297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4408157d30 0x7f44080cdc00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4400009de0 tx=0x7f440000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7550f38ed60a54eb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f44077fe700 1 -- 172.21.15.43:0/2668662297 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000e070 con 0x7f4408157d30 2023-06-08T03:48:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f44077fe700 1 -- 172.21.15.43:0/2668662297 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000bb20 con 0x7f4408157d30 2023-06-08T03:48:42.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f44077fe700 1 -- 172.21.15.43:0/2668662297 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400012430 con 0x7f4408157d30 2023-06-08T03:48:42.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440ebd9700 1 -- 172.21.15.43:0/2668662297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4408157d30 msgr2=0x7f44080cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.437+0000 7f440ebd9700 1 --2- 172.21.15.43:0/2668662297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4408157d30 0x7f44080cdc00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4400009de0 tx=0x7f440000b330 comp rx=0 tx=0).stop 2023-06-08T03:48:42.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.438+0000 7f440ebd9700 1 -- 172.21.15.43:0/2668662297 shutdown_connections 2023-06-08T03:48:42.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.438+0000 7f440ebd9700 1 --2- 172.21.15.43:0/2668662297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4408157d30 0x7f44080cdc00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.438+0000 7f440ebd9700 1 --2- 172.21.15.43:0/2668662297 >> v2:172.21.15.135:3300/0 conn(0x7f44080ce3a0 0x7f44080ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.438+0000 7f440ebd9700 1 -- 172.21.15.43:0/2668662297 >> 172.21.15.43:0/2668662297 conn(0x7f440806a6d0 msgr2=0x7f4408099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.438+0000 7f440ebd9700 1 -- 172.21.15.43:0/2668662297 shutdown_connections 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.438+0000 7f440ebd9700 1 -- 172.21.15.43:0/2668662297 wait complete. 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.439+0000 7f440ebd9700 1 Processor -- start 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.439+0000 7f440ebd9700 1 -- start start 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440ebd9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 0x7f44081f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440ebd9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4408157d30 0x7f44080b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440ebd9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f440815a6a0 0x7f440806b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440ebd9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440806be10 con 0x7f44080ce3a0 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440ebd9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080b1240 con 0x7f4408157d30 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440ebd9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44081f1ef0 con 0x7f440815a6a0 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440c975700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 0x7f44081f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440c975700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 0x7f44081f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57680/0 (socket says 172.21.15.43:57680) 2023-06-08T03:48:42.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.440+0000 7f440c975700 1 -- 172.21.15.43:0/950828258 learned_addr learned my addr 172.21.15.43:0/950828258 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440d176700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f440815a6a0 0x7f440806b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f4407fff700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4408157d30 0x7f44080b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440c975700 1 -- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f440815a6a0 msgr2=0x7f440806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440c975700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f440815a6a0 0x7f440806b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440c975700 1 -- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4408157d30 msgr2=0x7f44080b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440c975700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4408157d30 0x7f44080b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440c975700 1 -- 172.21.15.43:0/950828258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00094a0 con 0x7f44080ce3a0 2023-06-08T03:48:42.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f4407fff700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4408157d30 0x7f44080b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440d176700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f440815a6a0 0x7f440806b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440c975700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 0x7f44081f18a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f440000b370 tx=0x7f4400004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400012430 con 0x7f44080ce3a0 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400020070 con 0x7f44080ce3a0 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4400009a70 con 0x7f44080ce3a0 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400004280 con 0x7f44080ce3a0 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.441+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44081f24b0 con 0x7f44080ce3a0 2023-06-08T03:48:42.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.442+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080af240 con 0x7f44080ce3a0 2023-06-08T03:48:42.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.443+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f44000043e0 con 0x7f44080ce3a0 2023-06-08T03:48:42.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.443+0000 7f44057fa700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f43e806ac50 0x7f43e806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.443+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4400022070 con 0x7f44080ce3a0 2023-06-08T03:48:42.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.443+0000 7f4407fff700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f43e806ac50 0x7f43e806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.444+0000 7f4407fff700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f43e806ac50 0x7f43e806d100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44080b4510 tx=0x7f43f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.448+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44000bd310 con 0x7f44080ce3a0 2023-06-08T03:48:42.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.460+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4400056ac0 con 0x7f44080ce3a0 2023-06-08T03:48:42.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.693+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44080b29f0 con 0x7f44080ce3a0 2023-06-08T03:48:42.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.694+0000 7f44057fa700 1 -- 172.21.15.43:0/950828258 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f4400083f70 con 0x7f44080ce3a0 2023-06-08T03:48:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:42.698 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-08T03:48:42.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f43e806ac50 msgr2=0x7f43e806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f43e806ac50 0x7f43e806d100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44080b4510 tx=0x7f43f0008040 comp rx=0 tx=0).stop 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 msgr2=0x7f44081f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 0x7f44081f18a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f440000b370 tx=0x7f4400004ad0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 shutdown_connections 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f43e806ac50 0x7f43e806d100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44080ce3a0 0x7f44081f18a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f440815a6a0 0x7f440806b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 --2- 172.21.15.43:0/950828258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4408157d30 0x7f44080b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 >> 172.21.15.43:0/950828258 conn(0x7f440806a6d0 msgr2=0x7f440815ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:42.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 shutdown_connections 2023-06-08T03:48:42.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.696+0000 7f440ebd9700 1 -- 172.21.15.43:0/950828258 wait complete. 2023-06-08T03:48:42.702 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2023-06-08T03:48:42.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:42.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.834+0000 7ff0d645f700 1 Processor -- start 2023-06-08T03:48:42.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.834+0000 7ff0d645f700 1 -- start start 2023-06-08T03:48:42.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0d645f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0d00b80d0 0x7ff0d01606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0d645f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0d00b5000 0x7ff0d00cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0d645f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00cf1d0 con 0x7ff0d00cfba0 2023-06-08T03:48:42.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0d645f700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00ccfc0 con 0x7ff0d00b5000 2023-06-08T03:48:42.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0d645f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00cd790 con 0x7ff0d00b80d0 2023-06-08T03:48:42.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0cf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0d00b5000 0x7ff0d00cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0cf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0d00b5000 0x7ff0d00cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57690/0 (socket says 172.21.15.43:57690) 2023-06-08T03:48:42.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0cf7fe700 1 -- 172.21.15.43:0/3636079081 learned_addr learned my addr 172.21.15.43:0/3636079081 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:42.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.835+0000 7ff0cffff700 1 --2- 172.21.15.43:0/3636079081 >> v2:172.21.15.135:3300/0 conn(0x7ff0d00b80d0 0x7ff0d01606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0cf7fe700 1 -- 172.21.15.43:0/3636079081 >> v2:172.21.15.135:3300/0 conn(0x7ff0d00b80d0 msgr2=0x7ff0d01606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:42.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0cf7fe700 1 --2- 172.21.15.43:0/3636079081 >> v2:172.21.15.135:3300/0 conn(0x7ff0d00b80d0 0x7ff0d01606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0cf7fe700 1 -- 172.21.15.43:0/3636079081 >> v1:172.21.15.135:6789/0 conn(0x7ff0d00cfba0 legacy=0x7ff0d00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0cf7fe700 1 -- 172.21.15.43:0/3636079081 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0160c30 con 0x7ff0d00b5000 2023-06-08T03:48:42.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0cf7fe700 1 --2- 172.21.15.43:0/3636079081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d00cf660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0d006cd20 tx=0x7ff0c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3647236597ade6d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0ceffd700 1 -- 172.21.15.43:0/3636079081 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4011830 con 0x7ff0d00b5000 2023-06-08T03:48:42.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0ceffd700 1 -- 172.21.15.43:0/3636079081 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4011990 con 0x7ff0d00b5000 2023-06-08T03:48:42.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.836+0000 7ff0ceffd700 1 -- 172.21.15.43:0/3636079081 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4011d20 con 0x7ff0d00b5000 2023-06-08T03:48:42.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 -- 172.21.15.43:0/3636079081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 msgr2=0x7ff0d00cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3636079081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d00cf660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0d006cd20 tx=0x7ff0c4009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 -- 172.21.15.43:0/3636079081 shutdown_connections 2023-06-08T03:48:42.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3636079081 >> v2:172.21.15.135:3300/0 conn(0x7ff0d00b80d0 0x7ff0d01606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3636079081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d00cf660 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 -- 172.21.15.43:0/3636079081 >> 172.21.15.43:0/3636079081 conn(0x7ff0d0072120 msgr2=0x7ff0d006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:42.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 -- 172.21.15.43:0/3636079081 shutdown_connections 2023-06-08T03:48:42.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.837+0000 7ff0d645f700 1 -- 172.21.15.43:0/3636079081 wait complete. 2023-06-08T03:48:42.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.838+0000 7ff0d645f700 1 Processor -- start 2023-06-08T03:48:42.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.838+0000 7ff0d645f700 1 -- start start 2023-06-08T03:48:42.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0d645f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0d645f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d00b80d0 0x7ff0d00abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0d645f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d00cfba0 0x7ff0d00ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0d645f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d014f820 con 0x7ff0d00b5000 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0d645f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00cc1b0 con 0x7ff0d00cfba0 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0d645f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00cc490 con 0x7ff0d00b80d0 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0cffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0cffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d014eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57694/0 (socket says 172.21.15.43:57694) 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.839+0000 7ff0cffff700 1 -- 172.21.15.43:0/3724619651 learned_addr learned my addr 172.21.15.43:0/3724619651 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cf7fe700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d00b80d0 0x7ff0d00abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0d49fc700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d00cfba0 0x7ff0d00ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cffff700 1 -- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d00b80d0 msgr2=0x7ff0d00abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cffff700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d00b80d0 0x7ff0d00abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cffff700 1 -- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d00cfba0 msgr2=0x7ff0d00ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cffff700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d00cfba0 0x7ff0d00ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cffff700 1 -- 172.21.15.43:0/3724619651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4009550 con 0x7ff0d00b5000 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0cffff700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d014eca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000e9b0 tx=0x7ff0c000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0009710 con 0x7ff0d00b5000 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000ee50 con 0x7ff0d00b5000 2023-06-08T03:48:42.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d014fa70 con 0x7ff0d00b5000 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000ca50 con 0x7ff0d00b5000 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.840+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d014f1e0 con 0x7ff0d00b5000 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.841+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d014ff90 con 0x7ff0d00b5000 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.842+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0c000cbb0 con 0x7ff0d00b5000 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.842+0000 7ff0ccff9700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0bc06ace0 0x7ff0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.842+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff0c0089090 con 0x7ff0d00b5000 2023-06-08T03:48:42.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.842+0000 7ff0cf7fe700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0bc06ace0 0x7ff0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:42.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.843+0000 7ff0cf7fe700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0bc06ace0 0x7ff0bc06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009c10 tx=0x7ff0c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:42.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:42.847+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0d014ff90 con 0x7ff0d00b5000 2023-06-08T03:48:43.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.047+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d014ff90 con 0x7ff0d00b5000 2023-06-08T03:48:43.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.048+0000 7ff0ccff9700 1 -- 172.21.15.43:0/3724619651 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14579 (secure 0 0 0) 0x7ff0d014ff90 con 0x7ff0d00b5000 2023-06-08T03:48:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:43.053 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:42.173360+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:43.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0bc06ace0 msgr2=0x7ff0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0bc06ace0 0x7ff0bc06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009c10 tx=0x7ff0c4008030 comp rx=0 tx=0).stop 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 msgr2=0x7ff0d014eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d014eca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000e9b0 tx=0x7ff0c000ecc0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 shutdown_connections 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0bc06ace0 0x7ff0bc06d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0d00b5000 0x7ff0d014eca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d00cfba0 0x7ff0d00ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 --2- 172.21.15.43:0/3724619651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d00b80d0 0x7ff0d00abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 >> 172.21.15.43:0/3724619651 conn(0x7ff0d0072120 msgr2=0x7ff0d00b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:43.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 shutdown_connections 2023-06-08T03:48:43.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.050+0000 7ff0d645f700 1 -- 172.21.15.43:0/3724619651 wait complete. 2023-06-08T03:48:43.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T03:48:43.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:48:43.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.190+0000 7f34c1246700 1 Processor -- start 2023-06-08T03:48:43.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.190+0000 7f34c1246700 1 -- start start 2023-06-08T03:48:43.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34c1246700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34bc071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34c1246700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0cf4c0 con 0x7f34bc15c6d0 2023-06-08T03:48:43.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34c1246700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0b2090 con 0x7f34bc15c300 2023-06-08T03:48:43.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34c1246700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0cd910 con 0x7f34bc06a4c0 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34ba59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f34bc15c6d0 0x7f34bc069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52606/0 (socket says 172.21.15.43:52606) 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34ba59c700 1 -- 172.21.15.43:0/2376876161 learned_addr learned my addr 172.21.15.43:0/2376876161 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094313765 0 0) 0x7f34bc0cf4c0 con 0x7f34bc15c6d0 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a40035b0 con 0x7f34bc15c6d0 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34bb59e700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34bc071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825782293 0 0) 0x7f34a40035b0 con 0x7f34bc15c6d0 2023-06-08T03:48:43.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 msgr2=0x7f34bc071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.191+0000 7f34b9d9b700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34bc071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 >> v1:172.21.15.135:6789/0 conn(0x7f34bc15c300 legacy=0x7f34bc0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0b1db0 con 0x7f34bc15c6d0 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f34ac001670 con 0x7f34bc15c6d0 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 >> v1:172.21.15.43:6789/0 conn(0x7f34bc15c6d0 legacy=0x7f34bc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a4003a30 0x7f34a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34a4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34a4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0cd910 con 0x7f34a4004850 2023-06-08T03:48:43.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a400bb10 con 0x7f34a4003a30 2023-06-08T03:48:43.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a400bcd0 con 0x7f34bc06a4c0 2023-06-08T03:48:43.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34a4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34bad9d700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a4003a30 0x7f34a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34bb59e700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34a4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 -- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 msgr2=0x7f34a4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34a4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 -- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a4003a30 msgr2=0x7f34a4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a4003a30 0x7f34a4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 -- 172.21.15.43:0/2376876161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40035b0 con 0x7f34a4004850 2023-06-08T03:48:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34bb59e700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc06a4c0 0x7f34a4005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34ba59c700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34a4004cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00c240 tx=0x7f34a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ff28506367299 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac007c10 con 0x7f34a4004850 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac00ce00 con 0x7f34a4004850 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.192+0000 7f34b9d9b700 1 -- 172.21.15.43:0/2376876161 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac005ba0 con 0x7f34a4004850 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34c1246700 1 -- 172.21.15.43:0/2376876161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 msgr2=0x7f34a4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34c1246700 1 --2- 172.21.15.43:0/2376876161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34a4004cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00c240 tx=0x7f34a4005880 comp rx=0 tx=0).stop 2023-06-08T03:48:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34bb59e700 1 -- 172.21.15.43:0/2376876161 reap_dead start 2023-06-08T03:48:43.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34c1246700 1 -- 172.21.15.43:0/2376876161 shutdown_connections 2023-06-08T03:48:43.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34c1246700 1 -- 172.21.15.43:0/2376876161 >> 172.21.15.43:0/2376876161 conn(0x7f34bc06aec0 msgr2=0x7f34bc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:43.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34c1246700 1 -- 172.21.15.43:0/2376876161 shutdown_connections 2023-06-08T03:48:43.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.193+0000 7f34c1246700 1 -- 172.21.15.43:0/2376876161 wait complete. 2023-06-08T03:48:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.194+0000 7f34c1246700 1 Processor -- start 2023-06-08T03:48:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.194+0000 7f34c1246700 1 -- start start 2023-06-08T03:48:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34c1246700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34bc152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34c1246700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc0b4230 0x7f34bc0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34c1246700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34bc0b4be0 0x7f34bc0c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34c1246700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1532b0 con 0x7f34a4004850 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34c1246700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1560a0 con 0x7f34bc0b4be0 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34c1246700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc155a70 con 0x7f34bc0b4230 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34bad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34bc152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34bad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34bc152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57714/0 (socket says 172.21.15.43:57714) 2023-06-08T03:48:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34bad9d700 1 -- 172.21.15.43:0/297297921 learned_addr learned my addr 172.21.15.43:0/297297921 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:43.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34ba59c700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc0b4230 0x7f34bc0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.195+0000 7f34bb59e700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34bc0b4be0 0x7f34bc0c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34bad9d700 1 -- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc0b4230 msgr2=0x7f34bc0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34bad9d700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc0b4230 0x7f34bc0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34bad9d700 1 -- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34bc0b4be0 msgr2=0x7f34bc0c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34bad9d700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34bc0b4be0 0x7f34bc0c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34bad9d700 1 -- 172.21.15.43:0/297297921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0b51d0 con 0x7f34a4004850 2023-06-08T03:48:43.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34bad9d700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34bc152760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f34b000f820 tx=0x7f34b000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00052e0 con 0x7f34a4004850 2023-06-08T03:48:43.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0005440 con 0x7f34a4004850 2023-06-08T03:48:43.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc155d30 con 0x7f34a4004850 2023-06-08T03:48:43.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00038a0 con 0x7f34a4004850 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.196+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc156530 con 0x7f34a4004850 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.197+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc156380 con 0x7f34a4004850 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.197+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34b0003a00 con 0x7f34a4004850 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.198+0000 7f34a37fe700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f34a806ad10 0x7f34a806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.198+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f34b0088d80 con 0x7f34a4004850 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.198+0000 7f34ba59c700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f34a806ad10 0x7f34a806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.199+0000 7f34ba59c700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f34a806ad10 0x7f34a806d1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0accf0 tx=0x7f34ac007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.202+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34b0054180 con 0x7f34a4004850 2023-06-08T03:48:43.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.401+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34bc06f630 con 0x7f34a4004850 2023-06-08T03:48:43.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.402+0000 7f34a37fe700 1 -- 172.21.15.43:0/297297921 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34b0003cb0 con 0x7f34a4004850 2023-06-08T03:48:43.406 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:48:43.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f34a806ad10 msgr2=0x7f34a806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f34a806ad10 0x7f34a806d1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0accf0 tx=0x7f34ac007000 comp rx=0 tx=0).stop 2023-06-08T03:48:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 msgr2=0x7f34bc152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34bc152760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f34b000f820 tx=0x7f34b000fb30 comp rx=0 tx=0).stop 2023-06-08T03:48:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 shutdown_connections 2023-06-08T03:48:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f34a806ad10 0x7f34a806d1c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34a4004850 0x7f34bc152760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34bc0b4be0 0x7f34bc0c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 --2- 172.21.15.43:0/297297921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34bc0b4230 0x7f34bc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 >> 172.21.15.43:0/297297921 conn(0x7f34bc06aec0 msgr2=0x7f34bc15e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:43.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 shutdown_connections 2023-06-08T03:48:43.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.404+0000 7f34c1246700 1 -- 172.21.15.43:0/297297921 wait complete. 2023-06-08T03:48:43.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:48:43.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.543+0000 7fbf9e4bd700 1 Processor -- start 2023-06-08T03:48:43.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.543+0000 7fbf9e4bd700 1 -- start start 2023-06-08T03:48:43.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9e4bd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf9815c3b0 0x7fbf980b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9e4bd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf9806a4c0 0x7fbf980b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9e4bd700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf98071cc0 con 0x7fbf9815c780 2023-06-08T03:48:43.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9e4bd700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf98071a00 con 0x7fbf9806a4c0 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9e4bd700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf980b1fc0 con 0x7fbf9815c3b0 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9ca5a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf9806a4c0 0x7fbf980b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9ca5a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf9806a4c0 0x7fbf980b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57726/0 (socket says 172.21.15.43:57726) 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.544+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/3323319142 learned_addr learned my addr 172.21.15.43:0/3323319142 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf97fff700 1 --2- 172.21.15.43:0/3323319142 >> v2:172.21.15.135:3300/0 conn(0x7fbf9815c3b0 0x7fbf980b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/3323319142 >> v2:172.21.15.135:3300/0 conn(0x7fbf9815c3b0 msgr2=0x7fbf980b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9ca5a700 1 --2- 172.21.15.43:0/3323319142 >> v2:172.21.15.135:3300/0 conn(0x7fbf9815c3b0 0x7fbf980b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/3323319142 >> v1:172.21.15.135:6789/0 conn(0x7fbf9815c780 legacy=0x7fbf98069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/3323319142 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980cf320 con 0x7fbf9806a4c0 2023-06-08T03:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9ca5a700 1 --2- 172.21.15.43:0/3323319142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9806a4c0 0x7fbf980b24a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf980b1340 tx=0x7fbf9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6029becea8b67e13 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf96ffd700 1 -- 172.21.15.43:0/3323319142 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000e070 con 0x7fbf9806a4c0 2023-06-08T03:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf96ffd700 1 -- 172.21.15.43:0/3323319142 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90003a20 con 0x7fbf9806a4c0 2023-06-08T03:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf96ffd700 1 -- 172.21.15.43:0/3323319142 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90003dd0 con 0x7fbf9806a4c0 2023-06-08T03:48:43.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/3323319142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9806a4c0 msgr2=0x7fbf980b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.545+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/3323319142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9806a4c0 0x7fbf980b24a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf980b1340 tx=0x7fbf9000b330 comp rx=0 tx=0).stop 2023-06-08T03:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.546+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/3323319142 shutdown_connections 2023-06-08T03:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.546+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/3323319142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9806a4c0 0x7fbf980b24a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.546+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/3323319142 >> v2:172.21.15.135:3300/0 conn(0x7fbf9815c3b0 0x7fbf980b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.546+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/3323319142 >> 172.21.15.43:0/3323319142 conn(0x7fbf9806aec0 msgr2=0x7fbf9806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.546+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/3323319142 shutdown_connections 2023-06-08T03:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.546+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/3323319142 wait complete. 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.547+0000 7fbf9e4bd700 1 Processor -- start 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.547+0000 7fbf9e4bd700 1 -- start start 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9e4bd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9806a4c0 0x7fbf980ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9e4bd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9815c3b0 0x7fbf980b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9e4bd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 0x7fbf980b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9e4bd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9815e600 con 0x7fbf9815c780 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9e4bd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9815d980 con 0x7fbf9815c3b0 2023-06-08T03:48:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9e4bd700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9815dc60 con 0x7fbf9806a4c0 2023-06-08T03:48:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 0x7fbf980b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 0x7fbf980b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57732/0 (socket says 172.21.15.43:57732) 2023-06-08T03:48:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/2202051416 learned_addr learned my addr 172.21.15.43:0/2202051416 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf977fe700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9815c3b0 0x7fbf980b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf97fff700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9806a4c0 0x7fbf980ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9806a4c0 msgr2=0x7fbf980ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9806a4c0 0x7fbf980ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9815c3b0 msgr2=0x7fbf980b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9815c3b0 0x7fbf980b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 -- 172.21.15.43:0/2202051416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf90009b30 con 0x7fbf9815c780 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf97fff700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9806a4c0 0x7fbf980ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.548+0000 7fbf9ca5a700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 0x7fbf980b4470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000b370 tx=0x7fbf90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.549+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90004440 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.549+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf900045c0 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.549+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9815df40 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.549+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90004970 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.549+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf980ae860 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.549+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf98073fa0 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.550+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf90012430 con 0x7fbf9815c780 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.550+0000 7fbf94ff9700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbf7806ace0 0x7fbf7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.550+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbf9008a490 con 0x7fbf9815c780 2023-06-08T03:48:43.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.551+0000 7fbf97fff700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbf7806ace0 0x7fbf7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.551+0000 7fbf97fff700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbf7806ace0 0x7fbf7806d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf9815ad80 tx=0x7fbf88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.555+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf900593b0 con 0x7fbf9815c780 2023-06-08T03:48:43.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.751+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf980b55d0 con 0x7fbf9815c780 2023-06-08T03:48:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.751+0000 7fbf94ff9700 1 -- 172.21.15.43:0/2202051416 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf90058f40 con 0x7fbf9815c780 2023-06-08T03:48:43.756 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:48:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbf7806ace0 msgr2=0x7fbf7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbf7806ace0 0x7fbf7806d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf9815ad80 tx=0x7fbf88008040 comp rx=0 tx=0).stop 2023-06-08T03:48:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 msgr2=0x7fbf980b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 0x7fbf980b4470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000b370 tx=0x7fbf90004ad0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 shutdown_connections 2023-06-08T03:48:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbf7806ace0 0x7fbf7806d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf9815c780 0x7fbf980b4470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9806a4c0 0x7fbf980ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 --2- 172.21.15.43:0/2202051416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9815c3b0 0x7fbf980b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 >> 172.21.15.43:0/2202051416 conn(0x7fbf9806aec0 msgr2=0x7fbf980cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 shutdown_connections 2023-06-08T03:48:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.753+0000 7fbf9e4bd700 1 -- 172.21.15.43:0/2202051416 wait complete. 2023-06-08T03:48:43.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-08T03:48:43.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.889+0000 7fd8e2d01700 1 Processor -- start 2023-06-08T03:48:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.889+0000 7fd8e2d01700 1 -- start start 2023-06-08T03:48:43.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.890+0000 7fd8e2d01700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc15c590 0x7fd8dc0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.890+0000 7fd8e2d01700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8dc06a4c0 0x7fd8dc0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.890+0000 7fd8e2d01700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0af050 con 0x7fd8dc0ccba0 2023-06-08T03:48:43.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.890+0000 7fd8e2d01700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0afae0 con 0x7fd8dc06a4c0 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.890+0000 7fd8e2d01700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0ccff0 con 0x7fd8dc15c590 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e0a9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc15c590 0x7fd8dc0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e129e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8dc06a4c0 0x7fd8dc0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8dbfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd8dc0ccba0 0x7fd8dc069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:39860/0 (socket says 172.21.15.43:39860) 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e129e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8dc06a4c0 0x7fd8dc0b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:39354/0 (socket says 172.21.15.43:39354) 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8dbfff700 1 -- 172.21.15.43:0/1639652809 learned_addr learned my addr 172.21.15.43:0/1639652809 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e0a9d700 1 -- 172.21.15.43:0/1639652809 >> v2:172.21.15.135:3300/0 conn(0x7fd8dc06a4c0 msgr2=0x7fd8dc0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:43.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e0a9d700 1 --2- 172.21.15.43:0/1639652809 >> v2:172.21.15.135:3300/0 conn(0x7fd8dc06a4c0 0x7fd8dc0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e0a9d700 1 -- 172.21.15.43:0/1639652809 >> v1:172.21.15.135:6789/0 conn(0x7fd8dc0ccba0 legacy=0x7fd8dc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e0a9d700 1 -- 172.21.15.43:0/1639652809 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0af800 con 0x7fd8dc15c590 2023-06-08T03:48:43.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8e0a9d700 1 --2- 172.21.15.43:0/1639652809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc15c590 0x7fd8dc0af220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009820 tx=0x7fd8d0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6faad4c8b245d63e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8db7fe700 1 -- 172.21.15.43:0/1639652809 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0005e30 con 0x7fd8dc15c590 2023-06-08T03:48:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8db7fe700 1 -- 172.21.15.43:0/1639652809 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0006030 con 0x7fd8dc15c590 2023-06-08T03:48:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.891+0000 7fd8db7fe700 1 -- 172.21.15.43:0/1639652809 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00063c0 con 0x7fd8dc15c590 2023-06-08T03:48:43.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 -- 172.21.15.43:0/1639652809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc15c590 msgr2=0x7fd8dc0af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/1639652809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc15c590 0x7fd8dc0af220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009820 tx=0x7fd8d0009b30 comp rx=0 tx=0).stop 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 -- 172.21.15.43:0/1639652809 shutdown_connections 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/1639652809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc15c590 0x7fd8dc0af220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/1639652809 >> v2:172.21.15.135:3300/0 conn(0x7fd8dc06a4c0 0x7fd8dc0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 -- 172.21.15.43:0/1639652809 >> 172.21.15.43:0/1639652809 conn(0x7fd8dc06b7e0 msgr2=0x7fd8dc0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 -- 172.21.15.43:0/1639652809 shutdown_connections 2023-06-08T03:48:43.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.892+0000 7fd8e2d01700 1 -- 172.21.15.43:0/1639652809 wait complete. 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.893+0000 7fd8e2d01700 1 Processor -- start 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.893+0000 7fd8e2d01700 1 -- start start 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e2d01700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc06a4c0 0x7fd8dc1466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e2d01700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc0ccba0 0x7fd8dc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e2d01700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 0x7fd8dc1f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e2d01700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c97b0 con 0x7fd8dc15c590 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e2d01700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c8710 con 0x7fd8dc0ccba0 2023-06-08T03:48:43.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e2d01700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c89f0 con 0x7fd8dc06a4c0 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e129e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 0x7fd8dc1f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e129e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 0x7fd8dc1f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57744/0 (socket says 172.21.15.43:57744) 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e129e700 1 -- 172.21.15.43:0/450041904 learned_addr learned my addr 172.21.15.43:0/450041904 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.894+0000 7fd8e0a9d700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc06a4c0 0x7fd8dc1466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8dbfff700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc0ccba0 0x7fd8dc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e129e700 1 -- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc06a4c0 msgr2=0x7fd8dc1466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e129e700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc06a4c0 0x7fd8dc1466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e129e700 1 -- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc0ccba0 msgr2=0x7fd8dc0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e129e700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc0ccba0 0x7fd8dc0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e129e700 1 -- 172.21.15.43:0/450041904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0009430 con 0x7fd8dc15c590 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e129e700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 0x7fd8dc1f4e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ef90 tx=0x7fd8d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4009ca0 con 0x7fd8dc15c590 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d400f040 con 0x7fd8dc15c590 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc0c8cd0 con 0x7fd8dc15c590 2023-06-08T03:48:43.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4014480 con 0x7fd8dc15c590 2023-06-08T03:48:43.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.895+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc0c9290 con 0x7fd8dc15c590 2023-06-08T03:48:43.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.896+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0c94b0 con 0x7fd8dc15c590 2023-06-08T03:48:43.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.896+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd8d40145e0 con 0x7fd8dc15c590 2023-06-08T03:48:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.897+0000 7fd8d97fa700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd8c006ace0 0x7fd8c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.897+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd8d4089a90 con 0x7fd8dc15c590 2023-06-08T03:48:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.897+0000 7fd8e0a9d700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd8c006ace0 0x7fd8c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.897+0000 7fd8e0a9d700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd8c006ace0 0x7fd8c006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009b70 tx=0x7fd8d0008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:43.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:43.901+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd8d40589b0 con 0x7fd8dc15c590 2023-06-08T03:48:44.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.103+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd8dc073fa0 con 0x7fd8dc15c590 2023-06-08T03:48:44.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.104+0000 7fd8d97fa700 1 -- 172.21.15.43:0/450041904 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd8d4058540 con 0x7fd8dc15c590 2023-06-08T03:48:44.108 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:44.109 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-06-08T03:48:44.109 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:48:44.109 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-06-08T03:48:44.109 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-06-08T03:48:44.109 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:48:44.109 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:48:44.110 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-06-08T03:48:44.110 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-06-08T03:48:44.110 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:48:44.110 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-06-08T03:48:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd8c006ace0 msgr2=0x7fd8c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd8c006ace0 0x7fd8c006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009b70 tx=0x7fd8d0008070 comp rx=0 tx=0).stop 2023-06-08T03:48:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 msgr2=0x7fd8dc1f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 0x7fd8dc1f4e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ef90 tx=0x7fd8d400c3a0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 shutdown_connections 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd8c006ace0 0x7fd8c006d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15c590 0x7fd8dc1f4e40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8dc06a4c0 0x7fd8dc1466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 --2- 172.21.15.43:0/450041904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc0ccba0 0x7fd8dc0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 >> 172.21.15.43:0/450041904 conn(0x7fd8dc06b7e0 msgr2=0x7fd8dc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 shutdown_connections 2023-06-08T03:48:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.106+0000 7fd8e2d01700 1 -- 172.21.15.43:0/450041904 wait complete. 2023-06-08T03:48:44.122 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-08T03:48:44.123 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-08T03:48:44.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.247+0000 7f7d94ced700 1 Processor -- start 2023-06-08T03:48:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.247+0000 7f7d94ced700 1 -- start start 2023-06-08T03:48:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d94ced700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d900cc180 0x7f7d900ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d94ced700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d900ac380 con 0x7f7d9015c660 2023-06-08T03:48:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d94ced700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d900acc20 con 0x7f7d9006a4c0 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d94ced700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900c9dc0 con 0x7f7d900cc180 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d8e59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7d9015c660 0x7f7d90069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52652/0 (socket says 172.21.15.43:52652) 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d8e59c700 1 -- 172.21.15.43:0/2824277441 learned_addr learned my addr 172.21.15.43:0/2824277441 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d8ed9d700 1 --2- 172.21.15.43:0/2824277441 >> v2:172.21.15.135:3300/0 conn(0x7f7d900cc180 0x7f7d900ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.248+0000 7f7d8d59a700 1 -- 172.21.15.43:0/2824277441 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103635271 0 0) 0x7f7d900ac380 con 0x7f7d9015c660 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8d59a700 1 -- 172.21.15.43:0/2824277441 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d780035b0 con 0x7f7d9015c660 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/2824277441 >> v1:172.21.15.135:6789/0 conn(0x7f7d9006a4c0 legacy=0x7f7d900ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/2824277441 >> v1:172.21.15.43:6789/0 conn(0x7f7d9015c660 legacy=0x7f7d90069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/2824277441 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900aecb0 con 0x7f7d900cc180 2023-06-08T03:48:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8ed9d700 1 --2- 172.21.15.43:0/2824277441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900ae5b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009d90 tx=0x7f7d8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129cc6369abf83ff server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8d59a700 1 -- 172.21.15.43:0/2824277441 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800e070 con 0x7f7d900cc180 2023-06-08T03:48:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8d59a700 1 -- 172.21.15.43:0/2824277441 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8800bb20 con 0x7f7d900cc180 2023-06-08T03:48:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.249+0000 7f7d8d59a700 1 -- 172.21.15.43:0/2824277441 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88012430 con 0x7f7d900cc180 2023-06-08T03:48:44.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 -- 172.21.15.43:0/2824277441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 msgr2=0x7f7d900ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 --2- 172.21.15.43:0/2824277441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900ae5b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009d90 tx=0x7f7d8800b330 comp rx=0 tx=0).stop 2023-06-08T03:48:44.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 -- 172.21.15.43:0/2824277441 shutdown_connections 2023-06-08T03:48:44.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 --2- 172.21.15.43:0/2824277441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900ae5b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 -- 172.21.15.43:0/2824277441 >> 172.21.15.43:0/2824277441 conn(0x7f7d90098b20 msgr2=0x7f7d9006b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 -- 172.21.15.43:0/2824277441 shutdown_connections 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.250+0000 7f7d94ced700 1 -- 172.21.15.43:0/2824277441 wait complete. 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.251+0000 7f7d94ced700 1 Processor -- start 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.251+0000 7f7d94ced700 1 -- start start 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d94ced700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d9006a4c0 0x7f7d900b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d94ced700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d94ced700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 0x7f7d900afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d94ced700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900c5170 con 0x7f7d9015c660 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d94ced700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900c48d0 con 0x7f7d900cc180 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d94ced700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900c4bb0 con 0x7f7d9006a4c0 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 0x7f7d900afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 0x7f7d900afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57758/0 (socket says 172.21.15.43:57758) 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/3691170663 learned_addr learned my addr 172.21.15.43:0/3691170663 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:44.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8e59c700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d9006a4c0 0x7f7d900b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8dd9b700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d9006a4c0 msgr2=0x7f7d900b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d9006a4c0 0x7f7d900b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 msgr2=0x7f7d900af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 -- 172.21.15.43:0/3691170663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009a70 con 0x7f7d9015c660 2023-06-08T03:48:44.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.252+0000 7f7d8ed9d700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 0x7f7d900afc10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d900707c0 tx=0x7f7d88004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:44.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.253+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88012430 con 0x7f7d9015c660 2023-06-08T03:48:44.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.253+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88020070 con 0x7f7d9015c660 2023-06-08T03:48:44.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.253+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d900c4e90 con 0x7f7d9015c660 2023-06-08T03:48:44.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.253+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88004280 con 0x7f7d9015c660 2023-06-08T03:48:44.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.253+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d900b5330 con 0x7f7d9015c660 2023-06-08T03:48:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.254+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d90158820 con 0x7f7d9015c660 2023-06-08T03:48:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.254+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d880043e0 con 0x7f7d9015c660 2023-06-08T03:48:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.254+0000 7f7d7effd700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7d7006ace0 0x7f7d7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.254+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7d88022070 con 0x7f7d9015c660 2023-06-08T03:48:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.255+0000 7f7d8e59c700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7d7006ace0 0x7f7d7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.255+0000 7f7d8e59c700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7d7006ace0 0x7f7d7006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d800010e0 tx=0x7f7d80007c70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:44.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.259+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d90158820 con 0x7f7d9015c660 2023-06-08T03:48:44.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:44.456+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7d90158820 con 0x7f7d9015c660 2023-06-08T03:48:45.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.253+0000 7f7d7effd700 1 -- 172.21.15.43:0/3691170663 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7d90158820 con 0x7f7d9015c660 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7d7006ace0 msgr2=0x7f7d7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7d7006ace0 0x7f7d7006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d800010e0 tx=0x7f7d80007c70 comp rx=0 tx=0).stop 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 msgr2=0x7f7d900afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 0x7f7d900afc10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d900707c0 tx=0x7f7d88004ad0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 shutdown_connections 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7d7006ace0 0x7f7d7006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9015c660 0x7f7d900afc10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d9006a4c0 0x7f7d900b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 --2- 172.21.15.43:0/3691170663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d900cc180 0x7f7d900af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.256+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 >> 172.21.15.43:0/3691170663 conn(0x7f7d90098b20 msgr2=0x7f7d9006d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:45.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.257+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 shutdown_connections 2023-06-08T03:48:45.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.257+0000 7f7d94ced700 1 -- 172.21.15.43:0/3691170663 wait complete. 2023-06-08T03:48:45.262 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-06-08T03:48:45.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-08T03:48:45.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.413+0000 7fed7a440700 1 Processor -- start 2023-06-08T03:48:45.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed7a440700 1 -- start start 2023-06-08T03:48:45.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed7a440700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed740b60a0 0x7fed740cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:45.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed7a440700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fed7415e340 0x7fed740cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:45.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed7a440700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740cda20 con 0x7fed740cf5b0 2023-06-08T03:48:45.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed7a440700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740b6470 con 0x7fed740b60a0 2023-06-08T03:48:45.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed7a440700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7415e7a0 con 0x7fed7415e340 2023-06-08T03:48:45.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed73fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed740b60a0 0x7fed740cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:45.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed73fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed740b60a0 0x7fed740cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57762/0 (socket says 172.21.15.43:57762) 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.414+0000 7fed73fff700 1 -- 172.21.15.43:0/3579398521 learned_addr learned my addr 172.21.15.43:0/3579398521 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed789dd700 1 --2- 172.21.15.43:0/3579398521 >> v2:172.21.15.135:3300/0 conn(0x7fed7415e340 0x7fed740cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed73fff700 1 -- 172.21.15.43:0/3579398521 >> v2:172.21.15.135:3300/0 conn(0x7fed7415e340 msgr2=0x7fed740cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed73fff700 1 --2- 172.21.15.43:0/3579398521 >> v2:172.21.15.135:3300/0 conn(0x7fed7415e340 0x7fed740cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed73fff700 1 -- 172.21.15.43:0/3579398521 >> v1:172.21.15.135:6789/0 conn(0x7fed740cf5b0 legacy=0x7fed7415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed73fff700 1 -- 172.21.15.43:0/3579398521 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7415a520 con 0x7fed740b60a0 2023-06-08T03:48:45.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed789dd700 1 --2- 172.21.15.43:0/3579398521 >> v2:172.21.15.135:3300/0 conn(0x7fed7415e340 0x7fed740cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed73fff700 1 --2- 172.21.15.43:0/3579398521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed740cad90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed74071ff0 tx=0x7fed64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9e9a9818f7db57 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed72ffd700 1 -- 172.21.15.43:0/3579398521 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64004230 con 0x7fed740b60a0 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed72ffd700 1 -- 172.21.15.43:0/3579398521 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64004390 con 0x7fed740b60a0 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.415+0000 7fed72ffd700 1 -- 172.21.15.43:0/3579398521 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed640036a0 con 0x7fed740b60a0 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 -- 172.21.15.43:0/3579398521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 msgr2=0x7fed740cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 --2- 172.21.15.43:0/3579398521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed740cad90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed74071ff0 tx=0x7fed64009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 -- 172.21.15.43:0/3579398521 shutdown_connections 2023-06-08T03:48:45.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 --2- 172.21.15.43:0/3579398521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed740cad90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 --2- 172.21.15.43:0/3579398521 >> v2:172.21.15.135:3300/0 conn(0x7fed7415e340 0x7fed740cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 -- 172.21.15.43:0/3579398521 >> 172.21.15.43:0/3579398521 conn(0x7fed74069db0 msgr2=0x7fed7406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:45.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 -- 172.21.15.43:0/3579398521 shutdown_connections 2023-06-08T03:48:45.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.416+0000 7fed7a440700 1 -- 172.21.15.43:0/3579398521 wait complete. 2023-06-08T03:48:45.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.417+0000 7fed7a440700 1 Processor -- start 2023-06-08T03:48:45.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.417+0000 7fed7a440700 1 -- start start 2023-06-08T03:48:45.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed74157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed740cf5b0 0x7fed741efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7415e340 0x7fed74158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74157640 con 0x7fed740b60a0 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7415bbf0 con 0x7fed7415e340 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7415bed0 con 0x7fed740cf5b0 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed74157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed74157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57766/0 (socket says 172.21.15.43:57766) 2023-06-08T03:48:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 -- 172.21.15.43:0/838700973 learned_addr learned my addr 172.21.15.43:0/838700973 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed789dd700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7415e340 0x7fed74158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed737fe700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed740cf5b0 0x7fed741efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 -- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed740cf5b0 msgr2=0x7fed741efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed740cf5b0 0x7fed741efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 -- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7415e340 msgr2=0x7fed74158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7415e340 0x7fed74158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 -- 172.21.15.43:0/838700973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64009550 con 0x7fed740b60a0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed737fe700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed740cf5b0 0x7fed741efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed73fff700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed74157100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed7406f750 tx=0x7fed64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64011630 con 0x7fed740b60a0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64011790 con 0x7fed740b60a0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.418+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7415c1b0 con 0x7fed740b60a0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.419+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64011b40 con 0x7fed740b60a0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.419+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7415c770 con 0x7fed740b60a0 2023-06-08T03:48:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.420+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74073fa0 con 0x7fed740b60a0 2023-06-08T03:48:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.420+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed64011ca0 con 0x7fed740b60a0 2023-06-08T03:48:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.421+0000 7fed70ff9700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fed6006ace0 0x7fed6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.421+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fed6408a8f0 con 0x7fed740b60a0 2023-06-08T03:48:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.421+0000 7fed737fe700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fed6006ace0 0x7fed6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.421+0000 7fed737fe700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fed6006ace0 0x7fed6006d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed68006fd0 tx=0x7fed68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.425+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed64055c10 con 0x7fed740b60a0 2023-06-08T03:48:45.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:45.622+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fed740b21d0 con 0x7fed740b60a0 2023-06-08T03:48:46.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.259+0000 7fed70ff9700 1 -- 172.21.15.43:0/838700973 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fed64059230 con 0x7fed740b60a0 2023-06-08T03:48:46.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.265+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fed6006ace0 msgr2=0x7fed6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.265+0000 7fed7a440700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fed6006ace0 0x7fed6006d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed68006fd0 tx=0x7fed68008040 comp rx=0 tx=0).stop 2023-06-08T03:48:46.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.265+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 msgr2=0x7fed74157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.265+0000 7fed7a440700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed74157100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed7406f750 tx=0x7fed64004750 comp rx=0 tx=0).stop 2023-06-08T03:48:46.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.273+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 shutdown_connections 2023-06-08T03:48:46.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.273+0000 7fed7a440700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fed6006ace0 0x7fed6006d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.273+0000 7fed7a440700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed740b60a0 0x7fed74157100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.273+0000 7fed7a440700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed7415e340 0x7fed74158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.273+0000 7fed7a440700 1 --2- 172.21.15.43:0/838700973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed740cf5b0 0x7fed741efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.273+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 >> 172.21.15.43:0/838700973 conn(0x7fed74069db0 msgr2=0x7fed740d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.274+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 shutdown_connections 2023-06-08T03:48:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.275+0000 7fed7a440700 1 -- 172.21.15.43:0/838700973 wait complete. 2023-06-08T03:48:46.284 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-06-08T03:48:46.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-08T03:48:46.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.426+0000 7f524c7ea700 1 Processor -- start 2023-06-08T03:48:46.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.426+0000 7f524c7ea700 1 -- start start 2023-06-08T03:48:46.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524c7ea700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f5244071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524c7ea700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f524406a4c0 0x7f52440b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524c7ea700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415c8f0 con 0x7f52440cee20 2023-06-08T03:48:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524c7ea700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440cd940 con 0x7f524406a4c0 2023-06-08T03:48:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524c7ea700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440b20f0 con 0x7f524415c520 2023-06-08T03:48:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f524406a4c0 0x7f52440b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f524406a4c0 0x7f52440b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57776/0 (socket says 172.21.15.43:57776) 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 -- 172.21.15.43:0/748765537 learned_addr learned my addr 172.21.15.43:0/748765537 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524a586700 1 --2- 172.21.15.43:0/748765537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f5244071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 -- 172.21.15.43:0/748765537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 msgr2=0x7f5244071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 --2- 172.21.15.43:0/748765537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f5244071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 -- 172.21.15.43:0/748765537 >> v1:172.21.15.135:6789/0 conn(0x7f52440cee20 legacy=0x7f5244069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 -- 172.21.15.43:0/748765537 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440cd3c0 con 0x7f524406a4c0 2023-06-08T03:48:46.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.427+0000 7f524ad87700 1 --2- 172.21.15.43:0/748765537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f52440b24a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f523c009e80 tx=0x7f523c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272c226b685fa10e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f5249584700 1 -- 172.21.15.43:0/748765537 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00e070 con 0x7f524406a4c0 2023-06-08T03:48:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f5249584700 1 -- 172.21.15.43:0/748765537 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c00b8d0 con 0x7f524406a4c0 2023-06-08T03:48:46.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f5249584700 1 -- 172.21.15.43:0/748765537 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00bc80 con 0x7f524406a4c0 2023-06-08T03:48:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 -- 172.21.15.43:0/748765537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 msgr2=0x7f52440b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 --2- 172.21.15.43:0/748765537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f52440b24a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f523c009e80 tx=0x7f523c00b330 comp rx=0 tx=0).stop 2023-06-08T03:48:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 -- 172.21.15.43:0/748765537 shutdown_connections 2023-06-08T03:48:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 --2- 172.21.15.43:0/748765537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f52440b24a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 --2- 172.21.15.43:0/748765537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f5244071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 -- 172.21.15.43:0/748765537 >> 172.21.15.43:0/748765537 conn(0x7f524406aec0 msgr2=0x7f524406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 -- 172.21.15.43:0/748765537 shutdown_connections 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.428+0000 7f524c7ea700 1 -- 172.21.15.43:0/748765537 wait complete. 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 Processor -- start 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 -- start start 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f524414ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52440cee20 0x7f52440ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f52440ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440acd50 con 0x7f524406a4c0 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524414bf40 con 0x7f52440cee20 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524c7ea700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440abe30 con 0x7f524415c520 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524a586700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f524414ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524a586700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f524414ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57778/0 (socket says 172.21.15.43:57778) 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f524a586700 1 -- 172.21.15.43:0/2314593861 learned_addr learned my addr 172.21.15.43:0/2314593861 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:46.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.430+0000 7f5249d85700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52440cee20 0x7f52440ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524ad87700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f52440ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524a586700 1 -- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 msgr2=0x7f52440ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524a586700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f52440ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524a586700 1 -- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52440cee20 msgr2=0x7f52440ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524a586700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52440cee20 0x7f52440ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524a586700 1 -- 172.21.15.43:0/2314593861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009b30 con 0x7f524406a4c0 2023-06-08T03:48:46.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524a586700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f524414ba00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f524000e9b0 tx=0x7f524000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240009710 con 0x7f524406a4c0 2023-06-08T03:48:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000ee50 con 0x7f524406a4c0 2023-06-08T03:48:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440ac0d0 con 0x7f524406a4c0 2023-06-08T03:48:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000ca50 con 0x7f524406a4c0 2023-06-08T03:48:46.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.431+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440ac690 con 0x7f524406a4c0 2023-06-08T03:48:46.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.432+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440c2f70 con 0x7f524406a4c0 2023-06-08T03:48:46.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.433+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f524000cbb0 con 0x7f524406a4c0 2023-06-08T03:48:46.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.433+0000 7f523affd700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f522806ace0 0x7f522806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.433+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f5240089380 con 0x7f524406a4c0 2023-06-08T03:48:46.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.433+0000 7f5249d85700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f522806ace0 0x7f522806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.434+0000 7f5249d85700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f522806ace0 0x7f522806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52441572f0 tx=0x7f5234009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:46.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.438+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5240057fb0 con 0x7f524406a4c0 2023-06-08T03:48:46.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.678+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5244073fa0 con 0x7f524406a4c0 2023-06-08T03:48:46.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.684+0000 7f523affd700 1 -- 172.21.15.43:0/2314593861 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f524000ce60 con 0x7f524406a4c0 2023-06-08T03:48:46.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f522806ace0 msgr2=0x7f522806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f522806ace0 0x7f522806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52441572f0 tx=0x7f5234009040 comp rx=0 tx=0).stop 2023-06-08T03:48:46.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 msgr2=0x7f524414ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f524414ba00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f524000e9b0 tx=0x7f524000ecc0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 shutdown_connections 2023-06-08T03:48:46.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f522806ace0 0x7f522806d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f524406a4c0 0x7f524414ba00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f524415c520 0x7f52440ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 --2- 172.21.15.43:0/2314593861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52440cee20 0x7f52440ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.688+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 >> 172.21.15.43:0/2314593861 conn(0x7f524406aec0 msgr2=0x7f5244069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:46.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.691+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 shutdown_connections 2023-06-08T03:48:46.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.691+0000 7f524c7ea700 1 -- 172.21.15.43:0/2314593861 wait complete. 2023-06-08T03:48:46.702 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 3 and data pool 4 2023-06-08T03:48:46.717 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-08T03:48:46.718 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-08T03:48:46.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.843+0000 7fa43b393700 1 Processor -- start 2023-06-08T03:48:46.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.843+0000 7fa43b393700 1 -- start start 2023-06-08T03:48:46.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa43b393700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa43406d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa43b393700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4340cda50 0x7fa4340ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa43b393700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43406e100 con 0x7fa4340ae830 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa43b393700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa434159650 con 0x7fa4340cda50 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa43b393700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340ace50 con 0x7fa434159280 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa439930700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4340cda50 0x7fa4340ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.844+0000 7fa43912f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa43406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4340cda50 0x7fa4340ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:39404/0 (socket says 172.21.15.43:39404) 2023-06-08T03:48:46.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 -- 172.21.15.43:0/3636120460 learned_addr learned my addr 172.21.15.43:0/3636120460 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:46.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa43912f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa43406d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51242/0 (socket says 172.21.15.43:51242) 2023-06-08T03:48:46.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 -- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 msgr2=0x7fa43406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:46.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 --2- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa43406d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 -- 172.21.15.43:0/3636120460 >> v1:172.21.15.135:6789/0 conn(0x7fa4340ae830 legacy=0x7fa4340cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 -- 172.21.15.43:0/3636120460 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43406ded0 con 0x7fa4340cda50 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa43912f700 1 --2- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa43406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa439930700 1 --2- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340ad2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00d150 tx=0x7fa42c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e464c42797c397 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa42bfff700 1 -- 172.21.15.43:0/3636120460 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c010070 con 0x7fa4340cda50 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa42bfff700 1 -- 172.21.15.43:0/3636120460 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00dd10 con 0x7fa4340cda50 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.845+0000 7fa42bfff700 1 -- 172.21.15.43:0/3636120460 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00b310 con 0x7fa4340cda50 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 -- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 msgr2=0x7fa4340ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 --2- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340ad2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00d150 tx=0x7fa42c00d460 comp rx=0 tx=0).stop 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 -- 172.21.15.43:0/3636120460 shutdown_connections 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 --2- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa43406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 --2- 172.21.15.43:0/3636120460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340ad2e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 -- 172.21.15.43:0/3636120460 >> 172.21.15.43:0/3636120460 conn(0x7fa434098b20 msgr2=0x7fa43406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 -- 172.21.15.43:0/3636120460 shutdown_connections 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.846+0000 7fa43b393700 1 -- 172.21.15.43:0/3636120460 wait complete. 2023-06-08T03:48:46.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.847+0000 7fa43b393700 1 Processor -- start 2023-06-08T03:48:46.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.847+0000 7fa43b393700 1 -- start start 2023-06-08T03:48:46.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43b393700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 0x7fa434152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43b393700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43b393700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa434153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43b393700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340c3440 con 0x7fa4340ae830 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43b393700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434153530 con 0x7fa4340cda50 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43b393700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340cbf20 con 0x7fa434159280 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 0x7fa434152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 0x7fa434152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57790/0 (socket says 172.21.15.43:57790) 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 -- 172.21.15.43:0/3593620304 learned_addr learned my addr 172.21.15.43:0/3593620304 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43892e700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa439930700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa434153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 -- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 msgr2=0x7fa434153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa434153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 -- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 msgr2=0x7fa4340c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:46.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 -- 172.21.15.43:0/3593620304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424009430 con 0x7fa4340ae830 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43892e700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.848+0000 7fa43912f700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 0x7fa434152ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa42400ebe0 tx=0x7fa424009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.849+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424005a20 con 0x7fa4340ae830 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.849+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424005b80 con 0x7fa4340ae830 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.849+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c00bd40 con 0x7fa4340ae830 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.849+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400c8b0 con 0x7fa4340ae830 2023-06-08T03:48:46.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.849+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4340c39c0 con 0x7fa4340ae830 2023-06-08T03:48:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.850+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43404e090 con 0x7fa4340ae830 2023-06-08T03:48:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.850+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa42400ca10 con 0x7fa4340ae830 2023-06-08T03:48:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.851+0000 7fa429ffb700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa41806ace0 0x7fa41806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.851+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4240897f0 con 0x7fa4340ae830 2023-06-08T03:48:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.851+0000 7fa43892e700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa41806ace0 0x7fa41806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.851+0000 7fa43892e700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa41806ace0 0x7fa41806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4340c53a0 tx=0x7fa430009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:46.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:46.855+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa424054800 con 0x7fa4340ae830 2023-06-08T03:48:47.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.067+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa4340cd570 con 0x7fa4340ae830 2023-06-08T03:48:47.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.688+0000 7fa429ffb700 1 -- 172.21.15.43:0/3593620304 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa424057e20 con 0x7fa4340ae830 2023-06-08T03:48:47.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa41806ace0 msgr2=0x7fa41806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa41806ace0 0x7fa41806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4340c53a0 tx=0x7fa430009040 comp rx=0 tx=0).stop 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 msgr2=0x7fa434152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 0x7fa434152ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa42400ebe0 tx=0x7fa424009e00 comp rx=0 tx=0).stop 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 shutdown_connections 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa41806ace0 0x7fa41806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4340ae830 0x7fa434152ff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa434159280 0x7fa434153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 --2- 172.21.15.43:0/3593620304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4340cda50 0x7fa4340c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 >> 172.21.15.43:0/3593620304 conn(0x7fa434098b20 msgr2=0x7fa4340cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:47.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.690+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 shutdown_connections 2023-06-08T03:48:47.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.691+0000 7fa43b393700 1 -- 172.21.15.43:0/3593620304 wait complete. 2023-06-08T03:48:47.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-08T03:48:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.844+0000 7fc61ac98700 1 Processor -- start 2023-06-08T03:48:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.844+0000 7fc61ac98700 1 -- start start 2023-06-08T03:48:47.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc61ac98700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc61415a280 0x7fc6140cca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc61ac98700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6140cb510 0x7fc6140b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc61ac98700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6140b06e0 0x7fc614069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc61ac98700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6140cc5b0 con 0x7fc6140b06e0 2023-06-08T03:48:47.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc61ac98700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61415a650 con 0x7fc61415a280 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc61ac98700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140cb9a0 con 0x7fc6140cb510 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6140b06e0 0x7fc614069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6140b06e0 0x7fc614069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57802/0 (socket says 172.21.15.43:57802) 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 -- 172.21.15.43:0/3648767888 learned_addr learned my addr 172.21.15.43:0/3648767888 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc613fff700 1 --2- 172.21.15.43:0/3648767888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6140cb510 0x7fc6140b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc618a34700 1 --2- 172.21.15.43:0/3648767888 >> v2:172.21.15.135:3300/0 conn(0x7fc61415a280 0x7fc6140cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 -- 172.21.15.43:0/3648767888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6140cb510 msgr2=0x7fc6140b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:47.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 --2- 172.21.15.43:0/3648767888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6140cb510 0x7fc6140b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 -- 172.21.15.43:0/3648767888 >> v2:172.21.15.135:3300/0 conn(0x7fc61415a280 msgr2=0x7fc6140cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 --2- 172.21.15.43:0/3648767888 >> v2:172.21.15.135:3300/0 conn(0x7fc61415a280 0x7fc6140cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.845+0000 7fc619235700 1 -- 172.21.15.43:0/3648767888 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140cbc80 con 0x7fc6140b06e0 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc619235700 1 --2- 172.21.15.43:0/3648767888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140b06e0 0x7fc614069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6140b22e0 tx=0x7fc60c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd589717110862a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc6137fe700 1 -- 172.21.15.43:0/3648767888 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00e070 con 0x7fc6140b06e0 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc6137fe700 1 -- 172.21.15.43:0/3648767888 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00b9c0 con 0x7fc6140b06e0 2023-06-08T03:48:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc6137fe700 1 -- 172.21.15.43:0/3648767888 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00bd70 con 0x7fc6140b06e0 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 -- 172.21.15.43:0/3648767888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140b06e0 msgr2=0x7fc614069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 --2- 172.21.15.43:0/3648767888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140b06e0 0x7fc614069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6140b22e0 tx=0x7fc60c00b330 comp rx=0 tx=0).stop 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 -- 172.21.15.43:0/3648767888 shutdown_connections 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 --2- 172.21.15.43:0/3648767888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140b06e0 0x7fc614069db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 --2- 172.21.15.43:0/3648767888 >> v2:172.21.15.135:3300/0 conn(0x7fc61415a280 0x7fc6140cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 --2- 172.21.15.43:0/3648767888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6140cb510 0x7fc6140b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 -- 172.21.15.43:0/3648767888 >> 172.21.15.43:0/3648767888 conn(0x7fc614098a70 msgr2=0x7fc61406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 -- 172.21.15.43:0/3648767888 shutdown_connections 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.846+0000 7fc61ac98700 1 -- 172.21.15.43:0/3648767888 wait complete. 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.847+0000 7fc61ac98700 1 Processor -- start 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 -- start start 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 0x7fc6140c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc61415a280 0x7fc6141eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61415aa50 0x7fc6141f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140c3900 con 0x7fc6140cb510 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140c57e0 con 0x7fc61415aa50 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc61ac98700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140cd2c0 con 0x7fc61415a280 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.848+0000 7fc618a34700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 0x7fc6140c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 0x7fc6140c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57804/0 (socket says 172.21.15.43:57804) 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 -- 172.21.15.43:0/2873104753 learned_addr learned my addr 172.21.15.43:0/2873104753 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc619235700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61415aa50 0x7fc6141f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc613fff700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc61415a280 0x7fc6141eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 -- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc61415a280 msgr2=0x7fc6141eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc61415a280 0x7fc6141eef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 -- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61415aa50 msgr2=0x7fc6141f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61415aa50 0x7fc6141f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 -- 172.21.15.43:0/2873104753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c009b30 con 0x7fc6140cb510 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc618a34700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 0x7fc6140c3220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc60800d7d0 tx=0x7fc60800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608017070 con 0x7fc6140cb510 2023-06-08T03:48:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608005a20 con 0x7fc6140cb510 2023-06-08T03:48:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6140c59f0 con 0x7fc6140cb510 2023-06-08T03:48:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608005bd0 con 0x7fc6140cb510 2023-06-08T03:48:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.849+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6140c5fb0 con 0x7fc6140cb510 2023-06-08T03:48:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.850+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614073fa0 con 0x7fc6140cb510 2023-06-08T03:48:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.851+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc608005d30 con 0x7fc6140cb510 2023-06-08T03:48:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.851+0000 7fc6117fa700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5f806ace0 0x7fc5f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.851+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fc608088ef0 con 0x7fc6140cb510 2023-06-08T03:48:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.851+0000 7fc613fff700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5f806ace0 0x7fc5f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.852+0000 7fc613fff700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5f806ace0 0x7fc5f806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc61406f290 tx=0x7fc600008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:47.856+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc608053ed0 con 0x7fc6140cb510 2023-06-08T03:48:48.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:48.055+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc6140cd400 con 0x7fc6140cb510 2023-06-08T03:48:49.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.717+0000 7fc6117fa700 1 -- 172.21.15.43:0/2873104753 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc6080574f0 con 0x7fc6140cb510 2023-06-08T03:48:49.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.723+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5f806ace0 msgr2=0x7fc5f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:49.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.723+0000 7fc61ac98700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5f806ace0 0x7fc5f806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc61406f290 tx=0x7fc600008040 comp rx=0 tx=0).stop 2023-06-08T03:48:49.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.723+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 msgr2=0x7fc6140c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:49.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.723+0000 7fc61ac98700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 0x7fc6140c3220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc60800d7d0 tx=0x7fc60800dae0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 shutdown_connections 2023-06-08T03:48:49.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5f806ace0 0x7fc5f806d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6140cb510 0x7fc6140c3220 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61415aa50 0x7fc6141f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 --2- 172.21.15.43:0/2873104753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc61415a280 0x7fc6141eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 >> 172.21.15.43:0/2873104753 conn(0x7fc614098a70 msgr2=0x7fc6140ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:49.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.725+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 shutdown_connections 2023-06-08T03:48:49.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.726+0000 7fc61ac98700 1 -- 172.21.15.43:0/2873104753 wait complete. 2023-06-08T03:48:49.734 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' created 2023-06-08T03:48:49.748 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-08T03:48:49.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.881+0000 7f38aa934700 1 Processor -- start 2023-06-08T03:48:49.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38aa934700 1 -- start start 2023-06-08T03:48:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38aa934700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f38a40cec70 0x7f38a40ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38aa934700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 0x7f38a40ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38aa934700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a40b0930 con 0x7f38a415a270 2023-06-08T03:48:49.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38aa934700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a40b0c10 con 0x7f38a40cec70 2023-06-08T03:48:49.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38aa934700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40b0ef0 con 0x7f38a415a640 2023-06-08T03:48:49.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.882+0000 7f38a3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f38a415a270 0x7f38a40ce560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52716/0 (socket says 172.21.15.43:52716) 2023-06-08T03:48:49.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a3fff700 1 -- 172.21.15.43:0/2505487758 learned_addr learned my addr 172.21.15.43:0/2505487758 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:49.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a37fe700 1 --2- 172.21.15.43:0/2505487758 >> v2:172.21.15.135:3300/0 conn(0x7f38a40cec70 0x7f38a40ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 0x7f38a40ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912182169 0 0) 0x7f38a40b0930 con 0x7f38a415a270 2023-06-08T03:48:49.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38900035b0 con 0x7f38a415a270 2023-06-08T03:48:49.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3497036780 0 0) 0x7f38900035b0 con 0x7f38a415a270 2023-06-08T03:48:49.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 msgr2=0x7f38a40ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:49.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 0x7f38a40ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 >> v2:172.21.15.135:3300/0 conn(0x7f38a40cec70 msgr2=0x7f38a40ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:49.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 --2- 172.21.15.43:0/2505487758 >> v2:172.21.15.135:3300/0 conn(0x7f38a40cec70 0x7f38a40ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40b11d0 con 0x7f38a415a270 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f3894001670 con 0x7f38a415a270 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 >> v1:172.21.15.43:6789/0 conn(0x7f38a415a270 legacy=0x7f38a40ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 0x7f3890003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3890003f80 0x7f3890004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3890004d90 0x7f3890005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40b0c10 con 0x7f3890004d90 2023-06-08T03:48:49.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40b0ef0 con 0x7f3890003f80 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389000ba10 con 0x7f38a415a640 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a37fe700 1 --2- 172.21.15.43:0/2505487758 >> v2:172.21.15.135:3300/0 conn(0x7f38a40cec70 0x7f38a40ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3890004d90 0x7f3890005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a3fff700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 0x7f3890003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.883+0000 7f38a37fe700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3890003f80 0x7f3890004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 -- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 msgr2=0x7f3890003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a415a640 0x7f3890003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 -- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3890003f80 msgr2=0x7f3890004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3890003f80 0x7f3890004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 -- 172.21.15.43:0/2505487758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900035b0 con 0x7f3890004d90 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3890004d90 0x7f3890005200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f389c009fc0 tx=0x7f3890005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964da7722f246451 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00ec30 con 0x7f3890004d90 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00f040 con 0x7f3890004d90 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a2ffd700 1 -- 172.21.15.43:0/2505487758 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c014480 con 0x7f3890004d90 2023-06-08T03:48:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38aa934700 1 -- 172.21.15.43:0/2505487758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3890004d90 msgr2=0x7f3890005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:49.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38aa934700 1 --2- 172.21.15.43:0/2505487758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3890004d90 0x7f3890005200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f389c009fc0 tx=0x7f3890005880 comp rx=0 tx=0).stop 2023-06-08T03:48:49.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38a8ed1700 1 -- 172.21.15.43:0/2505487758 reap_dead start 2023-06-08T03:48:49.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38aa934700 1 -- 172.21.15.43:0/2505487758 shutdown_connections 2023-06-08T03:48:49.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.884+0000 7f38aa934700 1 -- 172.21.15.43:0/2505487758 >> 172.21.15.43:0/2505487758 conn(0x7f38a406a6d0 msgr2=0x7f38a4099c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:49.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.885+0000 7f38aa934700 1 -- 172.21.15.43:0/2505487758 shutdown_connections 2023-06-08T03:48:49.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.885+0000 7f38aa934700 1 -- 172.21.15.43:0/2505487758 wait complete. 2023-06-08T03:48:49.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.886+0000 7f38aa934700 1 Processor -- start 2023-06-08T03:48:49.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.886+0000 7f38aa934700 1 -- start start 2023-06-08T03:48:49.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38a41ef8c0 0x7f38a409c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 0x7f38a409cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a409a5d0 0x7f38a409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409af80 con 0x7f38a41efc90 2023-06-08T03:48:49.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409d160 con 0x7f38a41ef8c0 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409d440 con 0x7f38a409a5d0 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 0x7f38a409cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 0x7f38a409cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57826/0 (socket says 172.21.15.43:57826) 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 -- 172.21.15.43:0/751757116 learned_addr learned my addr 172.21.15.43:0/751757116 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a3fff700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38a41ef8c0 0x7f38a409c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a409a5d0 0x7f38a409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 -- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a409a5d0 msgr2=0x7f38a409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a409a5d0 0x7f38a409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 -- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38a41ef8c0 msgr2=0x7f38a409c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38a41ef8c0 0x7f38a409c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 -- 172.21.15.43:0/751757116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a409d720 con 0x7f38a41efc90 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a3fff700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38a41ef8c0 0x7f38a409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a8ed1700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a409a5d0 0x7f38a409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a37fe700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 0x7f38a409cb20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f388c010a30 tx=0x7f388c010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:49.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00e990 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00eaf0 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a409da00 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00ee60 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.887+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a409e200 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.888+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a409df20 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.889+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f388c016460 con 0x7f38a41efc90 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.889+0000 7f38a0ff9700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f388406ad10 0x7f388406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:49.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.889+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f388c089e90 con 0x7f38a41efc90 2023-06-08T03:48:49.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.890+0000 7f38a3fff700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f388406ad10 0x7f388406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:49.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.890+0000 7f38a3fff700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f388406ad10 0x7f388406d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38940048d0 tx=0x7f3894009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:49.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:49.894+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f38a409df20 con 0x7f38a41efc90 2023-06-08T03:48:50.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.091+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f38a409df20 con 0x7f38a41efc90 2023-06-08T03:48:50.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.720+0000 7f38a0ff9700 1 -- 172.21.15.43:0/751757116 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f38a409df20 con 0x7f38a41efc90 2023-06-08T03:48:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.727+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f388406ad10 msgr2=0x7f388406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.727+0000 7f38aa934700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f388406ad10 0x7f388406d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38940048d0 tx=0x7f3894009040 comp rx=0 tx=0).stop 2023-06-08T03:48:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.727+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 msgr2=0x7f38a409cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.727+0000 7f38aa934700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 0x7f38a409cb20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f388c010a30 tx=0x7f388c010df0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.729+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 shutdown_connections 2023-06-08T03:48:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.729+0000 7f38aa934700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f388406ad10 0x7f388406d1c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.729+0000 7f38aa934700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38a409a5d0 0x7f38a409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.729+0000 7f38aa934700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38a41ef8c0 0x7f38a409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.729+0000 7f38aa934700 1 --2- 172.21.15.43:0/751757116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38a41efc90 0x7f38a409cb20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.729+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 >> 172.21.15.43:0/751757116 conn(0x7f38a406a6d0 msgr2=0x7f38a40aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.733+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 shutdown_connections 2023-06-08T03:48:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.733+0000 7f38aa934700 1 -- 172.21.15.43:0/751757116 wait complete. 2023-06-08T03:48:50.741 INFO:teuthology.orchestra.run.smithi043.stderr:set pool 5 allow_ec_overwrites to true 2023-06-08T03:48:50.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-08T03:48:50.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.887+0000 7f377c44b700 1 Processor -- start 2023-06-08T03:48:50.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.887+0000 7f377c44b700 1 -- start start 2023-06-08T03:48:50.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f377c44b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37740b4ed0 0x7f37740d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:50.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f377c44b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377415c750 con 0x7f37740ccb00 2023-06-08T03:48:50.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f377c44b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740cf740 con 0x7f37740b43f0 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f377c44b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37740ccfc0 con 0x7f37740b4ed0 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f37799e6700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f37740ccb00 0x7f37740d0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52738/0 (socket says 172.21.15.43:52738) 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f37799e6700 1 -- 172.21.15.43:0/68681445 learned_addr learned my addr 172.21.15.43:0/68681445 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.888+0000 7f377a9e8700 1 --2- 172.21.15.43:0/68681445 >> v2:172.21.15.135:3300/0 conn(0x7f37740b4ed0 0x7f37740d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662697241 0 0) 0x7f3770001110 con 0x7f37740ccb00 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37600035b0 con 0x7f37740ccb00 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893118894 0 0) 0x7f37740cf740 con 0x7f37740b43f0 2023-06-08T03:48:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770001110 con 0x7f37740b43f0 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099669814 0 0) 0x7f37600035b0 con 0x7f37740ccb00 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f377a9e8700 1 -- 172.21.15.43:0/68681445 >> v1:172.21.15.135:6789/0 conn(0x7f37740b43f0 legacy=0x7f37740b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f377a9e8700 1 -- 172.21.15.43:0/68681445 >> v1:172.21.15.43:6789/0 conn(0x7f37740ccb00 legacy=0x7f37740d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f377a9e8700 1 -- 172.21.15.43:0/68681445 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740cd540 con 0x7f37740b4ed0 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f377a9e8700 1 --2- 172.21.15.43:0/68681445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b4ed0 0x7f37740d0d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f376c009d90 tx=0x7f376c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e787d91771fe02 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c00e070 con 0x7f37740b4ed0 2023-06-08T03:48:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c003a20 con 0x7f37740b4ed0 2023-06-08T03:48:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.889+0000 7f37791e5700 1 -- 172.21.15.43:0/68681445 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770001800 con 0x7f37740b4ed0 2023-06-08T03:48:50.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 -- 172.21.15.43:0/68681445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b4ed0 msgr2=0x7f37740d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 --2- 172.21.15.43:0/68681445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b4ed0 0x7f37740d0d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f376c009d90 tx=0x7f376c00b330 comp rx=0 tx=0).stop 2023-06-08T03:48:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 -- 172.21.15.43:0/68681445 shutdown_connections 2023-06-08T03:48:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 --2- 172.21.15.43:0/68681445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b4ed0 0x7f37740d0d50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 -- 172.21.15.43:0/68681445 >> 172.21.15.43:0/68681445 conn(0x7f3774072120 msgr2=0x7f377406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 -- 172.21.15.43:0/68681445 shutdown_connections 2023-06-08T03:48:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.890+0000 7f377c44b700 1 -- 172.21.15.43:0/68681445 wait complete. 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.891+0000 7f377c44b700 1 Processor -- start 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.891+0000 7f377c44b700 1 -- start start 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377c44b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b43f0 0x7f3774149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377c44b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 0x7f37740c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377c44b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37740ccb00 0x7f37740c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377c44b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740c7be0 con 0x7f37740b4ed0 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377c44b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377415dc00 con 0x7f37740b43f0 2023-06-08T03:48:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377c44b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740c6fd0 con 0x7f37740ccb00 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f37799e6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 0x7f37740c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f37799e6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 0x7f37740c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57840/0 (socket says 172.21.15.43:57840) 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f37799e6700 1 -- 172.21.15.43:0/1861513584 learned_addr learned my addr 172.21.15.43:0/1861513584 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377a9e8700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37740ccb00 0x7f37740c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f377a1e7700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b43f0 0x7f3774149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f37799e6700 1 -- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37740ccb00 msgr2=0x7f37740c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f37799e6700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37740ccb00 0x7f37740c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.892+0000 7f37799e6700 1 -- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b43f0 msgr2=0x7f3774149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f37799e6700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b43f0 0x7f3774149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f37799e6700 1 -- 172.21.15.43:0/1861513584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009a70 con 0x7f37740b4ed0 2023-06-08T03:48:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f377a9e8700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37740ccb00 0x7f37740c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f37799e6700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 0x7f37740c6460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f377000c710 tx=0x7f377000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770004c80 con 0x7f37740b4ed0 2023-06-08T03:48:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770004e00 con 0x7f37740b4ed0 2023-06-08T03:48:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37740c72b0 con 0x7f37740b4ed0 2023-06-08T03:48:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770007310 con 0x7f37740b4ed0 2023-06-08T03:48:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.893+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37740c7870 con 0x7f37740b4ed0 2023-06-08T03:48:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.894+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740c7d90 con 0x7f37740b4ed0 2023-06-08T03:48:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.894+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3770007470 con 0x7f37740b4ed0 2023-06-08T03:48:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.895+0000 7f3766ffd700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f375806ace0 0x7f375806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.895+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f3770089380 con 0x7f37740b4ed0 2023-06-08T03:48:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.895+0000 7f377a1e7700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f375806ace0 0x7f375806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.895+0000 7f377a1e7700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f375806ace0 0x7f375806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f37680011e0 tx=0x7f3768009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:50.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:50.899+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37740c7d90 con 0x7f37740b4ed0 2023-06-08T03:48:51.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.144+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3774073fa0 con 0x7f37740b4ed0 2023-06-08T03:48:51.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.148+0000 7f3766ffd700 1 -- 172.21.15.43:0/1861513584 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3770057bf0 con 0x7f37740b4ed0 2023-06-08T03:48:51.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f375806ace0 msgr2=0x7f375806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f375806ace0 0x7f375806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f37680011e0 tx=0x7f3768009040 comp rx=0 tx=0).stop 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 msgr2=0x7f37740c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 0x7f37740c6460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f377000c710 tx=0x7f377000ca20 comp rx=0 tx=0).stop 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 shutdown_connections 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f375806ace0 0x7f375806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37740ccb00 0x7f37740c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37740b43f0 0x7f3774149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 --2- 172.21.15.43:0/1861513584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37740b4ed0 0x7f37740c6460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 >> 172.21.15.43:0/1861513584 conn(0x7f3774072120 msgr2=0x7f37740d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 shutdown_connections 2023-06-08T03:48:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.151+0000 7f377c44b700 1 -- 172.21.15.43:0/1861513584 wait complete. 2023-06-08T03:48:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:added data pool 5 to fsmap 2023-06-08T03:48:51.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:48:51.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.286+0000 7f0a3cd49700 1 Processor -- start 2023-06-08T03:48:51.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.286+0000 7f0a3cd49700 1 -- start start 2023-06-08T03:48:51.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.287+0000 7f0a3cd49700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a38158fc0 0x7f0a38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.287+0000 7f0a3cd49700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0a3806c8f0 0x7f0a3806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.287+0000 7f0a3cd49700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a38159390 con 0x7f0a3806cd60 2023-06-08T03:48:51.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.287+0000 7f0a3cd49700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380caee0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.287+0000 7f0a3cd49700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380ae770 con 0x7f0a38158fc0 2023-06-08T03:48:51.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a36d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0a3806cd60 0x7f0a380cd440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52754/0 (socket says 172.21.15.43:52754) 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a36d9d700 1 -- 172.21.15.43:0/500082414 learned_addr learned my addr 172.21.15.43:0/500082414 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a35d9b700 1 --2- 172.21.15.43:0/500082414 >> v2:172.21.15.135:3300/0 conn(0x7f0a3806c8f0 0x7f0a3806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3659c700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a38158fc0 0x7f0a38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3559a700 1 -- 172.21.15.43:0/500082414 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389564246 0 0) 0x7f0a30001490 con 0x7f0a3806cd60 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3559a700 1 -- 172.21.15.43:0/500082414 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a240035b0 con 0x7f0a3806cd60 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a35d9b700 1 -- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a38158fc0 msgr2=0x7f0a38069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:51.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3559a700 1 -- 172.21.15.43:0/500082414 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787616001 0 0) 0x7f0a240035b0 con 0x7f0a3806cd60 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a35d9b700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a38158fc0 0x7f0a38069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a35d9b700 1 -- 172.21.15.43:0/500082414 >> v1:172.21.15.43:6789/0 conn(0x7f0a3806cd60 legacy=0x7f0a380cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a35d9b700 1 -- 172.21.15.43:0/500082414 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380ca920 con 0x7f0a3806c8f0 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3659c700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a38158fc0 0x7f0a38069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a35d9b700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806c8f0 0x7f0a3806d2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009840 tx=0x7f0a20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef5dc04e2a8dbea server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3559a700 1 -- 172.21.15.43:0/500082414 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30001b80 con 0x7f0a3806c8f0 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3559a700 1 -- 172.21.15.43:0/500082414 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20004030 con 0x7f0a3806c8f0 2023-06-08T03:48:51.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.288+0000 7f0a3559a700 1 -- 172.21.15.43:0/500082414 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200043c0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 -- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806c8f0 msgr2=0x7f0a3806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806c8f0 0x7f0a3806d2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009840 tx=0x7f0a20009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:51.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 -- 172.21.15.43:0/500082414 shutdown_connections 2023-06-08T03:48:51.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a38158fc0 0x7f0a38069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/500082414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806c8f0 0x7f0a3806d2c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 -- 172.21.15.43:0/500082414 >> 172.21.15.43:0/500082414 conn(0x7f0a380ceed0 msgr2=0x7f0a380cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:51.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 -- 172.21.15.43:0/500082414 shutdown_connections 2023-06-08T03:48:51.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.289+0000 7f0a3cd49700 1 -- 172.21.15.43:0/500082414 wait complete. 2023-06-08T03:48:51.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.290+0000 7f0a3cd49700 1 Processor -- start 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 -- start start 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 0x7f0a3814d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806cd60 0x7f0a38157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a38158fc0 0x7f0a381575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381f2ed0 con 0x7f0a38158fc0 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381f2000 con 0x7f0a3806cd60 2023-06-08T03:48:51.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.291+0000 7f0a3cd49700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381f2250 con 0x7f0a3806c8f0 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 0x7f0a3814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 0x7f0a3814d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51308/0 (socket says 172.21.15.43:51308) 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 -- 172.21.15.43:0/2096084680 learned_addr learned my addr 172.21.15.43:0/2096084680 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a35d9b700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806cd60 0x7f0a38157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 -- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806cd60 msgr2=0x7f0a38157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806cd60 0x7f0a38157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 -- 172.21.15.43:0/2096084680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a38158fc0 msgr2=0x7f0a381575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a38158fc0 0x7f0a381575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 -- 172.21.15.43:0/2096084680 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280094a0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a3659c700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 0x7f0a3814d350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800ebe0 tx=0x7f0a2800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28009800 con 0x7f0a3806c8f0 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.292+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2800c910 con 0x7f0a3806c8f0 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.293+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800cc80 con 0x7f0a3806c8f0 2023-06-08T03:48:51.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.293+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a200094a0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.293+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a381f2810 con 0x7f0a3806c8f0 2023-06-08T03:48:51.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.295+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a380cfda0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.296+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a28013470 con 0x7f0a3806c8f0 2023-06-08T03:48:51.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.296+0000 7f0a2effd700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0a1806ace0 0x7f0a1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.296+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a28089840 con 0x7f0a3806c8f0 2023-06-08T03:48:51.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.296+0000 7f0a35d9b700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0a1806ace0 0x7f0a1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.297+0000 7f0a35d9b700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0a1806ace0 0x7f0a1806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000a010 tx=0x7f0a20008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:51.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.301+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a28058120 con 0x7f0a3806c8f0 2023-06-08T03:48:51.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.544+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a38073fa0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.545+0000 7f0a2effd700 1 -- 172.21.15.43:0/2096084680 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f0a28057cb0 con 0x7f0a3806c8f0 2023-06-08T03:48:51.549 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:51.549 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:48:51.146665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-08T03:48:51.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0a1806ace0 msgr2=0x7f0a1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0a1806ace0 0x7f0a1806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000a010 tx=0x7f0a20008030 comp rx=0 tx=0).stop 2023-06-08T03:48:51.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 msgr2=0x7f0a3814d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 0x7f0a3814d350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800ebe0 tx=0x7f0a2800eef0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 shutdown_connections 2023-06-08T03:48:51.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0a1806ace0 0x7f0a1806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a38158fc0 0x7f0a381575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3806c8f0 0x7f0a3814d350 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 --2- 172.21.15.43:0/2096084680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a3806cd60 0x7f0a38157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 >> 172.21.15.43:0/2096084680 conn(0x7f0a380ceed0 msgr2=0x7f0a380affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 shutdown_connections 2023-06-08T03:48:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.547+0000 7f0a3cd49700 1 -- 172.21.15.43:0/2096084680 wait complete. 2023-06-08T03:48:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2023-06-08T03:48:51.563 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:51.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.683+0000 7fa3e112d700 1 Processor -- start 2023-06-08T03:48:51.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.683+0000 7fa3e112d700 1 -- start start 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3e112d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3dc0afa30 0x7fa3dc0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3e112d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3dc0cd980 0x7fa3dc0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3e112d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc0b01a0 con 0x7fa3dc0b0c40 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3e112d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3dc0b06f0 con 0x7fa3dc0cd980 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3e112d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3dc0b0900 con 0x7fa3dc0afa30 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3db59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3dc0cd980 0x7fa3dc0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3da59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa3dc0b0c40 0x7fa3dc0cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52764/0 (socket says 172.21.15.43:52764) 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3da59c700 1 -- 172.21.15.43:0/1626855070 learned_addr learned my addr 172.21.15.43:0/1626855070 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3dad9d700 1 --2- 172.21.15.43:0/1626855070 >> v2:172.21.15.135:3300/0 conn(0x7fa3dc0afa30 0x7fa3dc0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3db59e700 1 -- 172.21.15.43:0/1626855070 >> v2:172.21.15.135:3300/0 conn(0x7fa3dc0afa30 msgr2=0x7fa3dc0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3db59e700 1 --2- 172.21.15.43:0/1626855070 >> v2:172.21.15.135:3300/0 conn(0x7fa3dc0afa30 0x7fa3dc0b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3db59e700 1 -- 172.21.15.43:0/1626855070 >> v1:172.21.15.43:6789/0 conn(0x7fa3dc0b0c40 legacy=0x7fa3dc0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.684+0000 7fa3db59e700 1 -- 172.21.15.43:0/1626855070 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0ca7a0 con 0x7fa3dc0cd980 2023-06-08T03:48:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3db59e700 1 --2- 172.21.15.43:0/1626855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0cafa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc071060 tx=0x7fa3d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bafd39b7a3a1c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3d9d9b700 1 -- 172.21.15.43:0/1626855070 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400e070 con 0x7fa3dc0cd980 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3d9d9b700 1 -- 172.21.15.43:0/1626855070 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d400bbd0 con 0x7fa3dc0cd980 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3d9d9b700 1 -- 172.21.15.43:0/1626855070 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4012430 con 0x7fa3dc0cd980 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 -- 172.21.15.43:0/1626855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 msgr2=0x7fa3dc0cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 --2- 172.21.15.43:0/1626855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0cafa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc071060 tx=0x7fa3d400b330 comp rx=0 tx=0).stop 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 -- 172.21.15.43:0/1626855070 shutdown_connections 2023-06-08T03:48:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 --2- 172.21.15.43:0/1626855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0cafa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 --2- 172.21.15.43:0/1626855070 >> v2:172.21.15.135:3300/0 conn(0x7fa3dc0afa30 0x7fa3dc0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 -- 172.21.15.43:0/1626855070 >> 172.21.15.43:0/1626855070 conn(0x7fa3dc06b7e0 msgr2=0x7fa3dc0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 -- 172.21.15.43:0/1626855070 shutdown_connections 2023-06-08T03:48:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.685+0000 7fa3e112d700 1 -- 172.21.15.43:0/1626855070 wait complete. 2023-06-08T03:48:51.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.687+0000 7fa3e112d700 1 Processor -- start 2023-06-08T03:48:51.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.687+0000 7fa3e112d700 1 -- start start 2023-06-08T03:48:51.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc0afa30 0x7fa3dc149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3dc0b0c40 0x7fa3dc0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c4780 con 0x7fa3dc0cd980 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c3bb0 con 0x7fa3dc0afa30 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c3e50 con 0x7fa3dc0b0c40 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57870/0 (socket says 172.21.15.43:57870) 2023-06-08T03:48:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 -- 172.21.15.43:0/2239258684 learned_addr learned my addr 172.21.15.43:0/2239258684 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3da59c700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3dc0b0c40 0x7fa3dc0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3dad9d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc0afa30 0x7fa3dc149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 -- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3dc0b0c40 msgr2=0x7fa3dc0c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3dc0b0c40 0x7fa3dc0c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 -- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc0afa30 msgr2=0x7fa3dc149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc0afa30 0x7fa3dc149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 -- 172.21.15.43:0/2239258684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4009a70 con 0x7fa3dc0cd980 2023-06-08T03:48:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3dad9d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc0afa30 0x7fa3dc149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3db59e700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0c8220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4014040 tx=0x7fa3d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4012430 con 0x7fa3dc0cd980 2023-06-08T03:48:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4020070 con 0x7fa3dc0cd980 2023-06-08T03:48:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4004280 con 0x7fa3dc0cd980 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.688+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc0c4130 con 0x7fa3dc0cd980 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.689+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc0c5870 con 0x7fa3dc0cd980 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.689+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc0c4930 con 0x7fa3dc0cd980 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.690+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3d40043e0 con 0x7fa3dc0cd980 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.690+0000 7fa3c37fe700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3c806ace0 0x7fa3c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.690+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3d4022070 con 0x7fa3dc0cd980 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.690+0000 7fa3dad9d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3c806ace0 0x7fa3c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.691+0000 7fa3dad9d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3c806ace0 0x7fa3c806d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0006fd0 tx=0x7fa3d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:51.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.695+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3dc0c4930 con 0x7fa3dc0cd980 2023-06-08T03:48:51.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.897+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3dc0c4930 con 0x7fa3dc0cd980 2023-06-08T03:48:51.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.898+0000 7fa3c37fe700 1 -- 172.21.15.43:0/2239258684 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fa3dc0c4930 con 0x7fa3dc0cd980 2023-06-08T03:48:51.903 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:51.903 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3c806ace0 msgr2=0x7fa3c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3c806ace0 0x7fa3c806d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0006fd0 tx=0x7fa3d0008040 comp rx=0 tx=0).stop 2023-06-08T03:48:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 msgr2=0x7fa3dc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0c8220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4014040 tx=0x7fa3d4004ad0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 shutdown_connections 2023-06-08T03:48:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3c806ace0 0x7fa3c806d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.900+0000 7fa3e112d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3dc0cd980 0x7fa3dc0c8220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.901+0000 7fa3e112d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc0afa30 0x7fa3dc149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.901+0000 7fa3e112d700 1 --2- 172.21.15.43:0/2239258684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3dc0b0c40 0x7fa3dc0c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.901+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 >> 172.21.15.43:0/2239258684 conn(0x7fa3dc06b7e0 msgr2=0x7fa3dc0cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.901+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 shutdown_connections 2023-06-08T03:48:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:51.901+0000 7fa3e112d700 1 -- 172.21.15.43:0/2239258684 wait complete. 2023-06-08T03:48:51.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:52.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.037+0000 7fbc2518a700 1 Processor -- start 2023-06-08T03:48:52.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.037+0000 7fbc2518a700 1 -- start start 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc2518a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc20157d30 0x7fbc200cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc2518a700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200cd770 con 0x7fbc200ce3a0 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc2518a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc20158100 con 0x7fbc2015adb0 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc2518a700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2015b2d0 con 0x7fbc20157d30 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc20157d30 0x7fbc200cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1e59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbc200ce3a0 0x7fbc2015a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52778/0 (socket says 172.21.15.43:52778) 2023-06-08T03:48:52.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1e59c700 1 -- 172.21.15.43:0/2900044747 learned_addr learned my addr 172.21.15.43:0/2900044747 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1ed9d700 1 -- 172.21.15.43:0/2900044747 >> v1:172.21.15.135:6789/0 conn(0x7fbc2015adb0 legacy=0x7fbc200cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1ed9d700 1 -- 172.21.15.43:0/2900044747 >> v1:172.21.15.43:6789/0 conn(0x7fbc200ce3a0 legacy=0x7fbc2015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1ed9d700 1 -- 172.21.15.43:0/2900044747 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2015b5b0 con 0x7fbc20157d30 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.038+0000 7fbc1dd9b700 1 -- 172.21.15.43:0/2900044747 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292073660 0 0) 0x7fbc200cd770 con 0x7fbc200ce3a0 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc1ed9d700 1 --2- 172.21.15.43:0/2900044747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200cdc00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009820 tx=0x7fbc14009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdb94d96aa7c561 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc1dd9b700 1 -- 172.21.15.43:0/2900044747 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14005e30 con 0x7fbc20157d30 2023-06-08T03:48:52.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc1dd9b700 1 -- 172.21.15.43:0/2900044747 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14004030 con 0x7fbc20157d30 2023-06-08T03:48:52.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc1dd9b700 1 -- 172.21.15.43:0/2900044747 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140043c0 con 0x7fbc20157d30 2023-06-08T03:48:52.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 -- 172.21.15.43:0/2900044747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 msgr2=0x7fbc200cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 --2- 172.21.15.43:0/2900044747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200cdc00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009820 tx=0x7fbc14009b30 comp rx=0 tx=0).stop 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 -- 172.21.15.43:0/2900044747 shutdown_connections 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 --2- 172.21.15.43:0/2900044747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200cdc00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 -- 172.21.15.43:0/2900044747 >> 172.21.15.43:0/2900044747 conn(0x7fbc2006a6d0 msgr2=0x7fbc20099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 -- 172.21.15.43:0/2900044747 shutdown_connections 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.039+0000 7fbc2518a700 1 -- 172.21.15.43:0/2900044747 wait complete. 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.041+0000 7fbc2518a700 1 Processor -- start 2023-06-08T03:48:52.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.041+0000 7fbc2518a700 1 -- start start 2023-06-08T03:48:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc2518a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc200ce3a0 0x7fbc2014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc2518a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc2518a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc2015adb0 0x7fbc200c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc2518a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c6790 con 0x7fbc20157d30 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc2518a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20150530 con 0x7fbc2015adb0 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc2518a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200b39c0 con 0x7fbc200ce3a0 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc1e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc1e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57882/0 (socket says 172.21.15.43:57882) 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.042+0000 7fbc1e59c700 1 -- 172.21.15.43:0/3991042762 learned_addr learned my addr 172.21.15.43:0/3991042762 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1f59e700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc2015adb0 0x7fbc200c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1ed9d700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc200ce3a0 0x7fbc2014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1e59c700 1 -- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc200ce3a0 msgr2=0x7fbc2014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1e59c700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc200ce3a0 0x7fbc2014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1e59c700 1 -- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc2015adb0 msgr2=0x7fbc200c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1e59c700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc2015adb0 0x7fbc200c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1e59c700 1 -- 172.21.15.43:0/3991042762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14009430 con 0x7fbc20157d30 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1f59e700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc2015adb0 0x7fbc200c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc1e59c700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200c5d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c520 tx=0x7fbc1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10004c80 con 0x7fbc20157d30 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10004e20 con 0x7fbc20157d30 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc200c6970 con 0x7fbc20157d30 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10007310 con 0x7fbc20157d30 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.043+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc200b4360 con 0x7fbc20157d30 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.044+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc20073fa0 con 0x7fbc20157d30 2023-06-08T03:48:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.044+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc10007470 con 0x7fbc20157d30 2023-06-08T03:48:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.045+0000 7fbc077fe700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc0c06ace0 0x7fbc0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.045+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc10089400 con 0x7fbc20157d30 2023-06-08T03:48:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.045+0000 7fbc1ed9d700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc0c06ace0 0x7fbc0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.045+0000 7fbc1ed9d700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc0c06ace0 0x7fbc0c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc14000c00 tx=0x7fbc14008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.049+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc100541d0 con 0x7fbc20157d30 2023-06-08T03:48:52.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.248+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc200ceff0 con 0x7fbc20157d30 2023-06-08T03:48:52.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.250+0000 7fbc077fe700 1 -- 172.21.15.43:0/3991042762 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fbc100577f0 con 0x7fbc20157d30 2023-06-08T03:48:52.254 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:52.254 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:52.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc0c06ace0 msgr2=0x7fbc0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc0c06ace0 0x7fbc0c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc14000c00 tx=0x7fbc14008070 comp rx=0 tx=0).stop 2023-06-08T03:48:52.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 msgr2=0x7fbc200c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200c5d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c520 tx=0x7fbc1000c8e0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 shutdown_connections 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc0c06ace0 0x7fbc0c06d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc2015adb0 0x7fbc200c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc200ce3a0 0x7fbc2014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 --2- 172.21.15.43:0/3991042762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20157d30 0x7fbc200c5d10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 >> 172.21.15.43:0/3991042762 conn(0x7fbc2006a6d0 msgr2=0x7fbc200ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 shutdown_connections 2023-06-08T03:48:52.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.252+0000 7fbc2518a700 1 -- 172.21.15.43:0/3991042762 wait complete. 2023-06-08T03:48:52.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:48:52.322 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-06-08T03:48:52.319+0000 7f8fa9feb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-08T03:48:52.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.402+0000 7f9a3cb6f700 1 Processor -- start 2023-06-08T03:48:52.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.402+0000 7f9a3cb6f700 1 -- start start 2023-06-08T03:48:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3cb6f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a3815c0b0 0x7f9a380cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3cb6f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a380b2a20 0x7f9a380cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3cb6f700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a380cdc60 con 0x7f9a380cb2d0 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3cb6f700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a380b2e90 con 0x7f9a380b2a20 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3cb6f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380cfdf0 con 0x7f9a3815c0b0 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a35d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a380b2a20 0x7f9a380cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a36d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9a380cb2d0 0x7f9a3815fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52796/0 (socket says 172.21.15.43:52796) 2023-06-08T03:48:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a36d9d700 1 -- 172.21.15.43:0/2277186480 learned_addr learned my addr 172.21.15.43:0/2277186480 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3659c700 1 --2- 172.21.15.43:0/2277186480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a3815c0b0 0x7f9a380cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a35d9b700 1 -- 172.21.15.43:0/2277186480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a3815c0b0 msgr2=0x7f9a380cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a35d9b700 1 --2- 172.21.15.43:0/2277186480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a3815c0b0 0x7f9a380cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a35d9b700 1 -- 172.21.15.43:0/2277186480 >> v1:172.21.15.43:6789/0 conn(0x7f9a380cb2d0 legacy=0x7f9a3815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a35d9b700 1 -- 172.21.15.43:0/2277186480 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380d00d0 con 0x7f9a380b2a20 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3559a700 1 -- 172.21.15.43:0/2277186480 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71622576 0 0) 0x7f9a380cdc60 con 0x7f9a380cb2d0 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a35d9b700 1 --2- 172.21.15.43:0/2277186480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a380cad90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009840 tx=0x7f9a28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc1850597065b23 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3559a700 1 -- 172.21.15.43:0/2277186480 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28011830 con 0x7f9a380b2a20 2023-06-08T03:48:52.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3559a700 1 -- 172.21.15.43:0/2277186480 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a28011990 con 0x7f9a380b2a20 2023-06-08T03:48:52.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.404+0000 7f9a3559a700 1 -- 172.21.15.43:0/2277186480 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28011d20 con 0x7f9a380b2a20 2023-06-08T03:48:52.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/2277186480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 msgr2=0x7f9a380cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/2277186480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a380cad90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009840 tx=0x7f9a28009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:52.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/2277186480 shutdown_connections 2023-06-08T03:48:52.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/2277186480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a3815c0b0 0x7f9a380cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/2277186480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a380cad90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/2277186480 >> 172.21.15.43:0/2277186480 conn(0x7f9a38069db0 msgr2=0x7f9a3806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/2277186480 shutdown_connections 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.405+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/2277186480 wait complete. 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.406+0000 7f9a3cb6f700 1 Processor -- start 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 -- start start 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a3814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a380cb2d0 0x7f9a381548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a3815c0b0 0x7f9a381f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38154e10 con 0x7f9a380b2a20 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815d880 con 0x7f9a3815c0b0 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3cb6f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a381f22a0 con 0x7f9a380cb2d0 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a3814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a3814fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57894/0 (socket says 172.21.15.43:57894) 2023-06-08T03:48:52.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.407+0000 7f9a3659c700 1 -- 172.21.15.43:0/628292030 learned_addr learned my addr 172.21.15.43:0/628292030 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3659c700 1 -- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a380cb2d0 msgr2=0x7f9a381548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a35d9b700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a380cb2d0 0x7f9a381548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3659c700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a380cb2d0 0x7f9a381548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a36d9d700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a3815c0b0 0x7f9a381f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3659c700 1 -- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a3815c0b0 msgr2=0x7f9a381f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3659c700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a3815c0b0 0x7f9a381f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3659c700 1 -- 172.21.15.43:0/628292030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280094a0 con 0x7f9a380b2a20 2023-06-08T03:48:52.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a35d9b700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a380cb2d0 0x7f9a381548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3659c700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a3814fef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00d800 tx=0x7f9a2c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0125f0 con 0x7f9a380b2a20 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c012750 con 0x7f9a380b2a20 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a381f54e0 con 0x7f9a380b2a20 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c012b00 con 0x7f9a380b2a20 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.408+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a381f2830 con 0x7f9a380b2a20 2023-06-08T03:48:52.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.409+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a38073fa0 con 0x7f9a380b2a20 2023-06-08T03:48:52.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.410+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a2c012c60 con 0x7f9a380b2a20 2023-06-08T03:48:52.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.410+0000 7f9a26ffd700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9a1806ad10 0x7f9a1806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.410+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a2c089b20 con 0x7f9a380b2a20 2023-06-08T03:48:52.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.410+0000 7f9a35d9b700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9a1806ad10 0x7f9a1806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.411+0000 7f9a35d9b700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9a1806ad10 0x7f9a1806d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a3815b380 tx=0x7f9a28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.415+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a2c0548e0 con 0x7f9a380b2a20 2023-06-08T03:48:52.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.655+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a380b3140 con 0x7f9a380b2a20 2023-06-08T03:48:52.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.655+0000 7f9a26ffd700 1 -- 172.21.15.43:0/628292030 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f9a2c057f00 con 0x7f9a380b2a20 2023-06-08T03:48:52.660 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:52.660 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:48:51.146665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-08T03:48:52.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9a1806ad10 msgr2=0x7f9a1806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9a1806ad10 0x7f9a1806d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a3815b380 tx=0x7f9a28008030 comp rx=0 tx=0).stop 2023-06-08T03:48:52.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 msgr2=0x7f9a3814fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a3814fef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00d800 tx=0x7f9a2c00dbc0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 shutdown_connections 2023-06-08T03:48:52.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9a1806ad10 0x7f9a1806d1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a380b2a20 0x7f9a3814fef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a3815c0b0 0x7f9a381f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 --2- 172.21.15.43:0/628292030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a380cb2d0 0x7f9a381548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 >> 172.21.15.43:0/628292030 conn(0x7f9a38069db0 msgr2=0x7f9a38158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:52.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 shutdown_connections 2023-06-08T03:48:52.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.657+0000 7f9a3cb6f700 1 -- 172.21.15.43:0/628292030 wait complete. 2023-06-08T03:48:52.663 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2023-06-08T03:48:52.673 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:52.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.796+0000 7f4a0960b700 1 Processor -- start 2023-06-08T03:48:52.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.796+0000 7f4a0960b700 1 -- start start 2023-06-08T03:48:52.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a0960b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4a040afa30 0x7f4a040b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a0960b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4a040cd980 0x7f4a040cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a0960b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a040b01a0 con 0x7f4a040b0c40 2023-06-08T03:48:52.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a0960b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a040b06f0 con 0x7f4a040cd980 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a0960b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a040b0900 con 0x7f4a040afa30 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4a040cd980 0x7f4a040cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a027fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4a040b0c40 0x7f4a040cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52806/0 (socket says 172.21.15.43:52806) 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4a040cd980 0x7f4a040cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57906/0 (socket says 172.21.15.43:57906) 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a027fc700 1 -- 172.21.15.43:0/3391729725 learned_addr learned my addr 172.21.15.43:0/3391729725 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a02ffd700 1 --2- 172.21.15.43:0/3391729725 >> v2:172.21.15.135:3300/0 conn(0x7f4a040afa30 0x7f4a040b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 -- 172.21.15.43:0/3391729725 >> v2:172.21.15.135:3300/0 conn(0x7f4a040afa30 msgr2=0x7f4a040b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 --2- 172.21.15.43:0/3391729725 >> v2:172.21.15.135:3300/0 conn(0x7f4a040afa30 0x7f4a040b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 -- 172.21.15.43:0/3391729725 >> v1:172.21.15.43:6789/0 conn(0x7f4a040b0c40 legacy=0x7f4a040cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a01ffb700 1 -- 172.21.15.43:0/3391729725 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121526931 0 0) 0x7f4a040b01a0 con 0x7f4a040b0c40 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 -- 172.21.15.43:0/3391729725 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040ca7a0 con 0x7f4a040cd980 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a037fe700 1 --2- 172.21.15.43:0/3391729725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040cd980 0x7f4a040cafa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a04071060 tx=0x7f49fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1269584f3aa48a05 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.797+0000 7f4a01ffb700 1 -- 172.21.15.43:0/3391729725 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00e070 con 0x7f4a040cd980 2023-06-08T03:48:52.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a01ffb700 1 -- 172.21.15.43:0/3391729725 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00bbd0 con 0x7f4a040cd980 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a01ffb700 1 -- 172.21.15.43:0/3391729725 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc012430 con 0x7f4a040cd980 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 -- 172.21.15.43:0/3391729725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040cd980 msgr2=0x7f4a040cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 --2- 172.21.15.43:0/3391729725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040cd980 0x7f4a040cafa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a04071060 tx=0x7f49fc00b330 comp rx=0 tx=0).stop 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 -- 172.21.15.43:0/3391729725 shutdown_connections 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 --2- 172.21.15.43:0/3391729725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040cd980 0x7f4a040cafa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 --2- 172.21.15.43:0/3391729725 >> v2:172.21.15.135:3300/0 conn(0x7f4a040afa30 0x7f4a040b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 -- 172.21.15.43:0/3391729725 >> 172.21.15.43:0/3391729725 conn(0x7f4a0406b7e0 msgr2=0x7f4a040cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:52.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 -- 172.21.15.43:0/3391729725 shutdown_connections 2023-06-08T03:48:52.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.798+0000 7f4a0960b700 1 -- 172.21.15.43:0/3391729725 wait complete. 2023-06-08T03:48:52.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.800+0000 7f4a0960b700 1 Processor -- start 2023-06-08T03:48:52.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.800+0000 7f4a0960b700 1 -- start start 2023-06-08T03:48:52.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a0960b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a040afa30 0x7f4a041ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a0960b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 0x7f4a040c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a0960b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a040cd980 0x7f4a0406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a0960b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040c4e90 con 0x7f4a040b0c40 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a0960b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040c3070 con 0x7f4a040cd980 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a0960b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040c3310 con 0x7f4a040afa30 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 0x7f4a040c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 0x7f4a040c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57910/0 (socket says 172.21.15.43:57910) 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 -- 172.21.15.43:0/789971593 learned_addr learned my addr 172.21.15.43:0/789971593 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a02ffd700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a040afa30 0x7f4a041ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a037fe700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a040cd980 0x7f4a0406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 -- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a040afa30 msgr2=0x7f4a041ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a040afa30 0x7f4a041ef2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 -- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a040cd980 msgr2=0x7f4a0406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a040cd980 0x7f4a0406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 -- 172.21.15.43:0/789971593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009a70 con 0x7f4a040b0c40 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.801+0000 7f4a027fc700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 0x7f4a040c4950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49f40011e0 tx=0x7f49f400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.802+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400ee10 con 0x7f4a040b0c40 2023-06-08T03:48:52.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.802+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f4004a80 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.802+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a040c35f0 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.802+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4004e30 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.802+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a040c3bb0 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.802+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a04073fa0 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.803+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49f40070d0 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.803+0000 7f49eb7fe700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f49f006ace0 0x7f49f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.804+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f49f408bbe0 con 0x7f4a040b0c40 2023-06-08T03:48:52.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.804+0000 7f4a02ffd700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f49f006ace0 0x7f49f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:52.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.804+0000 7f4a02ffd700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f49f006ace0 0x7f49f006d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49f800b840 tx=0x7f49f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:52.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:52.808+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49f4056900 con 0x7f4a040b0c40 2023-06-08T03:48:53.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.004+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a040c62b0 con 0x7f4a040b0c40 2023-06-08T03:48:53.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.005+0000 7f49eb7fe700 1 -- 172.21.15.43:0/789971593 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f49f4015090 con 0x7f4a040b0c40 2023-06-08T03:48:53.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:53.010 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:53.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f49f006ace0 msgr2=0x7f49f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f49f006ace0 0x7f49f006d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49f800b840 tx=0x7f49f8008040 comp rx=0 tx=0).stop 2023-06-08T03:48:53.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 msgr2=0x7f4a040c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 0x7f4a040c4950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49f40011e0 tx=0x7f49f400ecf0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 shutdown_connections 2023-06-08T03:48:53.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f49f006ace0 0x7f49f006d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a040cd980 0x7f4a0406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a040afa30 0x7f4a041ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 --2- 172.21.15.43:0/789971593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a040b0c40 0x7f4a040c4950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.007+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 >> 172.21.15.43:0/789971593 conn(0x7f4a0406b7e0 msgr2=0x7f4a040cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.008+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 shutdown_connections 2023-06-08T03:48:53.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.008+0000 7f4a0960b700 1 -- 172.21.15.43:0/789971593 wait complete. 2023-06-08T03:48:53.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:48:53.201 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:48:53.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-08T03:48:46.681077+0000', 'modified': '2023-06-08T03:48:51.146665+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6837/2399698877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6835', 'nonce': 2399698877}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2399698877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-08T03:48:53.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-08T03:48:53.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-08T03:48:53.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.553+0000 7f51413c5700 1 Processor -- start 2023-06-08T03:48:53.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.553+0000 7f51413c5700 1 -- start start 2023-06-08T03:48:53.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.553+0000 7f51413c5700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f513c0b43f0 0x7f513c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.553+0000 7f51413c5700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c0cf690 con 0x7f513c0ccfc0 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f51413c5700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c0d0770 con 0x7f513c0cd430 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f51413c5700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c0d0180 con 0x7f513c0b43f0 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f513c0b43f0 0x7f513c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513a7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f513c0ccfc0 0x7f513c0d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52820/0 (socket says 172.21.15.43:52820) 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513a7fc700 1 -- 172.21.15.43:0/1980024868 learned_addr learned my addr 172.21.15.43:0/1980024868 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513affd700 1 -- 172.21.15.43:0/1980024868 >> v1:172.21.15.135:6789/0 conn(0x7f513c0cd430 legacy=0x7f513c0d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513affd700 1 -- 172.21.15.43:0/1980024868 >> v1:172.21.15.43:6789/0 conn(0x7f513c0ccfc0 legacy=0x7f513c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513affd700 1 -- 172.21.15.43:0/1980024868 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c0b4d00 con 0x7f513c0b43f0 2023-06-08T03:48:53.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f513affd700 1 --2- 172.21.15.43:0/1980024868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0b43f0 0x7f513c0b47c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5130009820 tx=0x7f5130009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f80af6f3504901 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f5139ffb700 1 -- 172.21.15.43:0/1980024868 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130005e30 con 0x7f513c0b43f0 2023-06-08T03:48:53.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f5139ffb700 1 -- 172.21.15.43:0/1980024868 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5130004030 con 0x7f513c0b43f0 2023-06-08T03:48:53.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.554+0000 7f5139ffb700 1 -- 172.21.15.43:0/1980024868 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300043c0 con 0x7f513c0b43f0 2023-06-08T03:48:53.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 -- 172.21.15.43:0/1980024868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0b43f0 msgr2=0x7f513c0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 --2- 172.21.15.43:0/1980024868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0b43f0 0x7f513c0b47c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5130009820 tx=0x7f5130009b30 comp rx=0 tx=0).stop 2023-06-08T03:48:53.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 -- 172.21.15.43:0/1980024868 shutdown_connections 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 --2- 172.21.15.43:0/1980024868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0b43f0 0x7f513c0b47c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 -- 172.21.15.43:0/1980024868 >> 172.21.15.43:0/1980024868 conn(0x7f513c06afb0 msgr2=0x7f513c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 -- 172.21.15.43:0/1980024868 shutdown_connections 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.555+0000 7f51413c5700 1 -- 172.21.15.43:0/1980024868 wait complete. 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.556+0000 7f51413c5700 1 Processor -- start 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.556+0000 7f51413c5700 1 -- start start 2023-06-08T03:48:53.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f51413c5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513c0b43f0 0x7f513c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f51413c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0ccfc0 0x7f513c1e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f51413c5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 0x7f513c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f51413c5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0c9a40 con 0x7f513c0cd430 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f51413c5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c159ae0 con 0x7f513c0ccfc0 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f51413c5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0c9ce0 con 0x7f513c0b43f0 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 0x7f513c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 0x7f513c15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57926/0 (socket says 172.21.15.43:57926) 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 -- 172.21.15.43:0/3829532252 learned_addr learned my addr 172.21.15.43:0/3829532252 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0ccfc0 0x7f513c1e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513affd700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513c0b43f0 0x7f513c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 -- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513c0b43f0 msgr2=0x7f513c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513c0b43f0 0x7f513c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 -- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0ccfc0 msgr2=0x7f513c1e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0ccfc0 0x7f513c1e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513b7fe700 1 -- 172.21.15.43:0/3829532252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130009430 con 0x7f513c0cd430 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0ccfc0 0x7f513c1e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.557+0000 7f513affd700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513c0b43f0 0x7f513c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.558+0000 7f513b7fe700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 0x7f513c15ae00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f513400b990 tx=0x7f513400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.558+0000 7f51237fe700 1 -- 172.21.15.43:0/3829532252 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400c970 con 0x7f513c0cd430 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.558+0000 7f51237fe700 1 -- 172.21.15.43:0/3829532252 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400cad0 con 0x7f513c0cd430 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.558+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c1562f0 con 0x7f513c0cd430 2023-06-08T03:48:53.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.558+0000 7f51237fe700 1 -- 172.21.15.43:0/3829532252 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400ce80 con 0x7f513c0cd430 2023-06-08T03:48:53.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.558+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c15a000 con 0x7f513c0cd430 2023-06-08T03:48:53.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.559+0000 7f51237fe700 1 -- 172.21.15.43:0/3829532252 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5134006d50 con 0x7f513c0cd430 2023-06-08T03:48:53.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.560+0000 7f51237fe700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f512806ace0 0x7f512806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.560+0000 7f51237fe700 1 -- 172.21.15.43:0/3829532252 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5134089240 con 0x7f513c0cd430 2023-06-08T03:48:53.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.560+0000 7f513affd700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f512806ace0 0x7f512806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.561+0000 7f513affd700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f512806ace0 0x7f512806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5130014040 tx=0x7f5130008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.562+0000 7f514d54ab80 1 Processor -- start 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.562+0000 7f514d54ab80 1 -- start start 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f486c2f0 0x5640f4868310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f486cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f48b5c70 0x5640f48b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f514d54ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f47723b0 con 0x5640f486c6c0 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f4773c60 con 0x5640f48b5c70 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f47c6570 con 0x5640f486c2f0 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f486cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f486cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57932/0 (socket says 172.21.15.43:57932) 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 -- 172.21.15.43:0/1680419781 learned_addr learned my addr 172.21.15.43:0/1680419781 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513affd700 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f486c2f0 0x5640f4868310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513b7fe700 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f48b5c70 0x5640f48b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 -- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f486c2f0 msgr2=0x5640f4868310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f486c2f0 0x5640f4868310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 -- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f48b5c70 msgr2=0x5640f48b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f48b5c70 0x5640f48b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 -- 172.21.15.43:0/1680419781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f45edd90 con 0x5640f486c6c0 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.563+0000 7f513a7fc700 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f486cb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f512c0015c0 tx=0x7f512c0018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940d7239ad58d487 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f5120ff9700 1 -- 172.21.15.43:0/1680419781 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c005d70 con 0x5640f486c6c0 2023-06-08T03:48:53.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f5120ff9700 1 -- 172.21.15.43:0/1680419781 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00d050 con 0x5640f486c6c0 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f5120ff9700 1 -- 172.21.15.43:0/1680419781 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c007310 con 0x5640f486c6c0 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 -- 172.21.15.43:0/1680419781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 msgr2=0x5640f486cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f486cb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f512c0015c0 tx=0x7f512c0018d0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 -- 172.21.15.43:0/1680419781 shutdown_connections 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f48b5c70 0x5640f48b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f486c2f0 0x5640f4868310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 --2- 172.21.15.43:0/1680419781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f486cb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 -- 172.21.15.43:0/1680419781 >> 172.21.15.43:0/1680419781 conn(0x5640f486ace0 msgr2=0x5640f48b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.564+0000 7f514d54ab80 1 -- 172.21.15.43:0/1680419781 shutdown_connections 2023-06-08T03:48:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.565+0000 7f514d54ab80 1 -- 172.21.15.43:0/1680419781 wait complete. 2023-06-08T03:48:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.565+0000 7f514d54ab80 1 -- start start 2023-06-08T03:48:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.565+0000 7f514d54ab80 1 Processor -- start 2023-06-08T03:48:53.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f488cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f489a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f488f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f47bfa00 con 0x5640f486c2f0 2023-06-08T03:48:53.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f475fa70 con 0x5640f486c6c0 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f475f770 con 0x5640f48b5c70 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f488cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f514d54ab80 10 client.0 _ll_register_callbacks cb 0x5640f475d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f488cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57936/0 (socket says 172.21.15.43:57936) 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 -- 172.21.15.43:0/3723207582 learned_addr learned my addr 172.21.15.43:0/3723207582 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513b7fe700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f488f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f489a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 -- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 msgr2=0x5640f488f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f488f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 -- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 msgr2=0x5640f489a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f489a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513affd700 1 -- 172.21.15.43:0/3723207582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c0cf690 con 0x5640f486c2f0 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.566+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f489a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f513affd700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f488cac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5130004000 tx=0x7f51300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ca5b7fe59342 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f5119ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f5119ffb700 1 -- 172.21.15.43:0/3723207582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513001d9c0 con 0x5640f486c2f0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f5119ffb700 1 -- 172.21.15.43:0/3723207582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f513001db20 con 0x5640f486c2f0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640f4860850 con 0x5640f486c2f0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f5119ffb700 1 -- 172.21.15.43:0/3723207582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f513001dce0 con 0x5640f486c2f0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 10 client.4419 fetch_fsmap learned FSMap version 7 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5640f45d6c10 con 0x5640f486c2f0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f5119ffb700 1 -- 172.21.15.43:0/3723207582 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640f4860850 con 0x5640f486c2f0 2023-06-08T03:48:53.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f5119ffb700 1 -- 172.21.15.43:0/3723207582 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f513002e020 con 0x5640f486c2f0 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 20 client.4419 populate_metadata read hostname 'smithi043' 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f488f610 0x5640f488de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 4 client.4419 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 --> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640f47b89e0 con 0x5640f488f610 2023-06-08T03:48:53.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.567+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f488f610 0x5640f488de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.568+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f488f610 0x5640f488de70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a05a8786aecb95 server_cookie=c77363a033590953 in_seq=0 out_seq=0 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.568+0000 7f5119ffb700 10 client.4419 ms_handle_connect on v2:172.21.15.135:6835/2399698877 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f5119ffb700 1 -- 172.21.15.43:0/3723207582 <== mds.0 v2:172.21.15.135:6835/2399698877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5640f47b89e0 con 0x5640f488f610 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f5119ffb700 10 client.4419 handle_command_reply: tid=0 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 client.4419 shutdown 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 msgr2=0x5640f488cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f488cac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5130004000 tx=0x7f51300047c0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 shutdown_connections 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f488f610 0x5640f488de70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f488cac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f488f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f5119ffb700 0 client.4419 ms_handle_reset on v2:172.21.15.135:6835/2399698877 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3723207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f489a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 >> 172.21.15.43:0/3723207582 conn(0x5640f486ace0 msgr2=0x5640f48b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 shutdown_connections 2023-06-08T03:48:53.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 1 -- 172.21.15.43:0/3723207582 wait complete. 2023-06-08T03:48:53.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.569+0000 7f514d54ab80 20 client.4419 trim_cache size 0 max 16384 2023-06-08T03:48:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.587+0000 7f514d54ab80 1 Processor -- start 2023-06-08T03:48:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.587+0000 7f514d54ab80 1 -- start start 2023-06-08T03:48:53.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f4862440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f488fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f4890140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f514d54ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f46438d0 con 0x5640f486c2f0 2023-06-08T03:48:53.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f486b300 con 0x5640f486c6c0 2023-06-08T03:48:53.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f48690c0 con 0x5640f48b5c70 2023-06-08T03:48:53.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f4862440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f4862440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57944/0 (socket says 172.21.15.43:57944) 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 -- 172.21.15.43:0/3283151876 learned_addr learned my addr 172.21.15.43:0/3283151876 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513a7fc700 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f488fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513b7fe700 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f4890140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 -- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 msgr2=0x5640f4890140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f4890140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 -- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 msgr2=0x5640f488fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f488fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 -- 172.21.15.43:0/3283151876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f4614200 con 0x5640f486c2f0 2023-06-08T03:48:53.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f513affd700 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f4862440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5130004800 tx=0x7f5130028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48944ce6de39c0d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f51217fa700 1 -- 172.21.15.43:0/3283151876 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513001d7c0 con 0x5640f486c2f0 2023-06-08T03:48:53.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f51217fa700 1 -- 172.21.15.43:0/3283151876 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513001d960 con 0x5640f486c2f0 2023-06-08T03:48:53.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.588+0000 7f51217fa700 1 -- 172.21.15.43:0/3283151876 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130028950 con 0x5640f486c2f0 2023-06-08T03:48:53.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 -- 172.21.15.43:0/3283151876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 msgr2=0x5640f4862440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f4862440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5130004800 tx=0x7f5130028000 comp rx=0 tx=0).stop 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 -- 172.21.15.43:0/3283151876 shutdown_connections 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c2f0 0x5640f4862440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f4890140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 --2- 172.21.15.43:0/3283151876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c6c0 0x5640f488fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 -- 172.21.15.43:0/3283151876 >> 172.21.15.43:0/3283151876 conn(0x5640f486ace0 msgr2=0x5640f488e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 -- 172.21.15.43:0/3283151876 shutdown_connections 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.589+0000 7f514d54ab80 1 -- 172.21.15.43:0/3283151876 wait complete. 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 -- start start 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 Processor -- start 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c2f0 0x5640f490e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f491a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f490c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f490d780 con 0x5640f486c6c0 2023-06-08T03:48:53.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f491afc0 con 0x5640f486c2f0 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f490ee90 con 0x5640f48b5c70 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f514d54ab80 10 client.0 _ll_register_callbacks cb 0x5640f475d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f513a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f491a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.590+0000 7f513a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f491a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57952/0 (socket says 172.21.15.43:57952) 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 -- 172.21.15.43:0/2271579197 learned_addr learned my addr 172.21.15.43:0/2271579197 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513affd700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c2f0 0x5640f490e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513b7fe700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f490c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 -- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 msgr2=0x5640f490c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f490c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 -- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c2f0 msgr2=0x5640f490e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c2f0 0x5640f490e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 -- 172.21.15.43:0/2271579197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640f45d6c10 con 0x5640f486c6c0 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f513a7fc700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f491a2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f512c000fd0 tx=0x7f512c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f769e37cb765eb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f5119ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-06-08T03:48:53.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f5119ffb700 1 -- 172.21.15.43:0/2271579197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c02a030 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f5119ffb700 1 -- 172.21.15.43:0/2271579197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f512c02b070 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f512c00d050 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f5119ffb700 1 -- 172.21.15.43:0/2271579197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f512c025070 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f514d54ab80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5640f45ec260 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f5119ffb700 1 -- 172.21.15.43:0/2271579197 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00d050 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f5119ffb700 1 -- 172.21.15.43:0/2271579197 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f512c0261b0 con 0x5640f486c6c0 2023-06-08T03:48:53.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f514d54ab80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f514d54ab80 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.591+0000 7f514d54ab80 20 client.4425 populate_metadata read hostname 'smithi043' 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f4896a60 0x5640f4896e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 4 client.4425 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 --> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5640f477b000 con 0x5640f4896a60 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f513affd700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f4896a60 0x5640f4896e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f5119ffb700 10 client.4425 ms_handle_connect on v2:172.21.15.135:6835/2399698877 2023-06-08T03:48:53.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f513affd700 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f4896a60 0x5640f4896e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b4d3d818af2a91 server_cookie=896a11e2ffd2ad1d in_seq=0 out_seq=0 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f5119ffb700 1 -- 172.21.15.43:0/2271579197 <== mds.0 v2:172.21.15.135:6835/2399698877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5640f477b000 con 0x5640f4896a60 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f5119ffb700 10 client.4425 handle_command_reply: tid=0 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 client.4425 shutdown 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 msgr2=0x5640f491a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f491a2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f512c000fd0 tx=0x7f512c000bc0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 shutdown_connections 2023-06-08T03:48:53.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x5640f4896a60 0x5640f4896e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5640f48b5c70 0x5640f490c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640f486c2f0 0x5640f490e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f5119ffb700 0 client.4425 ms_handle_reset on v2:172.21.15.135:6835/2399698877 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 --2- 172.21.15.43:0/2271579197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f486c6c0 0x5640f491a2d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 >> 172.21.15.43:0/2271579197 conn(0x5640f486ace0 msgr2=0x5640f48b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.592+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 shutdown_connections 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f514d54ab80 1 -- 172.21.15.43:0/2271579197 wait complete. 2023-06-08T03:48:53.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f514d54ab80 20 client.4425 trim_cache size 0 max 16384 2023-06-08T03:48:53.607 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-06-08T03:48:53.607 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "5ca92cbd-c0c8-4573-b70a-f139aab8d7d6", 2023-06-08T03:48:53.607 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-06-08T03:48:53.607 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4279, 2023-06-08T03:48:53.607 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-06-08T03:48:53.607 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.9076809600000004, 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 7, 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 25, 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 24, 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 12.304221425 2023-06-08T03:48:53.608 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-06-08T03:48:53.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f512806ace0 msgr2=0x7f512806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f512806ace0 0x7f512806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5130014040 tx=0x7f5130008070 comp rx=0 tx=0).stop 2023-06-08T03:48:53.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 msgr2=0x7f513c15ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 0x7f513c15ae00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f513400b990 tx=0x7f513400bd50 comp rx=0 tx=0).stop 2023-06-08T03:48:53.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 shutdown_connections 2023-06-08T03:48:53.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f512806ace0 0x7f512806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c0cd430 0x7f513c15ae00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513c0b43f0 0x7f513c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 --2- 172.21.15.43:0/3829532252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0ccfc0 0x7f513c1e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 >> 172.21.15.43:0/3829532252 conn(0x7f513c06afb0 msgr2=0x7f513c0d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 shutdown_connections 2023-06-08T03:48:53.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.593+0000 7f51413c5700 1 -- 172.21.15.43:0/3829532252 wait complete. 2023-06-08T03:48:53.611 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T03:48:53.612 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:53.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T03:48:53.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.733+0000 7f2923e90700 1 Processor -- start 2023-06-08T03:48:53.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.733+0000 7f2923e90700 1 -- start start 2023-06-08T03:48:53.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f2923e90700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c06a4c0 0x7f291c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f2923e90700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291c0af050 con 0x7f291c15c590 2023-06-08T03:48:53.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f2923e90700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291c0af800 con 0x7f291c0ccba0 2023-06-08T03:48:53.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f2923e90700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0afae0 con 0x7f291c06a4c0 2023-06-08T03:48:53.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f2921c2c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f291c15c590 0x7f291c069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52862/0 (socket says 172.21.15.43:52862) 2023-06-08T03:48:53.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f2921c2c700 1 -- 172.21.15.43:0/2066756615 learned_addr learned my addr 172.21.15.43:0/2066756615 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:53.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f292142b700 1 --2- 172.21.15.43:0/2066756615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c06a4c0 0x7f291c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f292142b700 1 -- 172.21.15.43:0/2066756615 >> v1:172.21.15.135:6789/0 conn(0x7f291c0ccba0 legacy=0x7f291c0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f292142b700 1 -- 172.21.15.43:0/2066756615 >> v1:172.21.15.43:6789/0 conn(0x7f291c15c590 legacy=0x7f291c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.734+0000 7f292142b700 1 -- 172.21.15.43:0/2066756615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0cc0c0 con 0x7f291c06a4c0 2023-06-08T03:48:53.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.735+0000 7f292142b700 1 --2- 172.21.15.43:0/2066756615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c06a4c0 0x7f291c0af220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f290c009870 tx=0x7f290c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517b96a8cbd36208 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.737+0000 7f2920c2a700 1 -- 172.21.15.43:0/2066756615 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c011830 con 0x7f291c06a4c0 2023-06-08T03:48:53.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.737+0000 7f2920c2a700 1 -- 172.21.15.43:0/2066756615 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c011990 con 0x7f291c06a4c0 2023-06-08T03:48:53.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.737+0000 7f2920c2a700 1 -- 172.21.15.43:0/2066756615 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c011d20 con 0x7f291c06a4c0 2023-06-08T03:48:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 -- 172.21.15.43:0/2066756615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c06a4c0 msgr2=0x7f291c0af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 --2- 172.21.15.43:0/2066756615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c06a4c0 0x7f291c0af220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f290c009870 tx=0x7f290c009b80 comp rx=0 tx=0).stop 2023-06-08T03:48:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 -- 172.21.15.43:0/2066756615 shutdown_connections 2023-06-08T03:48:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 --2- 172.21.15.43:0/2066756615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c06a4c0 0x7f291c0af220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 -- 172.21.15.43:0/2066756615 >> 172.21.15.43:0/2066756615 conn(0x7f291c06b7e0 msgr2=0x7f291c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 -- 172.21.15.43:0/2066756615 shutdown_connections 2023-06-08T03:48:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.738+0000 7f2923e90700 1 -- 172.21.15.43:0/2066756615 wait complete. 2023-06-08T03:48:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.739+0000 7f2923e90700 1 Processor -- start 2023-06-08T03:48:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.739+0000 7f2923e90700 1 -- start start 2023-06-08T03:48:53.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2923e90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291c06a4c0 0x7f291c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2923e90700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 0x7f291c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2923e90700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c15c590 0x7f291c1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2923e90700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0b4600 con 0x7f291c0ccba0 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2923e90700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0b39f0 con 0x7f291c06a4c0 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2923e90700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0b3cd0 con 0x7f291c15c590 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 0x7f291c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 0x7f291c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57966/0 (socket says 172.21.15.43:57966) 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 -- 172.21.15.43:0/3669996474 learned_addr learned my addr 172.21.15.43:0/3669996474 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292242d700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c15c590 0x7f291c1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f2921c2c700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291c06a4c0 0x7f291c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 -- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c15c590 msgr2=0x7f291c1f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c15c590 0x7f291c1f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 -- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291c06a4c0 msgr2=0x7f291c0c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291c06a4c0 0x7f291c0c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:53.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 -- 172.21.15.43:0/3669996474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c0094a0 con 0x7f291c0ccba0 2023-06-08T03:48:53.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.740+0000 7f292142b700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 0x7f291c14d9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f290c000c00 tx=0x7f290c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.742+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0036a0 con 0x7f291c0ccba0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.742+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c01f070 con 0x7f291c0ccba0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.742+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c003a20 con 0x7f291c0ccba0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.742+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c0b3fb0 con 0x7f291c0ccba0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.742+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c14df30 con 0x7f291c0ccba0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.743+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f290c003b80 con 0x7f291c0ccba0 2023-06-08T03:48:53.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.743+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c073fa0 con 0x7f291c0ccba0 2023-06-08T03:48:53.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.744+0000 7f29127fc700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f290006ace0 0x7f290006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:53.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.744+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f290c021070 con 0x7f291c0ccba0 2023-06-08T03:48:53.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.744+0000 7f2921c2c700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f290006ace0 0x7f290006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:53.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.744+0000 7f2921c2c700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f290006ace0 0x7f290006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2918007fd0 tx=0x7f2918009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:53.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.748+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f290c055f50 con 0x7f291c0ccba0 2023-06-08T03:48:53.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.990+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f291c071dc0 con 0x7f291c0ccba0 2023-06-08T03:48:53.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.991+0000 7f29127fc700 1 -- 172.21.15.43:0/3669996474 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f290c059570 con 0x7f291c0ccba0 2023-06-08T03:48:53.995 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-08T03:48:53.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f290006ace0 msgr2=0x7f290006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f290006ace0 0x7f290006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2918007fd0 tx=0x7f2918009040 comp rx=0 tx=0).stop 2023-06-08T03:48:53.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 msgr2=0x7f291c14d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:53.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 0x7f291c14d9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f290c000c00 tx=0x7f290c004750 comp rx=0 tx=0).stop 2023-06-08T03:48:53.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 shutdown_connections 2023-06-08T03:48:53.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f290006ace0 0x7f290006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291c15c590 0x7f291c1f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291c06a4c0 0x7f291c0c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 --2- 172.21.15.43:0/3669996474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f291c0ccba0 0x7f291c14d9f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 >> 172.21.15.43:0/3669996474 conn(0x7f291c06b7e0 msgr2=0x7f291c06e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 shutdown_connections 2023-06-08T03:48:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:53.993+0000 7f2923e90700 1 -- 172.21.15.43:0/3669996474 wait complete. 2023-06-08T03:48:54.009 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-08T03:48:54.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T03:48:54.009 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2023-06-08T03:48:54.010 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-08T03:48:54.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:54.010 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-08T03:48:54.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T03:48:54.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T03:48:54.011 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-08T03:48:54.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.011 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2023-06-08T03:48:54.028 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:48:54.029 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42451sec preferred_lft 42451sec 2023-06-08T03:48:54.030 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-06-08T03:48:54.031 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:48:54.031 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:48:54.031 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:48:54.032 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-08T03:48:54.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.032 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:48:54.033 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:48:54.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2023-06-08T03:48:54.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2023-06-08T03:48:54.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2023-06-08T03:48:54.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-08T03:48:54.034 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:48:54.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.195 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T03:48:54.225 INFO:teuthology.orchestra.run.smithi043.stdout:1 2023-06-08T03:48:54.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.227 DEBUG:teuthology.orchestra.run.smithi043:> route 2023-06-08T03:48:54.297 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2023-06-08T03:48:54.297 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T03:48:54.297 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T03:48:54.297 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T03:48:54.297 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T03:48:54.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.298 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:48:54.298 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:48:54.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T03:48:54.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T03:48:54.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T03:48:54.299 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:48:54.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.571 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-06-08T03:48:54.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.589 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2023-06-08T03:48:54.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.645 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:48:54.645 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:48:54.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-08T03:48:54.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-08T03:48:54.646 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:48:54.741 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-08T03:48:54.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.742 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:48:54.743 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:48:54.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-08T03:48:54.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-08T03:48:54.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-08T03:48:54.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-08T03:48:54.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-08T03:48:54.745 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:48:54.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:54.963 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:48:54.963 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:48:54.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2023-06-08T03:48:54.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2023-06-08T03:48:54.964 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:48:55.077 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-08T03:48:55.077 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:48:55.078 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:55.101 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-08T03:48:55.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:48:55.101 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:55.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2023-06-08T03:48:55.226 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-08T03:48:55.227 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-08T03:48:55.293 INFO:teuthology.orchestra.run.smithi043.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-08T03:48:55.294 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-08T03:48:55.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:55.295 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2023-06-08T03:48:55.351 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-08T03:48:55.352 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-08T03:48:55.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2023-06-08T03:48:55.420 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-08T03:48:55.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-08T03:48:55.487 INFO:teuthology.orchestra.run.smithi043.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-08T03:48:55.488 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-08T03:48:55.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:55.489 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2023-06-08T03:48:55.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:2023-06-08T03:48:55.513+0000 7fda3fe665c0 -1 init, newargv = 0x55e8803844f0 newargc=15 2023-06-08T03:48:55.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[106509]: starting ceph client 2023-06-08T03:48:55.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[106509]: starting fuse 2023-06-08T03:48:55.534 INFO:teuthology.orchestra.run.smithi043.stdout:47 2023-06-08T03:48:55.534 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-06-08T03:48:55.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-08T03:48:55.535 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2023-06-08T03:48:55.535 DEBUG:teuthology.orchestra.run.smithi043:> import re 2023-06-08T03:48:55.535 DEBUG:teuthology.orchestra.run.smithi043:> import os 2023-06-08T03:48:55.535 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2023-06-08T03:48:55.536 DEBUG:teuthology.orchestra.run.smithi043:> 2023-06-08T03:48:55.536 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2023-06-08T03:48:55.536 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-08T03:48:55.537 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2023-06-08T03:48:55.537 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-08T03:48:55.537 DEBUG:teuthology.orchestra.run.smithi043:> 2023-06-08T03:48:55.537 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2023-06-08T03:48:55.538 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2023-06-08T03:48:55.538 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2023-06-08T03:48:55.539 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2023-06-08T03:48:55.539 DEBUG:teuthology.orchestra.run.smithi043:> 2023-06-08T03:48:55.539 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2023-06-08T03:48:55.539 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-08T03:48:55.540 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-08T03:48:55.540 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-08T03:48:55.540 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2023-06-08T03:48:55.541 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2023-06-08T03:48:55.541 DEBUG:teuthology.orchestra.run.smithi043:> return f 2023-06-08T03:48:55.541 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-08T03:48:55.541 DEBUG:teuthology.orchestra.run.smithi043:> 2023-06-08T03:48:55.542 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.admin")) 2023-06-08T03:48:55.542 DEBUG:teuthology.orchestra.run.smithi043:> ' 2023-06-08T03:48:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.admin.106509.asok 2023-06-08T03:48:55.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.106509.asok 2023-06-08T03:48:55.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:55.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.106509.asok status 2023-06-08T03:48:56.002 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-06-08T03:48:56.002 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2023-06-08T03:48:56.002 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-08T03:48:56.002 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "admin", 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "106509", 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:48:56.003 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4431, 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 4431 2023-06-08T03:48:56.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:48:56.005 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2023-06-08T03:48:56.005 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2023-06-08T03:48:56.005 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2023-06-08T03:48:56.005 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2381710139 2023-06-08T03:48:56.005 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:48:56.005 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2381710139 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.4431 192.168.0.1:0/2381710139", 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/2381710139", 2023-06-08T03:48:56.006 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2023-06-08T03:48:56.007 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 7, 2023-06-08T03:48:56.007 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 25, 2023-06-08T03:48:56.007 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2023-06-08T03:48:56.007 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2023-06-08T03:48:56.007 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2023-06-08T03:48:56.007 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-06-08T03:48:56.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:56.012 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2023-06-08T03:48:56.012 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:56.030 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2023-06-08T03:48:56.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:56.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:56.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:48:56.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:48:56.098 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-08T03:48:56.197 INFO:teuthology.orchestra.run.smithi043.stdout:# file: . 2023-06-08T03:48:56.197 INFO:teuthology.orchestra.run.smithi043.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-08T03:48:56.198 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:56.198 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:56.198 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:48:56.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.375+0000 7f1542a09700 1 Processor -- start 2023-06-08T03:48:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f1542a09700 1 -- start start 2023-06-08T03:48:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f1542a09700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f153c06aec0 0x7f153c06b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f1542a09700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0cf9f0 0x7f153c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f1542a09700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c0cf380 con 0x7f153c15c6a0 2023-06-08T03:48:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f1542a09700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0d17b0 con 0x7f153c06aec0 2023-06-08T03:48:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f1542a09700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c06b7d0 con 0x7f153c0cf9f0 2023-06-08T03:48:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f153bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f153c06aec0 0x7f153c06b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.376+0000 7f153b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f153c15c6a0 0x7f153c0cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52898/0 (socket says 172.21.15.43:52898) 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153b7fe700 1 -- 172.21.15.43:0/3340202469 learned_addr learned my addr 172.21.15.43:0/3340202469 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f1540fa6700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0cf9f0 0x7f153c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153bfff700 1 -- 172.21.15.43:0/3340202469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0cf9f0 msgr2=0x7f153c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153bfff700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0cf9f0 0x7f153c0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153bfff700 1 -- 172.21.15.43:0/3340202469 >> v1:172.21.15.43:6789/0 conn(0x7f153c15c6a0 legacy=0x7f153c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153bfff700 1 -- 172.21.15.43:0/3340202469 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0ce770 con 0x7f153c06aec0 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153affd700 1 -- 172.21.15.43:0/3340202469 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232989877 0 0) 0x7f153c0cf380 con 0x7f153c15c6a0 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f1540fa6700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0cf9f0 0x7f153c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153bfff700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c06aec0 0x7f153c06b290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f152c009840 tx=0x7f152c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2b7c174512f860 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153affd700 1 -- 172.21.15.43:0/3340202469 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c011830 con 0x7f153c06aec0 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153affd700 1 -- 172.21.15.43:0/3340202469 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c011990 con 0x7f153c06aec0 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.377+0000 7f153affd700 1 -- 172.21.15.43:0/3340202469 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c011d20 con 0x7f153c06aec0 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 -- 172.21.15.43:0/3340202469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c06aec0 msgr2=0x7f153c06b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c06aec0 0x7f153c06b290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f152c009840 tx=0x7f152c009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:56.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 -- 172.21.15.43:0/3340202469 shutdown_connections 2023-06-08T03:48:56.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0cf9f0 0x7f153c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 --2- 172.21.15.43:0/3340202469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c06aec0 0x7f153c06b290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 -- 172.21.15.43:0/3340202469 >> 172.21.15.43:0/3340202469 conn(0x7f153c099b20 msgr2=0x7f153c08a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:56.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 -- 172.21.15.43:0/3340202469 shutdown_connections 2023-06-08T03:48:56.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.378+0000 7f1542a09700 1 -- 172.21.15.43:0/3340202469 wait complete. 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.379+0000 7f1542a09700 1 Processor -- start 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 -- start start 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c06aec0 0x7f153c1f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 0x7f153c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c15c6a0 0x7f153c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0cb060 con 0x7f153c0cf9f0 2023-06-08T03:48:56.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0cb340 con 0x7f153c15c6a0 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f1542a09700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0cb620 con 0x7f153c06aec0 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f153b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 0x7f153c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.380+0000 7f153b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 0x7f153c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58000/0 (socket says 172.21.15.43:58000) 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 -- 172.21.15.43:0/3641499472 learned_addr learned my addr 172.21.15.43:0/3641499472 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153bfff700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c06aec0 0x7f153c1f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f1540fa6700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c15c6a0 0x7f153c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 -- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c06aec0 msgr2=0x7f153c1f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c06aec0 0x7f153c1f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 -- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c15c6a0 msgr2=0x7f153c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c15c6a0 0x7f153c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 -- 172.21.15.43:0/3641499472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0094a0 con 0x7f153c0cf9f0 2023-06-08T03:48:56.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f153b7fe700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 0x7f153c15ca70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15300011e0 tx=0x7f153000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:56.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530004c80 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530004de0 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c0cb900 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530007310 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.381+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c1f1830 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.382+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c0cbe20 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.383+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1530007470 con 0x7f153c0cf9f0 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.383+0000 7f1538ff9700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f152806ace0 0x7f152806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.383+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1530089440 con 0x7f153c0cf9f0 2023-06-08T03:48:56.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.383+0000 7f153bfff700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f152806ace0 0x7f152806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.384+0000 7f153bfff700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f152806ace0 0x7f152806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f152c0090b0 tx=0x7f152c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:56.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.388+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f153c0cbe20 con 0x7f153c0cf9f0 2023-06-08T03:48:56.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.587+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f153c0cbe20 con 0x7f153c0cf9f0 2023-06-08T03:48:56.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.588+0000 7f1538ff9700 1 -- 172.21.15.43:0/3641499472 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f153c0cbe20 con 0x7f153c0cf9f0 2023-06-08T03:48:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:56.593 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:56.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f152806ace0 msgr2=0x7f152806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f152806ace0 0x7f152806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f152c0090b0 tx=0x7f152c01c040 comp rx=0 tx=0).stop 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 msgr2=0x7f153c15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 0x7f153c15ca70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15300011e0 tx=0x7f153000ca30 comp rx=0 tx=0).stop 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 shutdown_connections 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f152806ace0 0x7f152806d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c15c6a0 0x7f153c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c06aec0 0x7f153c1f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 --2- 172.21.15.43:0/3641499472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153c0cf9f0 0x7f153c15ca70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 >> 172.21.15.43:0/3641499472 conn(0x7f153c099b20 msgr2=0x7f153c0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:56.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 shutdown_connections 2023-06-08T03:48:56.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.590+0000 7f1542a09700 1 -- 172.21.15.43:0/3641499472 wait complete. 2023-06-08T03:48:56.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:48:56.607 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:48:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.729+0000 7f774fd53700 1 Processor -- start 2023-06-08T03:48:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.729+0000 7f774fd53700 1 -- start start 2023-06-08T03:48:56.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774fd53700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f77480cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774fd53700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f774815e340 0x7f77480cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774fd53700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77480cda20 con 0x7f77480cf5b0 2023-06-08T03:48:56.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774fd53700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77480b6470 con 0x7f774815e340 2023-06-08T03:48:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774fd53700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774815e7c0 con 0x7f77480b60a0 2023-06-08T03:48:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774d2ee700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f77480cf5b0 0x7f774815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52914/0 (socket says 172.21.15.43:52914) 2023-06-08T03:48:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774d2ee700 1 -- 172.21.15.43:0/3891230717 learned_addr learned my addr 172.21.15.43:0/3891230717 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774daef700 1 --2- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f77480cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.730+0000 7f774e2f0700 1 --2- 172.21.15.43:0/3891230717 >> v2:172.21.15.135:3300/0 conn(0x7f774815e340 0x7f77480cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774caed700 1 -- 172.21.15.43:0/3891230717 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083588357 0 0) 0x7f77480cda20 con 0x7f77480cf5b0 2023-06-08T03:48:56.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774caed700 1 -- 172.21.15.43:0/3891230717 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77340035b0 con 0x7f77480cf5b0 2023-06-08T03:48:56.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774e2f0700 1 -- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 msgr2=0x7f77480cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:56.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774e2f0700 1 --2- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f77480cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774e2f0700 1 -- 172.21.15.43:0/3891230717 >> v1:172.21.15.43:6789/0 conn(0x7f77480cf5b0 legacy=0x7f774815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774e2f0700 1 -- 172.21.15.43:0/3891230717 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774815a520 con 0x7f774815e340 2023-06-08T03:48:56.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774e2f0700 1 --2- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480cfb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f774000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31601a76738aa57 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:56.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774caed700 1 -- 172.21.15.43:0/3891230717 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000e070 con 0x7f774815e340 2023-06-08T03:48:56.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774caed700 1 -- 172.21.15.43:0/3891230717 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774000bb20 con 0x7f774815e340 2023-06-08T03:48:56.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.731+0000 7f774caed700 1 -- 172.21.15.43:0/3891230717 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740012430 con 0x7f774815e340 2023-06-08T03:48:56.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 -- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 msgr2=0x7f77480cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 --2- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480cfb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f774000b330 comp rx=0 tx=0).stop 2023-06-08T03:48:56.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 -- 172.21.15.43:0/3891230717 shutdown_connections 2023-06-08T03:48:56.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 --2- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480cfb00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 --2- 172.21.15.43:0/3891230717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f77480cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 -- 172.21.15.43:0/3891230717 >> 172.21.15.43:0/3891230717 conn(0x7f7748069db0 msgr2=0x7f774806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 -- 172.21.15.43:0/3891230717 shutdown_connections 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.732+0000 7f774fd53700 1 -- 172.21.15.43:0/3891230717 wait complete. 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.733+0000 7f774fd53700 1 Processor -- start 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.733+0000 7f774fd53700 1 -- start start 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774fd53700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f7748147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774fd53700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 0x7f77480b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774fd53700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774fd53700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748148090 con 0x7f77480cf5b0 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774fd53700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774815a7b0 con 0x7f774815e340 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774fd53700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774815aa50 con 0x7f77480b60a0 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 0x7f77480b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 0x7f77480b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58014/0 (socket says 172.21.15.43:58014) 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 -- 172.21.15.43:0/2882645936 learned_addr learned my addr 172.21.15.43:0/2882645936 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:56.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774daef700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f7748147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774e2f0700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 -- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 msgr2=0x7f7748147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f7748147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 -- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 msgr2=0x7f77480b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 -- 172.21.15.43:0/2882645936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740009a70 con 0x7f77480cf5b0 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774e2f0700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:56.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f774d2ee700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 0x7f77480b11d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f774400c700 tx=0x7f774400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.734+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744005d70 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.735+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440070d0 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.735+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774815ad30 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.735+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744007460 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.735+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774815cbd0 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.735+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774815b250 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.736+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77440075c0 con 0x7f77480cf5b0 2023-06-08T03:48:56.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.736+0000 7f773e7fc700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772c06ace0 0x7f772c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:56.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.736+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7744088e00 con 0x7f77480cf5b0 2023-06-08T03:48:56.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.737+0000 7f774daef700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772c06ace0 0x7f772c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:56.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.737+0000 7f774daef700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772c06ace0 0x7f772c06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7738009ad0 tx=0x7f7738008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:56.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.741+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f774815b250 con 0x7f77480cf5b0 2023-06-08T03:48:56.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.937+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7748073fa0 con 0x7f77480cf5b0 2023-06-08T03:48:56.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.938+0000 7f773e7fc700 1 -- 172.21.15.43:0/2882645936 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7744053bd0 con 0x7f77480cf5b0 2023-06-08T03:48:56.942 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:48:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772c06ace0 msgr2=0x7f772c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772c06ace0 0x7f772c06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7738009ad0 tx=0x7f7738008040 comp rx=0 tx=0).stop 2023-06-08T03:48:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 msgr2=0x7f77480b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 0x7f77480b11d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f774400c700 tx=0x7f774400cac0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 shutdown_connections 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772c06ace0 0x7f772c06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f774815e340 0x7f77480b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77480b60a0 0x7f7748147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 --2- 172.21.15.43:0/2882645936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77480cf5b0 0x7f77480b11d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 >> 172.21.15.43:0/2882645936 conn(0x7f7748069db0 msgr2=0x7f774806a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:56.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 shutdown_connections 2023-06-08T03:48:56.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:56.940+0000 7f774fd53700 1 -- 172.21.15.43:0/2882645936 wait complete. 2023-06-08T03:48:56.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:48:57.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.079+0000 7f74355d6700 1 Processor -- start 2023-06-08T03:48:57.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.079+0000 7f74355d6700 1 -- start start 2023-06-08T03:48:57.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f74355d6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300b4ed0 0x7f74300d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f74355d6700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743015c750 con 0x7f74300ccb00 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f74355d6700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300cf740 con 0x7f74300b43f0 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f74355d6700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300ccfc0 con 0x7f74300b4ed0 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742e7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f74300ccb00 0x7f74300d0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52926/0 (socket says 172.21.15.43:52926) 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742e7fc700 1 -- 172.21.15.43:0/1258095937 learned_addr learned my addr 172.21.15.43:0/1258095937 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742f7fe700 1 --2- 172.21.15.43:0/1258095937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300b4ed0 0x7f74300d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696531268 0 0) 0x7f7420001110 con 0x7f74300ccb00 2023-06-08T03:48:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74180035b0 con 0x7f74300ccb00 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077096728 0 0) 0x7f74300cf740 con 0x7f74300b43f0 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7420001110 con 0x7f74300b43f0 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742f7fe700 1 -- 172.21.15.43:0/1258095937 >> v1:172.21.15.135:6789/0 conn(0x7f74300b43f0 legacy=0x7f74300b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742f7fe700 1 -- 172.21.15.43:0/1258095937 >> v1:172.21.15.43:6789/0 conn(0x7f74300ccb00 legacy=0x7f74300d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.080+0000 7f742f7fe700 1 -- 172.21.15.43:0/1258095937 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300cd540 con 0x7f74300b4ed0 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f742f7fe700 1 --2- 172.21.15.43:0/1258095937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300b4ed0 0x7f74300d0d50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7428009dc0 tx=0x7f742800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4977ff0724319efb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800e070 con 0x7f74300b4ed0 2023-06-08T03:48:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800bb20 con 0x7f74300b4ed0 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f742dffb700 1 -- 172.21.15.43:0/1258095937 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428012430 con 0x7f74300b4ed0 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 -- 172.21.15.43:0/1258095937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300b4ed0 msgr2=0x7f74300d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 --2- 172.21.15.43:0/1258095937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300b4ed0 0x7f74300d0d50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7428009dc0 tx=0x7f742800b330 comp rx=0 tx=0).stop 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 -- 172.21.15.43:0/1258095937 shutdown_connections 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 --2- 172.21.15.43:0/1258095937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300b4ed0 0x7f74300d0d50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 -- 172.21.15.43:0/1258095937 >> 172.21.15.43:0/1258095937 conn(0x7f7430072120 msgr2=0x7f743006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 -- 172.21.15.43:0/1258095937 shutdown_connections 2023-06-08T03:48:57.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.081+0000 7f74355d6700 1 -- 172.21.15.43:0/1258095937 wait complete. 2023-06-08T03:48:57.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 Processor -- start 2023-06-08T03:48:57.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 -- start start 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 0x7f743015ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74300b4ed0 0x7f74301f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300ccb00 0x7f74301f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300cb1c0 con 0x7f74300b43f0 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300ca580 con 0x7f74300b4ed0 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.083+0000 7f74355d6700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300ca820 con 0x7f74300ccb00 2023-06-08T03:48:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 0x7f743015ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 0x7f743015ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58026/0 (socket says 172.21.15.43:58026) 2023-06-08T03:48:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 -- 172.21.15.43:0/1199071273 learned_addr learned my addr 172.21.15.43:0/1199071273 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742f7fe700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300ccb00 0x7f74301f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742e7fc700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74300b4ed0 0x7f74301f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 -- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300ccb00 msgr2=0x7f74301f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300ccb00 0x7f74301f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 -- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74300b4ed0 msgr2=0x7f74301f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74300b4ed0 0x7f74301f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 -- 172.21.15.43:0/1199071273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009a70 con 0x7f74300b43f0 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f742effd700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 0x7f743015ec30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f742400c520 tx=0x7f742400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240052d0 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7424005430 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300cab00 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240038c0 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.084+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743015f170 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.085+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743015f360 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.086+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7424003a20 con 0x7f74300b43f0 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.086+0000 7f74177fe700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f741c06ace0 0x7f741c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.086+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7424088b60 con 0x7f74300b43f0 2023-06-08T03:48:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.086+0000 7f742e7fc700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f741c06ace0 0x7f741c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.087+0000 7f742e7fc700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f741c06ace0 0x7f741c06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7420007fd0 tx=0x7f7420007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.091+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74240539b0 con 0x7f74300b43f0 2023-06-08T03:48:57.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.288+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7430073fa0 con 0x7f74300b43f0 2023-06-08T03:48:57.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.289+0000 7f74177fe700 1 -- 172.21.15.43:0/1199071273 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7424017020 con 0x7f74300b43f0 2023-06-08T03:48:57.293 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:48:57.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f741c06ace0 msgr2=0x7f741c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f741c06ace0 0x7f741c06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7420007fd0 tx=0x7f7420007dc0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 msgr2=0x7f743015ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 0x7f743015ec30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f742400c520 tx=0x7f742400c830 comp rx=0 tx=0).stop 2023-06-08T03:48:57.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 shutdown_connections 2023-06-08T03:48:57.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f741c06ace0 0x7f741c06d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74300b43f0 0x7f743015ec30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74300ccb00 0x7f74301f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 --2- 172.21.15.43:0/1199071273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74300b4ed0 0x7f74301f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 >> 172.21.15.43:0/1199071273 conn(0x7f7430072120 msgr2=0x7f74300c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:57.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 shutdown_connections 2023-06-08T03:48:57.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.291+0000 7f74355d6700 1 -- 172.21.15.43:0/1199071273 wait complete. 2023-06-08T03:48:57.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:48:57.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.430+0000 7fda5f11d700 1 Processor -- start 2023-06-08T03:48:57.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.431+0000 7fda5f11d700 1 -- start start 2023-06-08T03:48:57.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.431+0000 7fda5f11d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda58159380 0x7fda580716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.431+0000 7fda5f11d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806f480 con 0x7fda580cd930 2023-06-08T03:48:57.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.431+0000 7fda5f11d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806f760 con 0x7fda580b1dc0 2023-06-08T03:48:57.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.431+0000 7fda5f11d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda580b10d0 con 0x7fda58159380 2023-06-08T03:48:57.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.431+0000 7fda5ceb9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda58159380 0x7fda580716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda5d6ba700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fda580cd930 0x7fda580ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52942/0 (socket says 172.21.15.43:52942) 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda5d6ba700 1 -- 172.21.15.43:0/1402916946 learned_addr learned my addr 172.21.15.43:0/1402916946 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda5ceb9700 1 -- 172.21.15.43:0/1402916946 >> v1:172.21.15.135:6789/0 conn(0x7fda580b1dc0 legacy=0x7fda580cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda5ceb9700 1 -- 172.21.15.43:0/1402916946 >> v1:172.21.15.43:6789/0 conn(0x7fda580cd930 legacy=0x7fda580ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda577fe700 1 -- 172.21.15.43:0/1402916946 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066594166 0 0) 0x7fda5806f480 con 0x7fda580cd930 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda5ceb9700 1 -- 172.21.15.43:0/1402916946 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580b12e0 con 0x7fda58159380 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda5ceb9700 1 --2- 172.21.15.43:0/1402916946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58159380 0x7fda580716c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009840 tx=0x7fda4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d407980cad03c317 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda577fe700 1 -- 172.21.15.43:0/1402916946 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c004230 con 0x7fda58159380 2023-06-08T03:48:57.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda577fe700 1 -- 172.21.15.43:0/1402916946 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c004390 con 0x7fda58159380 2023-06-08T03:48:57.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.432+0000 7fda577fe700 1 -- 172.21.15.43:0/1402916946 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0036a0 con 0x7fda58159380 2023-06-08T03:48:57.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 -- 172.21.15.43:0/1402916946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58159380 msgr2=0x7fda580716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1402916946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58159380 0x7fda580716c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009840 tx=0x7fda4c009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:57.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 -- 172.21.15.43:0/1402916946 shutdown_connections 2023-06-08T03:48:57.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1402916946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58159380 0x7fda580716c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 -- 172.21.15.43:0/1402916946 >> 172.21.15.43:0/1402916946 conn(0x7fda5806aec0 msgr2=0x7fda5806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:57.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 -- 172.21.15.43:0/1402916946 shutdown_connections 2023-06-08T03:48:57.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.433+0000 7fda5f11d700 1 -- 172.21.15.43:0/1402916946 wait complete. 2023-06-08T03:48:57.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.434+0000 7fda5f11d700 1 Processor -- start 2023-06-08T03:48:57.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.434+0000 7fda5f11d700 1 -- start start 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5f11d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580b1dc0 0x7fda580ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5f11d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 0x7fda580c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5f11d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58159380 0x7fda5814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5f11d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580c8ea0 con 0x7fda580cd930 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5f11d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580abc10 con 0x7fda58159380 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5f11d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5814cbb0 con 0x7fda580b1dc0 2023-06-08T03:48:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 0x7fda580c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 0x7fda580c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58040/0 (socket says 172.21.15.43:58040) 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 -- 172.21.15.43:0/1467898471 learned_addr learned my addr 172.21.15.43:0/1467898471 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5d6ba700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58159380 0x7fda5814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5ceb9700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580b1dc0 0x7fda580ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 -- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580b1dc0 msgr2=0x7fda580ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580b1dc0 0x7fda580ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 -- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58159380 msgr2=0x7fda5814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58159380 0x7fda5814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda57fff700 1 -- 172.21.15.43:0/1467898471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c0094a0 con 0x7fda580cd930 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5ceb9700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580b1dc0 0x7fda580ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.435+0000 7fda5d6ba700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58159380 0x7fda5814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.436+0000 7fda57fff700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 0x7fda580c7b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda4400c4d0 tx=0x7fda4400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.436+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44011790 con 0x7fda580cd930 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.436+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda440118f0 con 0x7fda580cd930 2023-06-08T03:48:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.436+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda580c8220 con 0x7fda580cd930 2023-06-08T03:48:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.436+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44011ca0 con 0x7fda580cd930 2023-06-08T03:48:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.436+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda580c87e0 con 0x7fda580cd930 2023-06-08T03:48:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.437+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5806f480 con 0x7fda580cd930 2023-06-08T03:48:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.437+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda4401c460 con 0x7fda580cd930 2023-06-08T03:48:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.437+0000 7fda557fa700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3c06ace0 0x7fda3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.438+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda440894f0 con 0x7fda580cd930 2023-06-08T03:48:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.438+0000 7fda5ceb9700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3c06ace0 0x7fda3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.438+0000 7fda5ceb9700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3c06ace0 0x7fda3c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0090b0 tx=0x7fda4c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.442+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda44054340 con 0x7fda580cd930 2023-06-08T03:48:57.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.638+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda580737f0 con 0x7fda580cd930 2023-06-08T03:48:57.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.639+0000 7fda557fa700 1 -- 172.21.15.43:0/1467898471 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda44057960 con 0x7fda580cd930 2023-06-08T03:48:57.644 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:48:57.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3c06ace0 msgr2=0x7fda3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3c06ace0 0x7fda3c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0090b0 tx=0x7fda4c008030 comp rx=0 tx=0).stop 2023-06-08T03:48:57.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 msgr2=0x7fda580c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 0x7fda580c7b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda4400c4d0 tx=0x7fda4400c890 comp rx=0 tx=0).stop 2023-06-08T03:48:57.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 shutdown_connections 2023-06-08T03:48:57.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3c06ace0 0x7fda3c06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58159380 0x7fda5814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580b1dc0 0x7fda580ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 --2- 172.21.15.43:0/1467898471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cd930 0x7fda580c7b40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 >> 172.21.15.43:0/1467898471 conn(0x7fda5806aec0 msgr2=0x7fda580caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:57.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 shutdown_connections 2023-06-08T03:48:57.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.641+0000 7fda5f11d700 1 -- 172.21.15.43:0/1467898471 wait complete. 2023-06-08T03:48:57.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:48:57.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.780+0000 7f5fb5b01700 1 Processor -- start 2023-06-08T03:48:57.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.780+0000 7f5fb5b01700 1 -- start start 2023-06-08T03:48:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5fb5b01700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fb0069db0 0x7f5fb00c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5fb5b01700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5fb00ccc00 0x7f5fb00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5fb5b01700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00720f0 con 0x7f5fb015a400 2023-06-08T03:48:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5fb5b01700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00ca1e0 con 0x7f5fb0069db0 2023-06-08T03:48:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5fb5b01700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00cb960 con 0x7f5fb00ccc00 2023-06-08T03:48:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fb0069db0 0x7f5fb00c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fb0069db0 0x7f5fb00c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58048/0 (socket says 172.21.15.43:58048) 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 -- 172.21.15.43:0/827117745 learned_addr learned my addr 172.21.15.43:0/827117745 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faffff700 1 --2- 172.21.15.43:0/827117745 >> v2:172.21.15.135:3300/0 conn(0x7f5fb00ccc00 0x7f5fb00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 -- 172.21.15.43:0/827117745 >> v2:172.21.15.135:3300/0 conn(0x7f5fb00ccc00 msgr2=0x7f5fb00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 --2- 172.21.15.43:0/827117745 >> v2:172.21.15.135:3300/0 conn(0x7f5fb00ccc00 0x7f5fb00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 -- 172.21.15.43:0/827117745 >> v1:172.21.15.135:6789/0 conn(0x7f5fb015a400 legacy=0x7f5fb006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:57.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.781+0000 7f5faf7fe700 1 -- 172.21.15.43:0/827117745 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00cbc40 con 0x7f5fb0069db0 2023-06-08T03:48:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5faf7fe700 1 --2- 172.21.15.43:0/827117745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb0069db0 0x7f5fb00c9ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00c2e90 tx=0x7f5f98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fceed94d56414e7c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fae7fc700 1 -- 172.21.15.43:0/827117745 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98004230 con 0x7f5fb0069db0 2023-06-08T03:48:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fae7fc700 1 -- 172.21.15.43:0/827117745 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f98004390 con 0x7f5fb0069db0 2023-06-08T03:48:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fae7fc700 1 -- 172.21.15.43:0/827117745 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980036a0 con 0x7f5fb0069db0 2023-06-08T03:48:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 -- 172.21.15.43:0/827117745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb0069db0 msgr2=0x7f5fb00c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/827117745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb0069db0 0x7f5fb00c9ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00c2e90 tx=0x7f5f98009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 -- 172.21.15.43:0/827117745 shutdown_connections 2023-06-08T03:48:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/827117745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb0069db0 0x7f5fb00c9ca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/827117745 >> v2:172.21.15.135:3300/0 conn(0x7f5fb00ccc00 0x7f5fb00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 -- 172.21.15.43:0/827117745 >> 172.21.15.43:0/827117745 conn(0x7f5fb006aec0 msgr2=0x7f5fb006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 -- 172.21.15.43:0/827117745 shutdown_connections 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.782+0000 7f5fb5b01700 1 -- 172.21.15.43:0/827117745 wait complete. 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.784+0000 7f5fb5b01700 1 Processor -- start 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.784+0000 7f5fb5b01700 1 -- start start 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.784+0000 7f5fb5b01700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0069db0 0x7f5fb0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.784+0000 7f5fb5b01700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fb00ccc00 0x7f5fb01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fb5b01700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 0x7f5fb0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fb5b01700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c7960 con 0x7f5fb015a400 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fb5b01700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c7c40 con 0x7f5fb0069db0 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fb5b01700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c7f20 con 0x7f5fb00ccc00 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 0x7f5fb0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 0x7f5fb0155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58058/0 (socket says 172.21.15.43:58058) 2023-06-08T03:48:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 -- 172.21.15.43:0/1439506403 learned_addr learned my addr 172.21.15.43:0/1439506403 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faf7fe700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0069db0 0x7f5fb0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faeffd700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fb00ccc00 0x7f5fb01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 -- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fb00ccc00 msgr2=0x7f5fb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fb00ccc00 0x7f5fb01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 -- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0069db0 msgr2=0x7f5fb0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0069db0 0x7f5fb0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 -- 172.21.15.43:0/1439506403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009550 con 0x7f5fb015a400 2023-06-08T03:48:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5faffff700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 0x7f5fb0155b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8007e40 tx=0x7f5fa800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800ed30 con 0x7f5fb015a400 2023-06-08T03:48:57.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8014420 con 0x7f5fb015a400 2023-06-08T03:48:57.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80147d0 con 0x7f5fb015a400 2023-06-08T03:48:57.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00c8200 con 0x7f5fb015a400 2023-06-08T03:48:57.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.785+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00c8720 con 0x7f5fb015a400 2023-06-08T03:48:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.786+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00c7aa0 con 0x7f5fb015a400 2023-06-08T03:48:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.787+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fa8014930 con 0x7f5fb015a400 2023-06-08T03:48:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.787+0000 7f5fa7fff700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f5f9006ace0 0x7f5f9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.787+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5fa8089f00 con 0x7f5fb015a400 2023-06-08T03:48:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.787+0000 7f5faf7fe700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f5f9006ace0 0x7f5f9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.788+0000 7f5faf7fe700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f5f9006ace0 0x7f5f9006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009130 tx=0x7f5f98008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.792+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5fb00c7aa0 con 0x7f5fb015a400 2023-06-08T03:48:57.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.985+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fb00c7aa0 con 0x7f5fb015a400 2023-06-08T03:48:57.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.986+0000 7f5fa7fff700 1 -- 172.21.15.43:0/1439506403 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fb00c7aa0 con 0x7f5fb015a400 2023-06-08T03:48:57.990 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:48:57.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f5f9006ace0 msgr2=0x7f5f9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f5f9006ace0 0x7f5f9006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009130 tx=0x7f5f98008030 comp rx=0 tx=0).stop 2023-06-08T03:48:57.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 msgr2=0x7f5fb0155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:57.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 0x7f5fb0155b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8007e40 tx=0x7f5fa800e3c0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 shutdown_connections 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f5f9006ace0 0x7f5f9006d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fb015a400 0x7f5fb0155b00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0069db0 0x7f5fb0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 --2- 172.21.15.43:0/1439506403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fb00ccc00 0x7f5fb01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 >> 172.21.15.43:0/1439506403 conn(0x7f5fb006aec0 msgr2=0x7f5fb00af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:57.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 shutdown_connections 2023-06-08T03:48:57.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:57.988+0000 7f5fb5b01700 1 -- 172.21.15.43:0/1439506403 wait complete. 2023-06-08T03:48:58.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:48:58.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.126+0000 7f437b7ca700 1 Processor -- start 2023-06-08T03:48:58.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f437b7ca700 1 -- start start 2023-06-08T03:48:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f437b7ca700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4374159380 0x7f43740716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f437b7ca700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f43740cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f437b7ca700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437406f480 con 0x7f4374071d50 2023-06-08T03:48:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f437b7ca700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740b10d0 con 0x7f4374159380 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f437b7ca700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740cb590 con 0x7f43740b1dc0 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.127+0000 7f4379566700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4374159380 0x7f43740716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379d67700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4374071d50 0x7f437415cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52970/0 (socket says 172.21.15.43:52970) 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379d67700 1 -- 172.21.15.43:0/343375801 learned_addr learned my addr 172.21.15.43:0/343375801 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4378d65700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f43740cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379566700 1 -- 172.21.15.43:0/343375801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 msgr2=0x7f43740cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379566700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f43740cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379566700 1 -- 172.21.15.43:0/343375801 >> v1:172.21.15.43:6789/0 conn(0x7f4374071d50 legacy=0x7f437415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379566700 1 -- 172.21.15.43:0/343375801 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437406f760 con 0x7f4374159380 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4378d65700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f43740cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4379566700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f43740716c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4368009840 tx=0x7f4368009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ad889a2f114999 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4367fff700 1 -- 172.21.15.43:0/343375801 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368011830 con 0x7f4374159380 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4367fff700 1 -- 172.21.15.43:0/343375801 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368011990 con 0x7f4374159380 2023-06-08T03:48:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.128+0000 7f4367fff700 1 -- 172.21.15.43:0/343375801 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368011d20 con 0x7f4374159380 2023-06-08T03:48:58.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 -- 172.21.15.43:0/343375801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 msgr2=0x7f43740716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f43740716c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4368009840 tx=0x7f4368009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 -- 172.21.15.43:0/343375801 shutdown_connections 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f43740716c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 --2- 172.21.15.43:0/343375801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f43740cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 -- 172.21.15.43:0/343375801 >> 172.21.15.43:0/343375801 conn(0x7f437406aec0 msgr2=0x7f437406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 -- 172.21.15.43:0/343375801 shutdown_connections 2023-06-08T03:48:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.129+0000 7f437b7ca700 1 -- 172.21.15.43:0/343375801 wait complete. 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.130+0000 7f437b7ca700 1 Processor -- start 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.130+0000 7f437b7ca700 1 -- start start 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f437b7ca700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4374071d50 0x7f4374148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f437b7ca700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f4374159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f437b7ca700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f437414cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f437b7ca700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437415b110 con 0x7f4374159380 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f437b7ca700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374149270 con 0x7f4374071d50 2023-06-08T03:48:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f437b7ca700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437415a500 con 0x7f43740b1dc0 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f437414cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f437414cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58072/0 (socket says 172.21.15.43:58072) 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 -- 172.21.15.43:0/932479169 learned_addr learned my addr 172.21.15.43:0/932479169 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379566700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4374071d50 0x7f4374148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4378d65700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f4374159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 -- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 msgr2=0x7f4374159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f4374159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 -- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4374071d50 msgr2=0x7f4374148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4374071d50 0x7f4374148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 -- 172.21.15.43:0/932479169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680094a0 con 0x7f4374159380 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4379d67700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f437414cf00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f436c00cb10 tx=0x7f436c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00ab00 con 0x7f4374159380 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.131+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00ac60 con 0x7f4374159380 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.132+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437415a7e0 con 0x7f4374159380 2023-06-08T03:48:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.132+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c012400 con 0x7f4374159380 2023-06-08T03:48:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.132+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437415ada0 con 0x7f4374159380 2023-06-08T03:48:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.133+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4374073fa0 con 0x7f4374159380 2023-06-08T03:48:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.133+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f436c01b3b0 con 0x7f4374159380 2023-06-08T03:48:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.133+0000 7f4365ffb700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f435806ace0 0x7f435806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.134+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f436c0893b0 con 0x7f4374159380 2023-06-08T03:48:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.134+0000 7f4379566700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f435806ace0 0x7f435806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.134+0000 7f4379566700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f435806ace0 0x7f435806d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f43680090b0 tx=0x7f436801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.138+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f436c054180 con 0x7f4374159380 2023-06-08T03:48:58.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.333+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f43740714a0 con 0x7f4374159380 2023-06-08T03:48:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.334+0000 7f4365ffb700 1 -- 172.21.15.43:0/932479169 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f436c0577a0 con 0x7f4374159380 2023-06-08T03:48:58.338 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:48:58.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f435806ace0 msgr2=0x7f435806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f435806ace0 0x7f435806d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f43680090b0 tx=0x7f436801c040 comp rx=0 tx=0).stop 2023-06-08T03:48:58.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 msgr2=0x7f437414cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f437414cf00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f436c00cb10 tx=0x7f436c00ced0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 shutdown_connections 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f435806ace0 0x7f435806d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4374159380 0x7f437414cf00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4374071d50 0x7f4374148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 --2- 172.21.15.43:0/932479169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43740b1dc0 0x7f4374159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 >> 172.21.15.43:0/932479169 conn(0x7f437406aec0 msgr2=0x7f43740afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:58.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 shutdown_connections 2023-06-08T03:48:58.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.336+0000 7f437b7ca700 1 -- 172.21.15.43:0/932479169 wait complete. 2023-06-08T03:48:58.352 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T03:48:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.473+0000 7fa1b3510700 1 Processor -- start 2023-06-08T03:48:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.473+0000 7fa1b3510700 1 -- start start 2023-06-08T03:48:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b3510700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1ac159260 0x7fa1ac071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b3510700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b3510700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac0ceb10 con 0x7fa1ac0cc020 2023-06-08T03:48:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b3510700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0aeee0 con 0x7fa1ac159260 2023-06-08T03:48:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b3510700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac159630 con 0x7fa1ac0ca5f0 2023-06-08T03:48:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b12ac700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1ac159260 0x7fa1ac071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b0aab700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b12ac700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1ac159260 0x7fa1ac071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:39692/0 (socket says 172.21.15.43:39692) 2023-06-08T03:48:58.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b0aab700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51532/0 (socket says 172.21.15.43:51532) 2023-06-08T03:48:58.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.474+0000 7fa1b12ac700 1 -- 172.21.15.43:0/1154816562 learned_addr learned my addr 172.21.15.43:0/1154816562 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:58.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1154816562 >> v2:172.21.15.135:3300/0 conn(0x7fa1ac159260 msgr2=0x7fa1ac071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:58.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1b0aab700 1 --2- 172.21.15.43:0/1154816562 >> v2:172.21.15.135:3300/0 conn(0x7fa1ac159260 0x7fa1ac071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1154816562 >> v1:172.21.15.135:6789/0 conn(0x7fa1ac0cc020 legacy=0x7fa1ac0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1154816562 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0ce680 con 0x7fa1ac0ca5f0 2023-06-08T03:48:58.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1b0aab700 1 --2- 172.21.15.43:0/1154816562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0716c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800bae0 tx=0x7fa1a800bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741a507a86cbb23f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1a3fff700 1 -- 172.21.15.43:0/1154816562 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800dc70 con 0x7fa1ac0ca5f0 2023-06-08T03:48:58.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1a3fff700 1 -- 172.21.15.43:0/1154816562 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a800ddd0 con 0x7fa1ac0ca5f0 2023-06-08T03:48:58.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.475+0000 7fa1a3fff700 1 -- 172.21.15.43:0/1154816562 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8010690 con 0x7fa1ac0ca5f0 2023-06-08T03:48:58.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 -- 172.21.15.43:0/1154816562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 msgr2=0x7fa1ac0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1154816562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0716c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800bae0 tx=0x7fa1a800bdf0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 -- 172.21.15.43:0/1154816562 shutdown_connections 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1154816562 >> v2:172.21.15.135:3300/0 conn(0x7fa1ac159260 0x7fa1ac071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1154816562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0716c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 -- 172.21.15.43:0/1154816562 >> 172.21.15.43:0/1154816562 conn(0x7fa1ac06aec0 msgr2=0x7fa1ac06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 -- 172.21.15.43:0/1154816562 shutdown_connections 2023-06-08T03:48:58.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.476+0000 7fa1b3510700 1 -- 172.21.15.43:0/1154816562 wait complete. 2023-06-08T03:48:58.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.477+0000 7fa1b3510700 1 Processor -- start 2023-06-08T03:48:58.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.477+0000 7fa1b3510700 1 -- start start 2023-06-08T03:48:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b3510700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b3510700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 0x7fa1ac0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b3510700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ac159260 0x7fa1ac14d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b3510700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0c7030 con 0x7fa1ac0cc020 2023-06-08T03:48:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b3510700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0c95b0 con 0x7fa1ac159260 2023-06-08T03:48:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b3510700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0c6720 con 0x7fa1ac0ca5f0 2023-06-08T03:48:58.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 0x7fa1ac0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 0x7fa1ac0ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58082/0 (socket says 172.21.15.43:58082) 2023-06-08T03:48:58.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1777463756 learned_addr learned my addr 172.21.15.43:0/1777463756 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:58.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b1aad700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ac159260 0x7fa1ac14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b12ac700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 msgr2=0x7fa1ac0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ac159260 msgr2=0x7fa1ac14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ac159260 0x7fa1ac14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.478+0000 7fa1b0aab700 1 -- 172.21.15.43:0/1777463756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a800b740 con 0x7fa1ac0cc020 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.479+0000 7fa1b0aab700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 0x7fa1ac0ad450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800b2c0 tx=0x7fa1a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.479+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8003cf0 con 0x7fa1ac0cc020 2023-06-08T03:48:58.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.479+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a8003e50 con 0x7fa1ac0cc020 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.479+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80106b0 con 0x7fa1ac0cc020 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.479+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac0ad990 con 0x7fa1ac0cc020 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.479+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac0adc10 con 0x7fa1ac0cc020 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.480+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac0c7170 con 0x7fa1ac0cc020 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.480+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1a8023440 con 0x7fa1ac0cc020 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.481+0000 7fa1a1ffb700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa19006ace0 0x7fa19006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.481+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa1a808b200 con 0x7fa1ac0cc020 2023-06-08T03:48:58.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.481+0000 7fa1b12ac700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa19006ace0 0x7fa19006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.482+0000 7fa1b12ac700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa19006ace0 0x7fa19006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009b60 tx=0x7fa19c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.485+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa1ac0c7170 con 0x7fa1ac0cc020 2023-06-08T03:48:58.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.701+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1ac0c7170 con 0x7fa1ac0cc020 2023-06-08T03:48:58.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.702+0000 7fa1a1ffb700 1 -- 172.21.15.43:0/1777463756 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa1ac0c7170 con 0x7fa1ac0cc020 2023-06-08T03:48:58.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.703+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa19006ace0 msgr2=0x7fa19006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.703+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa19006ace0 0x7fa19006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009b60 tx=0x7fa19c008040 comp rx=0 tx=0).stop 2023-06-08T03:48:58.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.703+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 msgr2=0x7fa1ac0ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.703+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 0x7fa1ac0ad450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800b2c0 tx=0x7fa1a8004750 comp rx=0 tx=0).stop 2023-06-08T03:48:58.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 shutdown_connections 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa19006ace0 0x7fa19006d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ac159260 0x7fa1ac14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1ac0ca5f0 0x7fa1ac0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 --2- 172.21.15.43:0/1777463756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac0cc020 0x7fa1ac0ad450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 >> 172.21.15.43:0/1777463756 conn(0x7fa1ac06aec0 msgr2=0x7fa1ac0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 shutdown_connections 2023-06-08T03:48:58.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.704+0000 7fa1b3510700 1 -- 172.21.15.43:0/1777463756 wait complete. 2023-06-08T03:48:58.710 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T03:48:58.719 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:48:58.720 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:48:58.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:48:58.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.897+0000 7ff2a40d0700 1 Processor -- start 2023-06-08T03:48:58.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.897+0000 7ff2a40d0700 1 -- start start 2023-06-08T03:48:58.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a40d0700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff29c0afa30 0x7ff29c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a40d0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff29c0cd980 0x7ff29c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a40d0700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c0b01a0 con 0x7ff29c0b0c40 2023-06-08T03:48:58.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a40d0700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0b06f0 con 0x7ff29c0afa30 2023-06-08T03:48:58.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a40d0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0b0900 con 0x7ff29c0cd980 2023-06-08T03:48:58.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff29c0afa30 0x7ff29c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff29c0afa30 0x7ff29c0b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58090/0 (socket says 172.21.15.43:58090) 2023-06-08T03:48:58.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 -- 172.21.15.43:0/1821852512 learned_addr learned my addr 172.21.15.43:0/1821852512 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:58.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a266d700 1 --2- 172.21.15.43:0/1821852512 >> v2:172.21.15.135:3300/0 conn(0x7ff29c0cd980 0x7ff29c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 -- 172.21.15.43:0/1821852512 >> v2:172.21.15.135:3300/0 conn(0x7ff29c0cd980 msgr2=0x7ff29c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:58.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 --2- 172.21.15.43:0/1821852512 >> v2:172.21.15.135:3300/0 conn(0x7ff29c0cd980 0x7ff29c0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 -- 172.21.15.43:0/1821852512 >> v1:172.21.15.135:6789/0 conn(0x7ff29c0b0c40 legacy=0x7ff29c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:58.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a1e6c700 1 -- 172.21.15.43:0/1821852512 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0ca7a0 con 0x7ff29c0afa30 2023-06-08T03:48:58.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.898+0000 7ff2a266d700 1 --2- 172.21.15.43:0/1821852512 >> v2:172.21.15.135:3300/0 conn(0x7ff29c0cd980 0x7ff29c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:58.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a1e6c700 1 --2- 172.21.15.43:0/1821852512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0afa30 0x7ff29c0b24f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0c9c80 tx=0x7ff28c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4d5468b68eeeab server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a0e6a700 1 -- 172.21.15.43:0/1821852512 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c005e30 con 0x7ff29c0afa30 2023-06-08T03:48:58.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a0e6a700 1 -- 172.21.15.43:0/1821852512 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c004030 con 0x7ff29c0afa30 2023-06-08T03:48:58.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a0e6a700 1 -- 172.21.15.43:0/1821852512 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0043e0 con 0x7ff29c0afa30 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 -- 172.21.15.43:0/1821852512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0afa30 msgr2=0x7ff29c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/1821852512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0afa30 0x7ff29c0b24f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0c9c80 tx=0x7ff28c009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 -- 172.21.15.43:0/1821852512 shutdown_connections 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/1821852512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0afa30 0x7ff29c0b24f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/1821852512 >> v2:172.21.15.135:3300/0 conn(0x7ff29c0cd980 0x7ff29c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 -- 172.21.15.43:0/1821852512 >> 172.21.15.43:0/1821852512 conn(0x7ff29c06b7e0 msgr2=0x7ff29c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:58.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.899+0000 7ff2a40d0700 1 -- 172.21.15.43:0/1821852512 shutdown_connections 2023-06-08T03:48:58.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.900+0000 7ff2a40d0700 1 -- 172.21.15.43:0/1821852512 wait complete. 2023-06-08T03:48:58.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 Processor -- start 2023-06-08T03:48:58.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 -- start start 2023-06-08T03:48:58.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff29c0afa30 0x7ff29c0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff29c0b0c40 0x7ff29c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 0x7ff29c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15a020 con 0x7ff29c0cd980 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0c8070 con 0x7ff29c0b0c40 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.901+0000 7ff2a40d0700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0c8350 con 0x7ff29c0afa30 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 0x7ff29c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 0x7ff29c15aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58100/0 (socket says 172.21.15.43:58100) 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 -- 172.21.15.43:0/4268146958 learned_addr learned my addr 172.21.15.43:0/4268146958 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:58.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a1e6c700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff29c0afa30 0x7ff29c0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a166b700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff29c0b0c40 0x7ff29c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 -- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff29c0afa30 msgr2=0x7ff29c0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff29c0afa30 0x7ff29c0c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 -- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff29c0b0c40 msgr2=0x7ff29c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff29c0b0c40 0x7ff29c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 -- 172.21.15.43:0/4268146958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c009500 con 0x7ff29c0cd980 2023-06-08T03:48:58.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a266d700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 0x7ff29c15aee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff294007ef0 tx=0x7ff29400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400dd80 con 0x7ff29c0cd980 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400f040 con 0x7ff29c0cd980 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294003c60 con 0x7ff29c0cd980 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c159960 con 0x7ff29c0cd980 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.902+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c0c7d30 con 0x7ff29c0cd980 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.903+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c1597c0 con 0x7ff29c0cd980 2023-06-08T03:48:58.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.904+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff294004030 con 0x7ff29c0cd980 2023-06-08T03:48:58.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.904+0000 7ff2927fc700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff28006ace0 0x7ff28006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:58.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.904+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2940897f0 con 0x7ff29c0cd980 2023-06-08T03:48:58.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.905+0000 7ff2a1e6c700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff28006ace0 0x7ff28006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:58.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.905+0000 7ff2a1e6c700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff28006ace0 0x7ff28006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0c9c80 tx=0x7ff28c008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:58.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:58.909+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff29c1597c0 con 0x7ff29c0cd980 2023-06-08T03:48:59.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.110+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff29c15a160 con 0x7ff29c0cd980 2023-06-08T03:48:59.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.111+0000 7ff2927fc700 1 -- 172.21.15.43:0/4268146958 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7ff29c15a160 con 0x7ff29c0cd980 2023-06-08T03:48:59.115 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:48:59.116 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:48:59.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff28006ace0 msgr2=0x7ff28006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff28006ace0 0x7ff28006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0c9c80 tx=0x7ff28c008070 comp rx=0 tx=0).stop 2023-06-08T03:48:59.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 msgr2=0x7ff29c15aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 0x7ff29c15aee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff294007ef0 tx=0x7ff29400d3b0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 shutdown_connections 2023-06-08T03:48:59.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff28006ace0 0x7ff28006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0cd980 0x7ff29c15aee0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff29c0afa30 0x7ff29c0c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 --2- 172.21.15.43:0/4268146958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff29c0b0c40 0x7ff29c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 >> 172.21.15.43:0/4268146958 conn(0x7ff29c06b7e0 msgr2=0x7ff29c06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 shutdown_connections 2023-06-08T03:48:59.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.113+0000 7ff2a40d0700 1 -- 172.21.15.43:0/4268146958 wait complete. 2023-06-08T03:48:59.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:48:59.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:48:59.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.252+0000 7fdebf044700 1 Processor -- start 2023-06-08T03:48:59.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.252+0000 7fdebf044700 1 -- start start 2023-06-08T03:48:59.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebf044700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdeb80b60a0 0x7fdeb80cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebf044700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeb80cf5b0 0x7fdeb815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebf044700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb80cda20 con 0x7fdeb815e170 2023-06-08T03:48:59.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebf044700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb80b6470 con 0x7fdeb80b60a0 2023-06-08T03:48:59.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebf044700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb815a520 con 0x7fdeb80cf5b0 2023-06-08T03:48:59.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebcde0700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdeb80b60a0 0x7fdeb80cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.253+0000 7fdebcde0700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdeb80b60a0 0x7fdeb80cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58104/0 (socket says 172.21.15.43:58104) 2023-06-08T03:48:59.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdebcde0700 1 -- 172.21.15.43:0/1697603628 learned_addr learned my addr 172.21.15.43:0/1697603628 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:59.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdeb7fff700 1 --2- 172.21.15.43:0/1697603628 >> v2:172.21.15.135:3300/0 conn(0x7fdeb80cf5b0 0x7fdeb815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdebcde0700 1 -- 172.21.15.43:0/1697603628 >> v2:172.21.15.135:3300/0 conn(0x7fdeb80cf5b0 msgr2=0x7fdeb815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:59.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdebcde0700 1 --2- 172.21.15.43:0/1697603628 >> v2:172.21.15.135:3300/0 conn(0x7fdeb80cf5b0 0x7fdeb815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdebcde0700 1 -- 172.21.15.43:0/1697603628 >> v1:172.21.15.135:6789/0 conn(0x7fdeb815e170 legacy=0x7fdeb80ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdebcde0700 1 -- 172.21.15.43:0/1697603628 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb815ea40 con 0x7fdeb80b60a0 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdebcde0700 1 --2- 172.21.15.43:0/1697603628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb80b60a0 0x7fdeb80cad90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80cbd90 tx=0x7fdeac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6059177570faf7a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdeb77fe700 1 -- 172.21.15.43:0/1697603628 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac011830 con 0x7fdeb80b60a0 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdeb77fe700 1 -- 172.21.15.43:0/1697603628 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac011990 con 0x7fdeb80b60a0 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.254+0000 7fdeb77fe700 1 -- 172.21.15.43:0/1697603628 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac011d20 con 0x7fdeb80b60a0 2023-06-08T03:48:59.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 -- 172.21.15.43:0/1697603628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb80b60a0 msgr2=0x7fdeb80cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 --2- 172.21.15.43:0/1697603628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb80b60a0 0x7fdeb80cad90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80cbd90 tx=0x7fdeac009bd0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 -- 172.21.15.43:0/1697603628 shutdown_connections 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 --2- 172.21.15.43:0/1697603628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb80b60a0 0x7fdeb80cad90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 --2- 172.21.15.43:0/1697603628 >> v2:172.21.15.135:3300/0 conn(0x7fdeb80cf5b0 0x7fdeb815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 -- 172.21.15.43:0/1697603628 >> 172.21.15.43:0/1697603628 conn(0x7fdeb8069db0 msgr2=0x7fdeb806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 -- 172.21.15.43:0/1697603628 shutdown_connections 2023-06-08T03:48:59.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.255+0000 7fdebf044700 1 -- 172.21.15.43:0/1697603628 wait complete. 2023-06-08T03:48:59.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.256+0000 7fdebf044700 1 Processor -- start 2023-06-08T03:48:59.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.256+0000 7fdebf044700 1 -- start start 2023-06-08T03:48:59.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebf044700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeb80b60a0 0x7fdeb80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebf044700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb80cf5b0 0x7fdeb80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebf044700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 0x7fdeb814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebf044700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80c8b90 con 0x7fdeb815e170 2023-06-08T03:48:59.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebf044700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8158fc0 con 0x7fdeb80cf5b0 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebf044700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80c7f10 con 0x7fdeb80b60a0 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 0x7fdeb814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 0x7fdeb814eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58114/0 (socket says 172.21.15.43:58114) 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 -- 172.21.15.43:0/1633731259 learned_addr learned my addr 172.21.15.43:0/1633731259 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebcde0700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeb80b60a0 0x7fdeb80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdeb7fff700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb80cf5b0 0x7fdeb80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 -- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeb80b60a0 msgr2=0x7fdeb80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeb80b60a0 0x7fdeb80caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 -- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb80cf5b0 msgr2=0x7fdeb80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb80cf5b0 0x7fdeb80c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdebd5e1700 1 -- 172.21.15.43:0/1633731259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009550 con 0x7fdeb815e170 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.257+0000 7fdeb7fff700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb80cf5b0 0x7fdeb80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.258+0000 7fdebd5e1700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 0x7fdeb814eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000cc50 tx=0x7fdeb000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.258+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0003c00 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.258+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb0003d60 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.258+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb80c81f0 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.258+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000ab60 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.258+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb80c87b0 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.259+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb80c8cd0 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.259+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdeb000acc0 con 0x7fdeb815e170 2023-06-08T03:48:59.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.260+0000 7fdeb57fa700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fde9c06ace0 0x7fde9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.260+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdeb0089850 con 0x7fdeb815e170 2023-06-08T03:48:59.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.260+0000 7fdebcde0700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fde9c06ace0 0x7fde9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.260+0000 7fdebcde0700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fde9c06ace0 0x7fde9c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdeac014040 tx=0x7fdeac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.264+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdeb80c8cd0 con 0x7fdeb815e170 2023-06-08T03:48:59.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.463+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdeb80c8cd0 con 0x7fdeb815e170 2023-06-08T03:48:59.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.464+0000 7fdeb57fa700 1 -- 172.21.15.43:0/1633731259 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdeb80c8cd0 con 0x7fdeb815e170 2023-06-08T03:48:59.468 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:48:59.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.465+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fde9c06ace0 msgr2=0x7fde9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.465+0000 7fdebf044700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fde9c06ace0 0x7fde9c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdeac014040 tx=0x7fdeac008030 comp rx=0 tx=0).stop 2023-06-08T03:48:59.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 msgr2=0x7fdeb814eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 0x7fdeb814eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000cc50 tx=0x7fdeb000cf60 comp rx=0 tx=0).stop 2023-06-08T03:48:59.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 shutdown_connections 2023-06-08T03:48:59.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fde9c06ace0 0x7fde9c06d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdeb815e170 0x7fdeb814eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeb80b60a0 0x7fdeb80caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 --2- 172.21.15.43:0/1633731259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb80cf5b0 0x7fdeb80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 >> 172.21.15.43:0/1633731259 conn(0x7fdeb8069db0 msgr2=0x7fdeb80ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:59.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 shutdown_connections 2023-06-08T03:48:59.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.466+0000 7fdebf044700 1 -- 172.21.15.43:0/1633731259 wait complete. 2023-06-08T03:48:59.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:48:59.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.604+0000 7fe5ebbf5700 1 Processor -- start 2023-06-08T03:48:59.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.604+0000 7fe5ebbf5700 1 -- start start 2023-06-08T03:48:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5ebbf5700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe5e415cf00 0x7fe5e406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5ebbf5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e406d9b0 0x7fe5e406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5ebbf5700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e406e350 con 0x7fe5e415d2d0 2023-06-08T03:48:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5ebbf5700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e406c4c0 con 0x7fe5e415cf00 2023-06-08T03:48:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5ebbf5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40cd110 con 0x7fe5e406d9b0 2023-06-08T03:48:59.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5e9991700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe5e415cf00 0x7fe5e406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5e9190700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe5e415d2d0 0x7fe5e40cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53022/0 (socket says 172.21.15.43:53022) 2023-06-08T03:48:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.605+0000 7fe5e9190700 1 -- 172.21.15.43:0/65044359 learned_addr learned my addr 172.21.15.43:0/65044359 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5ea192700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e406d9b0 0x7fe5e406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e9991700 1 -- 172.21.15.43:0/65044359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e406d9b0 msgr2=0x7fe5e406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e9991700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e406d9b0 0x7fe5e406de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e9991700 1 -- 172.21.15.43:0/65044359 >> v1:172.21.15.43:6789/0 conn(0x7fe5e415d2d0 legacy=0x7fe5e40cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e9991700 1 -- 172.21.15.43:0/65044359 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40cd370 con 0x7fe5e415cf00 2023-06-08T03:48:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e898f700 1 -- 172.21.15.43:0/65044359 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80671132 0 0) 0x7fe5e406e350 con 0x7fe5e415d2d0 2023-06-08T03:48:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5ea192700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e406d9b0 0x7fe5e406de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e9991700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e415cf00 0x7fe5e406d1f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ed03f29789e84a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e898f700 1 -- 172.21.15.43:0/65044359 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011830 con 0x7fe5e415cf00 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e898f700 1 -- 172.21.15.43:0/65044359 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4011990 con 0x7fe5e415cf00 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5e898f700 1 -- 172.21.15.43:0/65044359 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011d20 con 0x7fe5e415cf00 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/65044359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e415cf00 msgr2=0x7fe5e406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.606+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e415cf00 0x7fe5e406d1f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).stop 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.607+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/65044359 shutdown_connections 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.607+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e406d9b0 0x7fe5e406de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.607+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/65044359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e415cf00 0x7fe5e406d1f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.607+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/65044359 >> 172.21.15.43:0/65044359 conn(0x7fe5e40cee30 msgr2=0x7fe5e40cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:59.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.607+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/65044359 shutdown_connections 2023-06-08T03:48:59.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.607+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/65044359 wait complete. 2023-06-08T03:48:59.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.608+0000 7fe5ebbf5700 1 Processor -- start 2023-06-08T03:48:59.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.608+0000 7fe5ebbf5700 1 -- start start 2023-06-08T03:48:59.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 0x7fe5e41f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e415cf00 0x7fe5e40c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e415d2d0 0x7fe5e4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c6440 con 0x7fe5e406d9b0 2023-06-08T03:48:59.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c66f0 con 0x7fe5e415d2d0 2023-06-08T03:48:59.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c69d0 con 0x7fe5e415cf00 2023-06-08T03:48:59.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 0x7fe5e41f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 0x7fe5e41f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58124/0 (socket says 172.21.15.43:58124) 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 -- 172.21.15.43:0/2851759006 learned_addr learned my addr 172.21.15.43:0/2851759006 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9190700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e415cf00 0x7fe5e40c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ea192700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e415d2d0 0x7fe5e4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 -- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e415cf00 msgr2=0x7fe5e40c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e415cf00 0x7fe5e40c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 -- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e415d2d0 msgr2=0x7fe5e4159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e415d2d0 0x7fe5e4159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 -- 172.21.15.43:0/2851759006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094a0 con 0x7fe5e406d9b0 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ea192700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e415d2d0 0x7fe5e4159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5e9991700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 0x7fe5e41f2fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40090b0 tx=0x7fe5d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40038a0 con 0x7fe5e406d9b0 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d401f070 con 0x7fe5e406d9b0 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e40c6cb0 con 0x7fe5e406d9b0 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4003c20 con 0x7fe5e406d9b0 2023-06-08T03:48:59.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.609+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e4159780 con 0x7fe5e406d9b0 2023-06-08T03:48:59.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.610+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e41e2690 con 0x7fe5e406d9b0 2023-06-08T03:48:59.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.611+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5d401a430 con 0x7fe5e406d9b0 2023-06-08T03:48:59.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.611+0000 7fe5da7fc700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe5c806ace0 0x7fe5c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.611+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5d4021070 con 0x7fe5e406d9b0 2023-06-08T03:48:59.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.611+0000 7fe5e9190700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe5c806ace0 0x7fe5c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.612+0000 7fe5e9190700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe5c806ace0 0x7fe5c806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40990c0 tx=0x7fe5e0007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.616+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5d40bd310 con 0x7fe5e406d9b0 2023-06-08T03:48:59.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.813+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5e4073fa0 con 0x7fe5e406d9b0 2023-06-08T03:48:59.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.814+0000 7fe5da7fc700 1 -- 172.21.15.43:0/2851759006 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5d4055fb0 con 0x7fe5e406d9b0 2023-06-08T03:48:59.818 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:48:59.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe5c806ace0 msgr2=0x7fe5c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe5c806ace0 0x7fe5c806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40990c0 tx=0x7fe5e0007c90 comp rx=0 tx=0).stop 2023-06-08T03:48:59.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 msgr2=0x7fe5e41f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 0x7fe5e41f2fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40090b0 tx=0x7fe5d4004750 comp rx=0 tx=0).stop 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 shutdown_connections 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe5c806ace0 0x7fe5c806d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e406d9b0 0x7fe5e41f2fd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e415d2d0 0x7fe5e4159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 --2- 172.21.15.43:0/2851759006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e415cf00 0x7fe5e40c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 >> 172.21.15.43:0/2851759006 conn(0x7fe5e40cee30 msgr2=0x7fe5e40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 shutdown_connections 2023-06-08T03:48:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.816+0000 7fe5ebbf5700 1 -- 172.21.15.43:0/2851759006 wait complete. 2023-06-08T03:48:59.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:48:59.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59c2897700 1 Processor -- start 2023-06-08T03:48:59.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59c2897700 1 -- start start 2023-06-08T03:48:59.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59c2897700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc0ae2e0 0x7f59bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59c2897700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc15c5d0 con 0x7f59bc06b0a0 2023-06-08T03:48:59.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59c2897700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0cdd70 con 0x7f59bc06d2c0 2023-06-08T03:48:59.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59c2897700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc160380 con 0x7f59bc0ae2e0 2023-06-08T03:48:59.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59bbfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f59bc06b0a0 0x7f59bc15fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53036/0 (socket says 172.21.15.43:53036) 2023-06-08T03:48:59.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.955+0000 7f59bbfff700 1 -- 172.21.15.43:0/3143198036 learned_addr learned my addr 172.21.15.43:0/3143198036 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:48:59.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59bb7fe700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc0ae2e0 0x7f59bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323310612 0 0) 0x7f59ac001110 con 0x7f59bc06b0a0 2023-06-08T03:48:59.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a40035b0 con 0x7f59bc06b0a0 2023-06-08T03:48:59.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071663431 0 0) 0x7f59bc0cdd70 con 0x7f59bc06d2c0 2023-06-08T03:48:59.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac001110 con 0x7f59bc06d2c0 2023-06-08T03:48:59.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3957823943 0 0) 0x7f59a40035b0 con 0x7f59bc06b0a0 2023-06-08T03:48:59.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc0ae2e0 msgr2=0x7f59bc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:59.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc0ae2e0 0x7f59bc069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 >> v1:172.21.15.135:6789/0 conn(0x7f59bc06d2c0 legacy=0x7f59bc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc160b30 con 0x7f59bc06b0a0 2023-06-08T03:48:59.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f59ac001800 con 0x7f59bc06b0a0 2023-06-08T03:48:59.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 >> v1:172.21.15.43:6789/0 conn(0x7f59bc06b0a0 legacy=0x7f59bc15fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a4003bc0 0x7f59a4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59a4004850 0x7f59a4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a400bfa0 con 0x7f59a4005200 2023-06-08T03:48:59.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a400c110 con 0x7f59a4003bc0 2023-06-08T03:48:59.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a400c2d0 con 0x7f59a4004850 2023-06-08T03:48:59.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59bb7fe700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc0ae2e0 0x7f59bc069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:48:59.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59bbfff700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a4003bc0 0x7f59a4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.956+0000 7f59c0e34700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59bb7fe700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59a4004850 0x7f59a4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 -- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59a4004850 msgr2=0x7f59a4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:59.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59a4004850 0x7f59a4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 -- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a4003bc0 msgr2=0x7f59a4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:48:59.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59a4003bc0 0x7f59a4003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 -- 172.21.15.43:0/3143198036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40035b0 con 0x7f59a4005200 2023-06-08T03:48:59.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59a400ba10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c320 tx=0x7f59a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0d83de726669f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4001f20 con 0x7f59a4005200 2023-06-08T03:48:59.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4003a00 con 0x7f59a4005200 2023-06-08T03:48:59.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59baffd700 1 -- 172.21.15.43:0/3143198036 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400cea0 con 0x7f59a4005200 2023-06-08T03:48:59.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c2897700 1 -- 172.21.15.43:0/3143198036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 msgr2=0x7f59a400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c2897700 1 --2- 172.21.15.43:0/3143198036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59a400ba10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c320 tx=0x7f59a4005880 comp rx=0 tx=0).stop 2023-06-08T03:48:59.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c0e34700 1 -- 172.21.15.43:0/3143198036 reap_dead start 2023-06-08T03:48:59.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c2897700 1 -- 172.21.15.43:0/3143198036 shutdown_connections 2023-06-08T03:48:59.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c2897700 1 -- 172.21.15.43:0/3143198036 >> 172.21.15.43:0/3143198036 conn(0x7f59bc0cee30 msgr2=0x7f59bc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:48:59.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.957+0000 7f59c2897700 1 -- 172.21.15.43:0/3143198036 shutdown_connections 2023-06-08T03:48:59.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.958+0000 7f59c2897700 1 -- 172.21.15.43:0/3143198036 wait complete. 2023-06-08T03:48:59.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.959+0000 7f59c2897700 1 Processor -- start 2023-06-08T03:48:59.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.959+0000 7f59c2897700 1 -- start start 2023-06-08T03:48:59.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59bc0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc0ae860 0x7f59bc15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc153a80 0x7f59bc09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc154320 con 0x7f59a4005200 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15e9d0 con 0x7f59bc0ae860 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15ec00 con 0x7f59bc153a80 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59bc0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59bc0b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58144/0 (socket says 172.21.15.43:58144) 2023-06-08T03:48:59.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 -- 172.21.15.43:0/1438240820 learned_addr learned my addr 172.21.15.43:0/1438240820 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bb7fe700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc0ae860 0x7f59bc15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c0e34700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc153a80 0x7f59bc09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 -- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc153a80 msgr2=0x7f59bc09d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc153a80 0x7f59bc09d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 -- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc0ae860 msgr2=0x7f59bc15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc0ae860 0x7f59bc15ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:48:59.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 -- 172.21.15.43:0/1438240820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc15eee0 con 0x7f59a4005200 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c0e34700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc153a80 0x7f59bc09d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59bbfff700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59bc0b4750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59ac007380 tx=0x7f59ac007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00f870 con 0x7f59a4005200 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00f9d0 con 0x7f59a4005200 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc15f1c0 con 0x7f59a4005200 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.960+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00fd80 con 0x7f59a4005200 2023-06-08T03:48:59.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.961+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc15f780 con 0x7f59a4005200 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.961+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc073fa0 con 0x7f59a4005200 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.962+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59ac01d460 con 0x7f59a4005200 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.962+0000 7f59b8ff9700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.963+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f59ac089690 con 0x7f59a4005200 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.963+0000 7f59bb7fe700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.963+0000 7f59bb7fe700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59a806ace0 0x7f59a806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59bc1544d0 tx=0x7f59b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:48:59.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:48:59.967+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59ac054590 con 0x7f59a4005200 2023-06-08T03:49:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.165+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59bc15c5d0 con 0x7f59a4005200 2023-06-08T03:49:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.165+0000 7f59b8ff9700 1 -- 172.21.15.43:0/1438240820 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59bc15c5d0 con 0x7f59a4005200 2023-06-08T03:49:00.170 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:00.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59a806ace0 msgr2=0x7f59a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59a806ace0 0x7f59a806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59bc1544d0 tx=0x7f59b0008040 comp rx=0 tx=0).stop 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 msgr2=0x7f59bc0b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59bc0b4750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59ac007380 tx=0x7f59ac007740 comp rx=0 tx=0).stop 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 shutdown_connections 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59a4005200 0x7f59bc0b4750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59bc153a80 0x7f59bc09d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 --2- 172.21.15.43:0/1438240820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59bc0ae860 0x7f59bc15ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 >> 172.21.15.43:0/1438240820 conn(0x7f59bc0cee30 msgr2=0x7f59bc09e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 shutdown_connections 2023-06-08T03:49:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.167+0000 7f59c2897700 1 -- 172.21.15.43:0/1438240820 wait complete. 2023-06-08T03:49:00.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:00.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.305+0000 7f256f2f6700 1 Processor -- start 2023-06-08T03:49:00.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256f2f6700 1 -- start start 2023-06-08T03:49:00.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256f2f6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25680b1dc0 0x7f25680716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256f2f6700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256806f480 con 0x7f25680cd930 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256f2f6700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256806f760 con 0x7f2568159380 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256f2f6700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680b10d0 con 0x7f25680b1dc0 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256c891700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f25680cd930 0x7f25680ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53058/0 (socket says 172.21.15.43:53058) 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.306+0000 7f256c891700 1 -- 172.21.15.43:0/1393090750 learned_addr learned my addr 172.21.15.43:0/1393090750 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f256d893700 1 --2- 172.21.15.43:0/1393090750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25680b1dc0 0x7f25680716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f255ffff700 1 -- 172.21.15.43:0/1393090750 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261634143 0 0) 0x7f256806f480 con 0x7f25680cd930 2023-06-08T03:49:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f255ffff700 1 -- 172.21.15.43:0/1393090750 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25540035b0 con 0x7f25680cd930 2023-06-08T03:49:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f256d893700 1 -- 172.21.15.43:0/1393090750 >> v1:172.21.15.135:6789/0 conn(0x7f2568159380 legacy=0x7f25680cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f255ffff700 1 -- 172.21.15.43:0/1393090750 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470573048 0 0) 0x7f256806f760 con 0x7f2568159380 2023-06-08T03:49:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f256d893700 1 -- 172.21.15.43:0/1393090750 >> v1:172.21.15.43:6789/0 conn(0x7f25680cd930 legacy=0x7f25680ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f256d893700 1 -- 172.21.15.43:0/1393090750 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680b12e0 con 0x7f25680b1dc0 2023-06-08T03:49:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f256d893700 1 --2- 172.21.15.43:0/1393090750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25680b1dc0 0x7f25680716c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2560009dc0 tx=0x7f256000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd26f66f1d6119f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:00.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f255ffff700 1 -- 172.21.15.43:0/1393090750 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e070 con 0x7f25680b1dc0 2023-06-08T03:49:00.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f255ffff700 1 -- 172.21.15.43:0/1393090750 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000bb20 con 0x7f25680b1dc0 2023-06-08T03:49:00.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.307+0000 7f255ffff700 1 -- 172.21.15.43:0/1393090750 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000bed0 con 0x7f25680b1dc0 2023-06-08T03:49:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 -- 172.21.15.43:0/1393090750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25680b1dc0 msgr2=0x7f25680716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 --2- 172.21.15.43:0/1393090750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25680b1dc0 0x7f25680716c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2560009dc0 tx=0x7f256000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 -- 172.21.15.43:0/1393090750 shutdown_connections 2023-06-08T03:49:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 --2- 172.21.15.43:0/1393090750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25680b1dc0 0x7f25680716c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 -- 172.21.15.43:0/1393090750 >> 172.21.15.43:0/1393090750 conn(0x7f256806aec0 msgr2=0x7f256806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:00.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 -- 172.21.15.43:0/1393090750 shutdown_connections 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.308+0000 7f256f2f6700 1 -- 172.21.15.43:0/1393090750 wait complete. 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.310+0000 7f256f2f6700 1 Processor -- start 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.310+0000 7f256f2f6700 1 -- start start 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.310+0000 7f256f2f6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 0x7f256814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256f2f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25680cd930 0x7f25680b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256f2f6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2568159380 0x7f25680ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256f2f6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680c40e0 con 0x7f25680b1dc0 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256f2f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680c34d0 con 0x7f25680cd930 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256f2f6700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680c37b0 con 0x7f2568159380 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 0x7f256814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 0x7f256814e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58158/0 (socket says 172.21.15.43:58158) 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 -- 172.21.15.43:0/3675274888 learned_addr learned my addr 172.21.15.43:0/3675274888 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256c891700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25680cd930 0x7f25680b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d893700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2568159380 0x7f25680ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 -- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2568159380 msgr2=0x7f25680ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2568159380 0x7f25680ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 -- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25680cd930 msgr2=0x7f25680b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25680cd930 0x7f25680b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 -- 172.21.15.43:0/3675274888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009a70 con 0x7f25680b1dc0 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256d092700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 0x7f256814e820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f255800c550 tx=0x7f255800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:00.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580054e0 con 0x7f25680b1dc0 2023-06-08T03:49:00.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558003680 con 0x7f25680b1dc0 2023-06-08T03:49:00.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558003a30 con 0x7f25680b1dc0 2023-06-08T03:49:00.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.311+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680c3a90 con 0x7f25680b1dc0 2023-06-08T03:49:00.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.312+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680c3180 con 0x7f25680b1dc0 2023-06-08T03:49:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.313+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2568073fa0 con 0x7f25680b1dc0 2023-06-08T03:49:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.313+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2558003b90 con 0x7f25680b1dc0 2023-06-08T03:49:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.313+0000 7f255dffb700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f254c06ace0 0x7f254c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.313+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2558088ab0 con 0x7f25680b1dc0 2023-06-08T03:49:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.314+0000 7f256c891700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f254c06ace0 0x7f254c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.314+0000 7f256c891700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f254c06ace0 0x7f254c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25680d0100 tx=0x7f2564009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.318+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2558053870 con 0x7f25680b1dc0 2023-06-08T03:49:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.513+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25681550b0 con 0x7f25680b1dc0 2023-06-08T03:49:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.513+0000 7f255dffb700 1 -- 172.21.15.43:0/3675274888 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25580170a0 con 0x7f25680b1dc0 2023-06-08T03:49:00.518 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f254c06ace0 msgr2=0x7f254c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f254c06ace0 0x7f254c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25680d0100 tx=0x7f2564009040 comp rx=0 tx=0).stop 2023-06-08T03:49:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 msgr2=0x7f256814e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 0x7f256814e820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f255800c550 tx=0x7f255800c860 comp rx=0 tx=0).stop 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 shutdown_connections 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f254c06ace0 0x7f254c06d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25680b1dc0 0x7f256814e820 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2568159380 0x7f25680ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 --2- 172.21.15.43:0/3675274888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25680cd930 0x7f25680b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 >> 172.21.15.43:0/3675274888 conn(0x7f256806aec0 msgr2=0x7f256806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 shutdown_connections 2023-06-08T03:49:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.516+0000 7f256f2f6700 1 -- 172.21.15.43:0/3675274888 wait complete. 2023-06-08T03:49:00.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:00.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.655+0000 7f114ac2a700 1 Processor -- start 2023-06-08T03:49:00.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.655+0000 7f114ac2a700 1 -- start start 2023-06-08T03:49:00.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f114ac2a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 0x7f11440ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f114ac2a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11440ce480 0x7f114406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f114ac2a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114415c5d0 con 0x7f114406c7f0 2023-06-08T03:49:00.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f114ac2a700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440cec20 con 0x7f11440ce480 2023-06-08T03:49:00.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f114ac2a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440ce940 con 0x7f114415c200 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f1143fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11440ce480 0x7f114406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f11489c6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 0x7f11440ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f11489c6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 0x7f11440ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51622/0 (socket says 172.21.15.43:51622) 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f11489c6700 1 -- 172.21.15.43:0/2811657684 learned_addr learned my addr 172.21.15.43:0/2811657684 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f1143fff700 1 -- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 msgr2=0x7f11440ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f1143fff700 1 --2- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 0x7f11440ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f1143fff700 1 -- 172.21.15.43:0/2811657684 >> v1:172.21.15.135:6789/0 conn(0x7f114406c7f0 legacy=0x7f114406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f1143fff700 1 -- 172.21.15.43:0/2811657684 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144069ee0 con 0x7f11440ce480 2023-06-08T03:49:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.656+0000 7f11489c6700 1 --2- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 0x7f11440ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f1143fff700 1 --2- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11440ce480 0x7f114406c2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1130009840 tx=0x7f1130009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a47dc0e36610a088 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f11437fe700 1 -- 172.21.15.43:0/2811657684 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011830 con 0x7f11440ce480 2023-06-08T03:49:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f11437fe700 1 -- 172.21.15.43:0/2811657684 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130011990 con 0x7f11440ce480 2023-06-08T03:49:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f11437fe700 1 -- 172.21.15.43:0/2811657684 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011d20 con 0x7f11440ce480 2023-06-08T03:49:00.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 -- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11440ce480 msgr2=0x7f114406c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 --2- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11440ce480 0x7f114406c2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1130009840 tx=0x7f1130009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 -- 172.21.15.43:0/2811657684 shutdown_connections 2023-06-08T03:49:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 --2- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f114415c200 0x7f11440ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 --2- 172.21.15.43:0/2811657684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11440ce480 0x7f114406c2b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 -- 172.21.15.43:0/2811657684 >> 172.21.15.43:0/2811657684 conn(0x7f11440cee30 msgr2=0x7f11440cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 -- 172.21.15.43:0/2811657684 shutdown_connections 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.657+0000 7f114ac2a700 1 -- 172.21.15.43:0/2811657684 wait complete. 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.659+0000 7f114ac2a700 1 Processor -- start 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.659+0000 7f114ac2a700 1 -- start start 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f114ac2a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f114406c7f0 0x7f11440b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f114ac2a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11440ce480 0x7f11440b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f114ac2a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 0x7f11440ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f114ac2a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11441f2a30 con 0x7f114415c200 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f114ac2a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11441f2100 con 0x7f114406c7f0 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f114ac2a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11441f23e0 con 0x7f11440ce480 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f11491c7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 0x7f11440ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f11491c7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 0x7f11440ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58176/0 (socket says 172.21.15.43:58176) 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f11491c7700 1 -- 172.21.15.43:0/3575362058 learned_addr learned my addr 172.21.15.43:0/3575362058 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f11489c6700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f114406c7f0 0x7f11440b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.660+0000 7f1143fff700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11440ce480 0x7f11440b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11491c7700 1 -- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11440ce480 msgr2=0x7f11440b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11491c7700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11440ce480 0x7f11440b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11491c7700 1 -- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f114406c7f0 msgr2=0x7f11440b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11491c7700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f114406c7f0 0x7f11440b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11491c7700 1 -- 172.21.15.43:0/3575362058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009550 con 0x7f114415c200 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11491c7700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 0x7f11440ca520 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f113c00cc50 tx=0x7f113c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c003c00 con 0x7f114415c200 2023-06-08T03:49:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c003d60 con 0x7f114415c200 2023-06-08T03:49:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300094a0 con 0x7f114415c200 2023-06-08T03:49:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c00aab0 con 0x7f114415c200 2023-06-08T03:49:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.661+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11440b16b0 con 0x7f114415c200 2023-06-08T03:49:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.662+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1144073fa0 con 0x7f114415c200 2023-06-08T03:49:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.663+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f113c00ac10 con 0x7f114415c200 2023-06-08T03:49:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.663+0000 7f11417fa700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f112806ace0 0x7f112806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.663+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f113c089590 con 0x7f114415c200 2023-06-08T03:49:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.663+0000 7f11489c6700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f112806ace0 0x7f112806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.664+0000 7f11489c6700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f112806ace0 0x7f112806d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11440b3360 tx=0x7f11380092c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.668+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f113c054350 con 0x7f114415c200 2023-06-08T03:49:00.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.865+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f114415c5d0 con 0x7f114415c200 2023-06-08T03:49:00.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.866+0000 7f11417fa700 1 -- 172.21.15.43:0/3575362058 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f114415c5d0 con 0x7f114415c200 2023-06-08T03:49:00.871 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f112806ace0 msgr2=0x7f112806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f112806ace0 0x7f112806d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11440b3360 tx=0x7f11380092c0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 msgr2=0x7f11440ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:00.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 0x7f11440ca520 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f113c00cc50 tx=0x7f113c00cf60 comp rx=0 tx=0).stop 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 shutdown_connections 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f112806ace0 0x7f112806d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114415c200 0x7f11440ca520 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f114406c7f0 0x7f11440b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 --2- 172.21.15.43:0/3575362058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11440ce480 0x7f11440b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 >> 172.21.15.43:0/3575362058 conn(0x7f11440cee30 msgr2=0x7f1144070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:00.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 shutdown_connections 2023-06-08T03:49:00.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:00.868+0000 7f114ac2a700 1 -- 172.21.15.43:0/3575362058 wait complete. 2023-06-08T03:49:00.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T03:49:01.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.006+0000 7f95df462700 1 Processor -- start 2023-06-08T03:49:01.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.006+0000 7f95df462700 1 -- start start 2023-06-08T03:49:01.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95df462700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95d815e420 0x7f95d80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95df462700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80cdb80 con 0x7f95d815e050 2023-06-08T03:49:01.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95df462700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80ce310 con 0x7f95d80cca40 2023-06-08T03:49:01.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95df462700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d80ce5f0 con 0x7f95d815e420 2023-06-08T03:49:01.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95dd1fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f95d815e050 0x7f95d80cd150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53084/0 (socket says 172.21.15.43:53084) 2023-06-08T03:49:01.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95dd1fe700 1 -- 172.21.15.43:0/4100011359 learned_addr learned my addr 172.21.15.43:0/4100011359 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95dc9fd700 1 --2- 172.21.15.43:0/4100011359 >> v2:172.21.15.135:3300/0 conn(0x7f95d815e420 0x7f95d80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95cffff700 1 -- 172.21.15.43:0/4100011359 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755456210 0 0) 0x7f95d80cdb80 con 0x7f95d815e050 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95cffff700 1 -- 172.21.15.43:0/4100011359 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c40035b0 con 0x7f95d815e050 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95cffff700 1 -- 172.21.15.43:0/4100011359 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772681416 0 0) 0x7f95c40035b0 con 0x7f95d815e050 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95dc9fd700 1 -- 172.21.15.43:0/4100011359 >> v1:172.21.15.135:6789/0 conn(0x7f95d80cca40 legacy=0x7f95d8163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95dc9fd700 1 -- 172.21.15.43:0/4100011359 >> v1:172.21.15.43:6789/0 conn(0x7f95d815e050 legacy=0x7f95d80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.007+0000 7f95dc9fd700 1 -- 172.21.15.43:0/4100011359 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80ce8d0 con 0x7f95d815e420 2023-06-08T03:49:01.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95dc9fd700 1 --2- 172.21.15.43:0/4100011359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80cc500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009840 tx=0x7f95c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3ba9f1a5370b27 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95cffff700 1 -- 172.21.15.43:0/4100011359 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4001670 con 0x7f95d815e420 2023-06-08T03:49:01.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95cffff700 1 -- 172.21.15.43:0/4100011359 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8004030 con 0x7f95d815e420 2023-06-08T03:49:01.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95cffff700 1 -- 172.21.15.43:0/4100011359 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80043c0 con 0x7f95d815e420 2023-06-08T03:49:01.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95df462700 1 -- 172.21.15.43:0/4100011359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 msgr2=0x7f95d80cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95df462700 1 --2- 172.21.15.43:0/4100011359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80cc500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009840 tx=0x7f95c8009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95df462700 1 -- 172.21.15.43:0/4100011359 shutdown_connections 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95df462700 1 --2- 172.21.15.43:0/4100011359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80cc500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.008+0000 7f95df462700 1 -- 172.21.15.43:0/4100011359 >> 172.21.15.43:0/4100011359 conn(0x7f95d8069db0 msgr2=0x7f95d806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.009+0000 7f95df462700 1 -- 172.21.15.43:0/4100011359 shutdown_connections 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.009+0000 7f95df462700 1 -- 172.21.15.43:0/4100011359 wait complete. 2023-06-08T03:49:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 Processor -- start 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 -- start start 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95d80cca40 0x7f95d8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 0x7f95d815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815b710 con 0x7f95d815e050 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d8150ff0 con 0x7f95d815e420 2023-06-08T03:49:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.010+0000 7f95df462700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815a670 con 0x7f95d80cca40 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 0x7f95d815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 0x7f95d815c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58188/0 (socket says 172.21.15.43:58188) 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 -- 172.21.15.43:0/1880440774 learned_addr learned my addr 172.21.15.43:0/1880440774 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dd1fe700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95d80cca40 0x7f95d8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dd9ff700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 -- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95d80cca40 msgr2=0x7f95d8150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95d80cca40 0x7f95d8150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 -- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 msgr2=0x7f95d80b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 -- 172.21.15.43:0/1880440774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c80094a0 con 0x7f95d815e050 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95dc9fd700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 0x7f95d815c1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95d806e130 tx=0x7f95c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80045b0 con 0x7f95d815e050 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8010590 con 0x7f95d815e050 2023-06-08T03:49:01.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d815a950 con 0x7f95d815e050 2023-06-08T03:49:01.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.011+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8010960 con 0x7f95d815e050 2023-06-08T03:49:01.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.012+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d815af10 con 0x7f95d815e050 2023-06-08T03:49:01.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.012+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d8073fa0 con 0x7f95d815e050 2023-06-08T03:49:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.013+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95c8010ac0 con 0x7f95d815e050 2023-06-08T03:49:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.013+0000 7f95cdffb700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f95bc06ace0 0x7f95bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.013+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95c808aed0 con 0x7f95d815e050 2023-06-08T03:49:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.013+0000 7f95dd1fe700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f95bc06ace0 0x7f95bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.014+0000 7f95dd1fe700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f95bc06ace0 0x7f95bc06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000f60 tx=0x7f95d4001e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.018+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95c8055c80 con 0x7f95d815e050 2023-06-08T03:49:01.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.230+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f95d80cc0e0 con 0x7f95d815e050 2023-06-08T03:49:01.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.230+0000 7f95cdffb700 1 -- 172.21.15.43:0/1880440774 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f95c80592a0 con 0x7f95d815e050 2023-06-08T03:49:01.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f95bc06ace0 msgr2=0x7f95bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f95bc06ace0 0x7f95bc06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000f60 tx=0x7f95d4001e40 comp rx=0 tx=0).stop 2023-06-08T03:49:01.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 msgr2=0x7f95d815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 0x7f95d815c1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95d806e130 tx=0x7f95c8004750 comp rx=0 tx=0).stop 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 shutdown_connections 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f95bc06ace0 0x7f95bc06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d815e420 0x7f95d80b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95d80cca40 0x7f95d8150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 --2- 172.21.15.43:0/1880440774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95d815e050 0x7f95d815c1b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 >> 172.21.15.43:0/1880440774 conn(0x7f95d8069db0 msgr2=0x7f95d80cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 shutdown_connections 2023-06-08T03:49:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.233+0000 7f95df462700 1 -- 172.21.15.43:0/1880440774 wait complete. 2023-06-08T03:49:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T03:49:01.249 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2023-06-08T03:49:01.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:01.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-08T03:49:01.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[106509]: fuse finished with error 0 and tester_r 0 2023-06-08T03:49:01.288 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T03:49:01.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:49:01.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:01.312 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-08T03:49:01.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:01.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.532+0000 7fc346dbe700 1 Processor -- start 2023-06-08T03:49:01.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.532+0000 7fc346dbe700 1 -- start start 2023-06-08T03:49:01.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc346dbe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34006a4c0 0x7fc3400af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc346dbe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc3400ccba0 0x7fc3400b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc346dbe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400af050 con 0x7fc34015c590 2023-06-08T03:49:01.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc346dbe700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400afae0 con 0x7fc3400ccba0 2023-06-08T03:49:01.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc346dbe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400af800 con 0x7fc34006a4c0 2023-06-08T03:49:01.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc3400ccba0 0x7fc3400b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc3400ccba0 0x7fc3400b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58196/0 (socket says 172.21.15.43:58196) 2023-06-08T03:49:01.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 -- 172.21.15.43:0/767116484 learned_addr learned my addr 172.21.15.43:0/767116484 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:01.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc33ffff700 1 --2- 172.21.15.43:0/767116484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34006a4c0 0x7fc3400af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 -- 172.21.15.43:0/767116484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34006a4c0 msgr2=0x7fc3400af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 --2- 172.21.15.43:0/767116484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34006a4c0 0x7fc3400af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 -- 172.21.15.43:0/767116484 >> v1:172.21.15.135:6789/0 conn(0x7fc34015c590 legacy=0x7fc340069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.533+0000 7fc34535b700 1 -- 172.21.15.43:0/767116484 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400cc0c0 con 0x7fc3400ccba0 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc34535b700 1 --2- 172.21.15.43:0/767116484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc3400b06d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e50 tx=0x7fc33800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4a33a16fe204a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc33f7fe700 1 -- 172.21.15.43:0/767116484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800e070 con 0x7fc3400ccba0 2023-06-08T03:49:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc33f7fe700 1 -- 172.21.15.43:0/767116484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800b9c0 con 0x7fc3400ccba0 2023-06-08T03:49:01.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc33f7fe700 1 -- 172.21.15.43:0/767116484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800bd70 con 0x7fc3400ccba0 2023-06-08T03:49:01.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 -- 172.21.15.43:0/767116484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 msgr2=0x7fc3400b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 --2- 172.21.15.43:0/767116484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc3400b06d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e50 tx=0x7fc33800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:01.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 -- 172.21.15.43:0/767116484 shutdown_connections 2023-06-08T03:49:01.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 --2- 172.21.15.43:0/767116484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc3400b06d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 --2- 172.21.15.43:0/767116484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34006a4c0 0x7fc3400af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 -- 172.21.15.43:0/767116484 >> 172.21.15.43:0/767116484 conn(0x7fc34006b7e0 msgr2=0x7fc3400cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:01.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 -- 172.21.15.43:0/767116484 shutdown_connections 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.534+0000 7fc346dbe700 1 -- 172.21.15.43:0/767116484 wait complete. 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.536+0000 7fc346dbe700 1 Processor -- start 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.536+0000 7fc346dbe700 1 -- start start 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34006a4c0 0x7fc34009ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc34015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34015c590 0x7fc3400c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c4160 con 0x7fc3400ccba0 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c5520 con 0x7fc34006a4c0 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c57a0 con 0x7fc34015c590 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc34015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc34015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58200/0 (socket says 172.21.15.43:58200) 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 -- 172.21.15.43:0/1021056634 learned_addr learned my addr 172.21.15.43:0/1021056634 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc34535b700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34015c590 0x7fc3400c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc344b5a700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34006a4c0 0x7fc34009ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 -- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34015c590 msgr2=0x7fc3400c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34015c590 0x7fc3400c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 -- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34006a4c0 msgr2=0x7fc34009ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34006a4c0 0x7fc34009ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 -- 172.21.15.43:0/1021056634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009b30 con 0x7fc3400ccba0 2023-06-08T03:49:01.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33ffff700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc34015a950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00e810 tx=0x7fc32c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00c070 con 0x7fc3400ccba0 2023-06-08T03:49:01.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c013610 con 0x7fc3400ccba0 2023-06-08T03:49:01.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3400c5a80 con 0x7fc3400ccba0 2023-06-08T03:49:01.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0139c0 con 0x7fc3400ccba0 2023-06-08T03:49:01.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.537+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3400c6320 con 0x7fc3400ccba0 2023-06-08T03:49:01.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.538+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc340073fa0 con 0x7fc3400ccba0 2023-06-08T03:49:01.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.539+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc32c013b20 con 0x7fc3400ccba0 2023-06-08T03:49:01.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.539+0000 7fc33d7fa700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc32406ace0 0x7fc32406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.539+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc32c0891a0 con 0x7fc3400ccba0 2023-06-08T03:49:01.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.539+0000 7fc344b5a700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc32406ace0 0x7fc32406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.540+0000 7fc344b5a700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc32406ace0 0x7fc32406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc334000fb0 tx=0x7fc334009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.543+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc32c057a80 con 0x7fc3400ccba0 2023-06-08T03:49:01.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.742+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc340071dc0 con 0x7fc3400ccba0 2023-06-08T03:49:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.743+0000 7fc33d7fa700 1 -- 172.21.15.43:0/1021056634 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fc32c057610 con 0x7fc3400ccba0 2023-06-08T03:49:01.747 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:01.747 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:01.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc32406ace0 msgr2=0x7fc32406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc32406ace0 0x7fc32406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc334000fb0 tx=0x7fc334009040 comp rx=0 tx=0).stop 2023-06-08T03:49:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 msgr2=0x7fc34015a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc34015a950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00e810 tx=0x7fc32c00eb20 comp rx=0 tx=0).stop 2023-06-08T03:49:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 shutdown_connections 2023-06-08T03:49:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc32406ace0 0x7fc32406d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc34015c590 0x7fc3400c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34006a4c0 0x7fc34009ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 --2- 172.21.15.43:0/1021056634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3400ccba0 0x7fc34015a950 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 >> 172.21.15.43:0/1021056634 conn(0x7fc34006b7e0 msgr2=0x7fc3400ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:01.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 shutdown_connections 2023-06-08T03:49:01.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.745+0000 7fc346dbe700 1 -- 172.21.15.43:0/1021056634 wait complete. 2023-06-08T03:49:01.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:01.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.883+0000 7fe33a006700 1 Processor -- start 2023-06-08T03:49:01.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.884+0000 7fe33a006700 1 -- start start 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe33a006700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe33406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe33a006700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3340d0380 0x7fe3340aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe33a006700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340acbe0 con 0x7fe3340ae580 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe33a006700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3340ac2d0 con 0x7fe3340d0380 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe33a006700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33406a6c0 con 0x7fe334069db0 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3340d0380 0x7fe3340aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3340d0380 0x7fe3340aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58208/0 (socket says 172.21.15.43:58208) 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 -- 172.21.15.43:0/3016833842 learned_addr learned my addr 172.21.15.43:0/3016833842 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe3337fe700 1 --2- 172.21.15.43:0/3016833842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe33406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 -- 172.21.15.43:0/3016833842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 msgr2=0x7fe33406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 --2- 172.21.15.43:0/3016833842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe33406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 -- 172.21.15.43:0/3016833842 >> v1:172.21.15.135:6789/0 conn(0x7fe3340ae580 legacy=0x7fe3340af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 -- 172.21.15.43:0/3016833842 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340b0860 con 0x7fe3340d0380 2023-06-08T03:49:01.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.885+0000 7fe332ffd700 1 --2- 172.21.15.43:0/3016833842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340aead0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098f0 tx=0x7fe328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95596a6d6d5130e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe3327fc700 1 -- 172.21.15.43:0/3016833842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800b8a0 con 0x7fe3340d0380 2023-06-08T03:49:01.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe3327fc700 1 -- 172.21.15.43:0/3016833842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32800ba00 con 0x7fe3340d0380 2023-06-08T03:49:01.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe3327fc700 1 -- 172.21.15.43:0/3016833842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800bd90 con 0x7fe3340d0380 2023-06-08T03:49:01.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 -- 172.21.15.43:0/3016833842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 msgr2=0x7fe3340aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 --2- 172.21.15.43:0/3016833842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340aead0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098f0 tx=0x7fe328009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 -- 172.21.15.43:0/3016833842 shutdown_connections 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 --2- 172.21.15.43:0/3016833842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe33406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 --2- 172.21.15.43:0/3016833842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340aead0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 -- 172.21.15.43:0/3016833842 >> 172.21.15.43:0/3016833842 conn(0x7fe33406b7e0 msgr2=0x7fe3340cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 -- 172.21.15.43:0/3016833842 shutdown_connections 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.886+0000 7fe33a006700 1 -- 172.21.15.43:0/3016833842 wait complete. 2023-06-08T03:49:01.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.887+0000 7fe33a006700 1 Processor -- start 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 -- start start 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe3340c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340ae580 0x7fe3340c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340c3930 con 0x7fe3340d0380 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340c6a10 con 0x7fe3340ae580 2023-06-08T03:49:01.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe33a006700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340c77f0 con 0x7fe334069db0 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe333fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe333fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58216/0 (socket says 172.21.15.43:58216) 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.888+0000 7fe333fff700 1 -- 172.21.15.43:0/1875700266 learned_addr learned my addr 172.21.15.43:0/1875700266 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe332ffd700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340ae580 0x7fe3340c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe3337fe700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe3340c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe333fff700 1 -- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 msgr2=0x7fe3340c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe333fff700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe3340c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe333fff700 1 -- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340ae580 msgr2=0x7fe3340c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:01.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe333fff700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340ae580 0x7fe3340c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:01.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe333fff700 1 -- 172.21.15.43:0/1875700266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009550 con 0x7fe3340d0380 2023-06-08T03:49:01.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe333fff700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340caec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00cb50 tx=0x7fe32c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c003c00 con 0x7fe3340d0380 2023-06-08T03:49:01.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c003d60 con 0x7fe3340d0380 2023-06-08T03:49:01.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3340c3270 con 0x7fe3340d0380 2023-06-08T03:49:01.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00aa20 con 0x7fe3340d0380 2023-06-08T03:49:01.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.889+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3340c7ad0 con 0x7fe3340d0380 2023-06-08T03:49:01.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.890+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3340c65c0 con 0x7fe3340d0380 2023-06-08T03:49:01.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.891+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe32c00ab80 con 0x7fe3340d0380 2023-06-08T03:49:01.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.891+0000 7fe31bfff700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe32006ace0 0x7fe32006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:01.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.891+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe32c0896d0 con 0x7fe3340d0380 2023-06-08T03:49:01.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.891+0000 7fe3337fe700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe32006ace0 0x7fe32006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:01.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.892+0000 7fe3337fe700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe32006ace0 0x7fe32006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe33406d540 tx=0x7fe324008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:01.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:01.895+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe32c054520 con 0x7fe3340d0380 2023-06-08T03:49:02.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.095+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3340ac570 con 0x7fe3340d0380 2023-06-08T03:49:02.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.096+0000 7fe31bfff700 1 -- 172.21.15.43:0/1875700266 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fe3340ac570 con 0x7fe3340d0380 2023-06-08T03:49:02.101 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:02.101 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe32006ace0 msgr2=0x7fe32006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe32006ace0 0x7fe32006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe33406d540 tx=0x7fe324008040 comp rx=0 tx=0).stop 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 msgr2=0x7fe3340caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340caec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00cb50 tx=0x7fe32c00ce60 comp rx=0 tx=0).stop 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 shutdown_connections 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe32006ace0 0x7fe32006d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3340d0380 0x7fe3340caec0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe334069db0 0x7fe3340c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 --2- 172.21.15.43:0/1875700266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340ae580 0x7fe3340c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.098+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 >> 172.21.15.43:0/1875700266 conn(0x7fe33406b7e0 msgr2=0x7fe3341598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:02.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.099+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 shutdown_connections 2023-06-08T03:49:02.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.099+0000 7fe33a006700 1 -- 172.21.15.43:0/1875700266 wait complete. 2023-06-08T03:49:02.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-08T03:49:02.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.239+0000 7fe334619700 1 Processor -- start 2023-06-08T03:49:02.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.239+0000 7fe334619700 1 -- start start 2023-06-08T03:49:02.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe334619700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe32c15c320 0x7fe32c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe334619700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe32c071770 0x7fe32c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe334619700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c071290 con 0x7fe32c15c6f0 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe334619700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0b2050 con 0x7fe32c071770 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe334619700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0cd2c0 con 0x7fe32c15c320 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe32c071770 0x7fe32c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe32c071770 0x7fe32c069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58220/0 (socket says 172.21.15.43:58220) 2023-06-08T03:49:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 -- 172.21.15.43:0/4240093023 learned_addr learned my addr 172.21.15.43:0/4240093023 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe3323b5700 1 --2- 172.21.15.43:0/4240093023 >> v2:172.21.15.135:3300/0 conn(0x7fe32c15c320 0x7fe32c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 -- 172.21.15.43:0/4240093023 >> v2:172.21.15.135:3300/0 conn(0x7fe32c15c320 msgr2=0x7fe32c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 --2- 172.21.15.43:0/4240093023 >> v2:172.21.15.135:3300/0 conn(0x7fe32c15c320 0x7fe32c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 -- 172.21.15.43:0/4240093023 >> v1:172.21.15.135:6789/0 conn(0x7fe32c15c6f0 legacy=0x7fe32c160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 -- 172.21.15.43:0/4240093023 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0cd5a0 con 0x7fe32c071770 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe331bb4700 1 --2- 172.21.15.43:0/4240093023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cd1a0 tx=0x7fe328009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf2529568512fbe server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.240+0000 7fe3313b3700 1 -- 172.21.15.43:0/4240093023 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800b870 con 0x7fe32c071770 2023-06-08T03:49:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe3313b3700 1 -- 172.21.15.43:0/4240093023 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32800b9d0 con 0x7fe32c071770 2023-06-08T03:49:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe3313b3700 1 -- 172.21.15.43:0/4240093023 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800bd60 con 0x7fe32c071770 2023-06-08T03:49:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 -- 172.21.15.43:0/4240093023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 msgr2=0x7fe32c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 --2- 172.21.15.43:0/4240093023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cd1a0 tx=0x7fe328009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 -- 172.21.15.43:0/4240093023 shutdown_connections 2023-06-08T03:49:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 --2- 172.21.15.43:0/4240093023 >> v2:172.21.15.135:3300/0 conn(0x7fe32c15c320 0x7fe32c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 --2- 172.21.15.43:0/4240093023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c069db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 -- 172.21.15.43:0/4240093023 >> 172.21.15.43:0/4240093023 conn(0x7fe32c06aec0 msgr2=0x7fe32c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 -- 172.21.15.43:0/4240093023 shutdown_connections 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.241+0000 7fe334619700 1 -- 172.21.15.43:0/4240093023 wait complete. 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.242+0000 7fe334619700 1 Processor -- start 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.242+0000 7fe334619700 1 -- start start 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe334619700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe334619700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe32c15c320 0x7fe32c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe334619700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe32c15c6f0 0x7fe32c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe334619700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c155280 con 0x7fe32c071770 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe334619700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0ca670 con 0x7fe32c15c6f0 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe334619700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0cac30 con 0x7fe32c15c320 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe3323b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe3323b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58226/0 (socket says 172.21.15.43:58226) 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe3323b5700 1 -- 172.21.15.43:0/1484216752 learned_addr learned my addr 172.21.15.43:0/1484216752 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.243+0000 7fe332bb6700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe32c15c6f0 0x7fe32c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe331bb4700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe32c15c320 0x7fe32c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe3323b5700 1 -- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe32c15c320 msgr2=0x7fe32c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe3323b5700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe32c15c320 0x7fe32c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe3323b5700 1 -- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe32c15c6f0 msgr2=0x7fe32c155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe3323b5700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe32c15c6f0 0x7fe32c155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe3323b5700 1 -- 172.21.15.43:0/1484216752 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009550 con 0x7fe32c071770 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe332bb6700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe32c15c6f0 0x7fe32c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:02.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe3323b5700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c154d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e810 tx=0x7fe31c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:02.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c013610 con 0x7fe32c071770 2023-06-08T03:49:02.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c013770 con 0x7fe32c071770 2023-06-08T03:49:02.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c0cb600 con 0x7fe32c071770 2023-06-08T03:49:02.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c013b20 con 0x7fe32c071770 2023-06-08T03:49:02.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.244+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c0cbe50 con 0x7fe32c071770 2023-06-08T03:49:02.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.245+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c0caf10 con 0x7fe32c071770 2023-06-08T03:49:02.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.245+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe31c013c80 con 0x7fe32c071770 2023-06-08T03:49:02.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.246+0000 7fe322ffd700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe31006ace0 0x7fe31006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.246+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe31c0894f0 con 0x7fe32c071770 2023-06-08T03:49:02.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.246+0000 7fe331bb4700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe31006ace0 0x7fe31006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.247+0000 7fe331bb4700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe31006ace0 0x7fe31006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe32c071b60 tx=0x7fe328008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:02.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.250+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe31c057d40 con 0x7fe32c071770 2023-06-08T03:49:02.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.496+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe32c0cf2e0 con 0x7fe32c071770 2023-06-08T03:49:02.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.761+0000 7fe322ffd700 1 -- 172.21.15.43:0/1484216752 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe31c0578d0 con 0x7fe32c071770 2023-06-08T03:49:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe31006ace0 msgr2=0x7fe31006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe31006ace0 0x7fe31006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe32c071b60 tx=0x7fe328008030 comp rx=0 tx=0).stop 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 msgr2=0x7fe32c154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c154d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e810 tx=0x7fe31c00ebd0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 shutdown_connections 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe31006ace0 0x7fe31006d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe32c071770 0x7fe32c154d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe32c15c6f0 0x7fe32c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 --2- 172.21.15.43:0/1484216752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe32c15c320 0x7fe32c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 >> 172.21.15.43:0/1484216752 conn(0x7fe32c06aec0 msgr2=0x7fe32c0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:02.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 shutdown_connections 2023-06-08T03:49:02.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.763+0000 7fe334619700 1 -- 172.21.15.43:0/1484216752 wait complete. 2023-06-08T03:49:02.780 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-08T03:49:02.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-08T03:49:02.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.904+0000 7fbdf32df700 1 Processor -- start 2023-06-08T03:49:02.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.904+0000 7fbdf32df700 1 -- start start 2023-06-08T03:49:02.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf32df700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbdec0b60a0 0x7fbdec0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf32df700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec0cda20 con 0x7fbdec15e340 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf32df700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec15e7a0 con 0x7fbdec0cf5b0 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf32df700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec0b6470 con 0x7fbdec0b60a0 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf107b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbdec0b60a0 0x7fbdec0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf187c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbdec15e340 0x7fbdec0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53142/0 (socket says 172.21.15.43:53142) 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf107b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbdec0b60a0 0x7fbdec0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58234/0 (socket says 172.21.15.43:58234) 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf187c700 1 -- 172.21.15.43:0/3562817739 learned_addr learned my addr 172.21.15.43:0/3562817739 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf107b700 1 -- 172.21.15.43:0/3562817739 >> v1:172.21.15.135:6789/0 conn(0x7fbdec0cf5b0 legacy=0x7fbdec15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf107b700 1 -- 172.21.15.43:0/3562817739 >> v1:172.21.15.43:6789/0 conn(0x7fbdec15e340 legacy=0x7fbdec0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbde3fff700 1 -- 172.21.15.43:0/3562817739 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470827300 0 0) 0x7fbdec0cda20 con 0x7fbdec15e340 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf107b700 1 -- 172.21.15.43:0/3562817739 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec15a520 con 0x7fbdec0b60a0 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbdf107b700 1 --2- 172.21.15.43:0/3562817739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec0b60a0 0x7fbdec0cad90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009840 tx=0x7fbde8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b287be8711c17ce server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbde3fff700 1 -- 172.21.15.43:0/3562817739 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8004230 con 0x7fbdec0b60a0 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbde3fff700 1 -- 172.21.15.43:0/3562817739 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8004390 con 0x7fbdec0b60a0 2023-06-08T03:49:02.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.905+0000 7fbde3fff700 1 -- 172.21.15.43:0/3562817739 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80036a0 con 0x7fbdec0b60a0 2023-06-08T03:49:02.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 -- 172.21.15.43:0/3562817739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec0b60a0 msgr2=0x7fbdec0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 --2- 172.21.15.43:0/3562817739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec0b60a0 0x7fbdec0cad90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009840 tx=0x7fbde8009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 -- 172.21.15.43:0/3562817739 shutdown_connections 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 --2- 172.21.15.43:0/3562817739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec0b60a0 0x7fbdec0cad90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 -- 172.21.15.43:0/3562817739 >> 172.21.15.43:0/3562817739 conn(0x7fbdec069db0 msgr2=0x7fbdec06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 -- 172.21.15.43:0/3562817739 shutdown_connections 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.906+0000 7fbdf32df700 1 -- 172.21.15.43:0/3562817739 wait complete. 2023-06-08T03:49:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.907+0000 7fbdf32df700 1 Processor -- start 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.907+0000 7fbdf32df700 1 -- start start 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf32df700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdec0b60a0 0x7fbdec14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf32df700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdec0cf5b0 0x7fbdec14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf32df700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 0x7fbdec0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf32df700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec15b640 con 0x7fbdec15e340 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf32df700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec15bdf0 con 0x7fbdec0b60a0 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf32df700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec15c0d0 con 0x7fbdec0cf5b0 2023-06-08T03:49:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 0x7fbdec0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 0x7fbdec0b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58244/0 (socket says 172.21.15.43:58244) 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 -- 172.21.15.43:0/569501855 learned_addr learned my addr 172.21.15.43:0/569501855 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf107b700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdec0b60a0 0x7fbdec14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf087a700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdec0cf5b0 0x7fbdec14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 -- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdec0cf5b0 msgr2=0x7fbdec14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdec0cf5b0 0x7fbdec14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 -- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdec0b60a0 msgr2=0x7fbdec14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdec0b60a0 0x7fbdec14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf187c700 1 -- 172.21.15.43:0/569501855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80094a0 con 0x7fbdec15e340 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.908+0000 7fbdf107b700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdec0b60a0 0x7fbdec14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.909+0000 7fbdf187c700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 0x7fbdec0b11a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbde400cca0 tx=0x7fbde400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.909+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400cea0 con 0x7fbdec15e340 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.909+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400ade0 con 0x7fbdec15e340 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.909+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec15c3b0 con 0x7fbdec15e340 2023-06-08T03:49:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.909+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4007310 con 0x7fbdec15e340 2023-06-08T03:49:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.909+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec14f100 con 0x7fbdec15e340 2023-06-08T03:49:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.910+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec15c8d0 con 0x7fbdec15e340 2023-06-08T03:49:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.910+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbde4007470 con 0x7fbdec15e340 2023-06-08T03:49:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.911+0000 7fbde1ffb700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbdd006ad10 0x7fbdd006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.911+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbde40896a0 con 0x7fbdec15e340 2023-06-08T03:49:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.911+0000 7fbdf107b700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbdd006ad10 0x7fbdd006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.911+0000 7fbdf107b700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbdd006ad10 0x7fbdd006d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbde80090b0 tx=0x7fbde8013040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:02.915+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbdec15c8d0 con 0x7fbdec15e340 2023-06-08T03:49:03.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.160+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbdec15c8d0 con 0x7fbdec15e340 2023-06-08T03:49:03.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.769+0000 7fbde1ffb700 1 -- 172.21.15.43:0/569501855 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbdec15c8d0 con 0x7fbdec15e340 2023-06-08T03:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbdd006ad10 msgr2=0x7fbdd006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbdd006ad10 0x7fbdd006d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbde80090b0 tx=0x7fbde8013040 comp rx=0 tx=0).stop 2023-06-08T03:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 msgr2=0x7fbdec0b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 0x7fbdec0b11a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbde400cca0 tx=0x7fbde400a340 comp rx=0 tx=0).stop 2023-06-08T03:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 shutdown_connections 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbdd006ad10 0x7fbdd006d1c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdec15e340 0x7fbdec0b11a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdec0b60a0 0x7fbdec14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 --2- 172.21.15.43:0/569501855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdec0cf5b0 0x7fbdec14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 >> 172.21.15.43:0/569501855 conn(0x7fbdec069db0 msgr2=0x7fbdec0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 shutdown_connections 2023-06-08T03:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.772+0000 7fbdf32df700 1 -- 172.21.15.43:0/569501855 wait complete. 2023-06-08T03:49:03.791 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-08T03:49:03.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:03.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.919+0000 7f7f63b82700 1 Processor -- start 2023-06-08T03:49:03.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.919+0000 7f7f63b82700 1 -- start start 2023-06-08T03:49:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f63b82700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f5c0cd980 0x7f7f5c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f63b82700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7f5c0b0c40 0x7f7f5c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f63b82700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c0b01a0 con 0x7f7f5c0afa30 2023-06-08T03:49:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f63b82700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b06f0 con 0x7f7f5c0b0c40 2023-06-08T03:49:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f63b82700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b0900 con 0x7f7f5c0cd980 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f6211f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7f5c0b0c40 0x7f7f5c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f6191e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7f5c0afa30 0x7f7f5c0cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53152/0 (socket says 172.21.15.43:53152) 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f6191e700 1 -- 172.21.15.43:0/2384528366 learned_addr learned my addr 172.21.15.43:0/2384528366 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.920+0000 7f7f6111d700 1 --2- 172.21.15.43:0/2384528366 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c0cd980 0x7f7f5c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6211f700 1 -- 172.21.15.43:0/2384528366 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c0cd980 msgr2=0x7f7f5c0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6211f700 1 --2- 172.21.15.43:0/2384528366 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c0cd980 0x7f7f5c0b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6211f700 1 -- 172.21.15.43:0/2384528366 >> v1:172.21.15.43:6789/0 conn(0x7f7f5c0afa30 legacy=0x7f7f5c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6211f700 1 -- 172.21.15.43:0/2384528366 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0ca7a0 con 0x7f7f5c0b0c40 2023-06-08T03:49:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6091c700 1 -- 172.21.15.43:0/2384528366 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112488030 0 0) 0x7f7f5c0b01a0 con 0x7f7f5c0afa30 2023-06-08T03:49:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6211f700 1 --2- 172.21.15.43:0/2384528366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0b0c40 0x7f7f5c0cafa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0c9c80 tx=0x7f7f5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26af7a5e7a5865cc server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6091c700 1 -- 172.21.15.43:0/2384528366 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400e070 con 0x7f7f5c0b0c40 2023-06-08T03:49:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6091c700 1 -- 172.21.15.43:0/2384528366 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5400bbd0 con 0x7f7f5c0b0c40 2023-06-08T03:49:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f6091c700 1 -- 172.21.15.43:0/2384528366 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54012430 con 0x7f7f5c0b0c40 2023-06-08T03:49:03.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f63b82700 1 -- 172.21.15.43:0/2384528366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0b0c40 msgr2=0x7f7f5c0cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f63b82700 1 --2- 172.21.15.43:0/2384528366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0b0c40 0x7f7f5c0cafa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0c9c80 tx=0x7f7f5400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f63b82700 1 -- 172.21.15.43:0/2384528366 shutdown_connections 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f63b82700 1 --2- 172.21.15.43:0/2384528366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0b0c40 0x7f7f5c0cafa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f63b82700 1 --2- 172.21.15.43:0/2384528366 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c0cd980 0x7f7f5c0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.921+0000 7f7f63b82700 1 -- 172.21.15.43:0/2384528366 >> 172.21.15.43:0/2384528366 conn(0x7f7f5c06b7e0 msgr2=0x7f7f5c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.922+0000 7f7f63b82700 1 -- 172.21.15.43:0/2384528366 shutdown_connections 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.922+0000 7f7f63b82700 1 -- 172.21.15.43:0/2384528366 wait complete. 2023-06-08T03:49:03.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.923+0000 7f7f63b82700 1 Processor -- start 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.923+0000 7f7f63b82700 1 -- start start 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.923+0000 7f7f63b82700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 0x7f7f5c0ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c0b0c40 0x7f7f5c0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c0cd980 0x7f7f5c0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0ac830 con 0x7f7f5c0afa30 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c15b8a0 con 0x7f7f5c0cd980 2023-06-08T03:49:03.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c15bb80 con 0x7f7f5c0b0c40 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 0x7f7f5c0ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 0x7f7f5c0ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58254/0 (socket says 172.21.15.43:58254) 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 -- 172.21.15.43:0/493456394 learned_addr learned my addr 172.21.15.43:0/493456394 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6111d700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c0b0c40 0x7f7f5c0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6211f700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c0cd980 0x7f7f5c0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 -- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c0b0c40 msgr2=0x7f7f5c0c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c0b0c40 0x7f7f5c0c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 -- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c0cd980 msgr2=0x7f7f5c0c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c0cd980 0x7f7f5c0c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 -- 172.21.15.43:0/493456394 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54009a70 con 0x7f7f5c0afa30 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6111d700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c0b0c40 0x7f7f5c0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6211f700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c0cd980 0x7f7f5c0c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f6191e700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 0x7f7f5c0ae9e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f580010e0 tx=0x7f7f5800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f580074e0 con 0x7f7f5c0afa30 2023-06-08T03:49:03.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f58007640 con 0x7f7f5c0afa30 2023-06-08T03:49:03.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c0ac450 con 0x7f7f5c0afa30 2023-06-08T03:49:03.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f58005a70 con 0x7f7f5c0afa30 2023-06-08T03:49:03.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.924+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c0c35b0 con 0x7f7f5c0afa30 2023-06-08T03:49:03.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.925+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c0ac970 con 0x7f7f5c0afa30 2023-06-08T03:49:03.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.926+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f58005bd0 con 0x7f7f5c0afa30 2023-06-08T03:49:03.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.926+0000 7f7f527fc700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7f4006ace0 0x7f7f4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:03.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.926+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f58088c70 con 0x7f7f5c0afa30 2023-06-08T03:49:03.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.926+0000 7f7f6111d700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7f4006ace0 0x7f7f4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:03.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.927+0000 7f7f6111d700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7f4006ace0 0x7f7f4006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0c6340 tx=0x7f7f4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:03.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:03.931+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f5c0ac970 con 0x7f7f5c0afa30 2023-06-08T03:49:04.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.172+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f5c0ac970 con 0x7f7f5c0afa30 2023-06-08T03:49:04.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.172+0000 7f7f527fc700 1 -- 172.21.15.43:0/493456394 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f7f5c0ac970 con 0x7f7f5c0afa30 2023-06-08T03:49:04.177 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:04.177 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:04.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7f4006ace0 msgr2=0x7f7f4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7f4006ace0 0x7f7f4006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0c6340 tx=0x7f7f4c008040 comp rx=0 tx=0).stop 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 msgr2=0x7f7f5c0ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 0x7f7f5c0ae9e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f580010e0 tx=0x7f7f5800cae0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 shutdown_connections 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f7f4006ace0 0x7f7f4006d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f5c0afa30 0x7f7f5c0ae9e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c0cd980 0x7f7f5c0c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 --2- 172.21.15.43:0/493456394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c0b0c40 0x7f7f5c0c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 >> 172.21.15.43:0/493456394 conn(0x7f7f5c06b7e0 msgr2=0x7f7f5c1589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 shutdown_connections 2023-06-08T03:49:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.174+0000 7f7f63b82700 1 -- 172.21.15.43:0/493456394 wait complete. 2023-06-08T03:49:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:04.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.311+0000 7f1ff0c0c700 1 Processor -- start 2023-06-08T03:49:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.311+0000 7f1ff0c0c700 1 -- start start 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1ff0c0c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1fec159380 0x7f1fec0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1ff0c0c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1fec0cd930 0x7f1fec0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1ff0c0c700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec06f480 con 0x7f1fec0b1dc0 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1ff0c0c700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0b10d0 con 0x7f1fec0cd930 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1ff0c0c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec06f760 con 0x7f1fec159380 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fead9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1fec0cd930 0x7f1fec0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fe9d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1fec0b1dc0 0x7f1fec0cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53166/0 (socket says 172.21.15.43:53166) 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fe9d9b700 1 -- 172.21.15.43:0/1691629246 learned_addr learned my addr 172.21.15.43:0/1691629246 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fea59c700 1 --2- 172.21.15.43:0/1691629246 >> v2:172.21.15.135:3300/0 conn(0x7f1fec159380 0x7f1fec0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fead9d700 1 -- 172.21.15.43:0/1691629246 >> v2:172.21.15.135:3300/0 conn(0x7f1fec159380 msgr2=0x7f1fec0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fead9d700 1 --2- 172.21.15.43:0/1691629246 >> v2:172.21.15.135:3300/0 conn(0x7f1fec159380 0x7f1fec0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fead9d700 1 -- 172.21.15.43:0/1691629246 >> v1:172.21.15.43:6789/0 conn(0x7f1fec0b1dc0 legacy=0x7f1fec0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fead9d700 1 -- 172.21.15.43:0/1691629246 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0b12e0 con 0x7f1fec0cd930 2023-06-08T03:49:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fe959a700 1 -- 172.21.15.43:0/1691629246 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057526298 0 0) 0x7f1fec06f480 con 0x7f1fec0b1dc0 2023-06-08T03:49:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.312+0000 7f1fea59c700 1 --2- 172.21.15.43:0/1691629246 >> v2:172.21.15.135:3300/0 conn(0x7f1fec159380 0x7f1fec0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1fead9d700 1 --2- 172.21.15.43:0/1691629246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0ca580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fec066830 tx=0x7f1fe400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a767d6b687620a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1fe959a700 1 -- 172.21.15.43:0/1691629246 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400e070 con 0x7f1fec0cd930 2023-06-08T03:49:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1fe959a700 1 -- 172.21.15.43:0/1691629246 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400bbd0 con 0x7f1fec0cd930 2023-06-08T03:49:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1fe959a700 1 -- 172.21.15.43:0/1691629246 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4012430 con 0x7f1fec0cd930 2023-06-08T03:49:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/1691629246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 msgr2=0x7f1fec0ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/1691629246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0ca580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fec066830 tx=0x7f1fe400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/1691629246 shutdown_connections 2023-06-08T03:49:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/1691629246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0ca580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/1691629246 >> v2:172.21.15.135:3300/0 conn(0x7f1fec159380 0x7f1fec0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/1691629246 >> 172.21.15.43:0/1691629246 conn(0x7f1fec06aec0 msgr2=0x7f1fec06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.313+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/1691629246 shutdown_connections 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.314+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/1691629246 wait complete. 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.315+0000 7f1ff0c0c700 1 Processor -- start 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.315+0000 7f1ff0c0c700 1 -- start start 2023-06-08T03:49:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1ff0c0c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1fec0b1dc0 0x7f1fec0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1ff0c0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1ff0c0c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fec159380 0x7f1fec152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1ff0c0c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0ccdc0 con 0x7f1fec0cd930 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1ff0c0c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0cc140 con 0x7f1fec159380 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1ff0c0c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0cc420 con 0x7f1fec0b1dc0 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58268/0 (socket says 172.21.15.43:58268) 2023-06-08T03:49:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 -- 172.21.15.43:0/2414397171 learned_addr learned my addr 172.21.15.43:0/2414397171 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fea59c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1fec0b1dc0 0x7f1fec0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fead9d700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fec159380 0x7f1fec152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 -- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1fec0b1dc0 msgr2=0x7f1fec0c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1fec0b1dc0 0x7f1fec0c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 -- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fec159380 msgr2=0x7f1fec152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fec159380 0x7f1fec152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 -- 172.21.15.43:0/2414397171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009a70 con 0x7f1fec0cd930 2023-06-08T03:49:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fe9d9b700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0cb6c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0011e0 tx=0x7f1fdc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.316+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc004c80 con 0x7f1fec0cd930 2023-06-08T03:49:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.317+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc004e00 con 0x7f1fec0cd930 2023-06-08T03:49:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.317+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec0cc700 con 0x7f1fec0cd930 2023-06-08T03:49:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.317+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc007310 con 0x7f1fec0cd930 2023-06-08T03:49:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.317+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0b31a0 con 0x7f1fec0cd930 2023-06-08T03:49:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.317+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec0ccf00 con 0x7f1fec0cd930 2023-06-08T03:49:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.318+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1fdc007470 con 0x7f1fec0cd930 2023-06-08T03:49:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.318+0000 7f1fdaffd700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1fcc06ace0 0x7f1fcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.319+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1fdc089510 con 0x7f1fec0cd930 2023-06-08T03:49:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.319+0000 7f1fea59c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1fcc06ace0 0x7f1fcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.319+0000 7f1fea59c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1fcc06ace0 0x7f1fcc06d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c900 tx=0x7f1fe0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:04.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.323+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1fec0ccf00 con 0x7f1fec0cd930 2023-06-08T03:49:04.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.522+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fec0ccf00 con 0x7f1fec0cd930 2023-06-08T03:49:04.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.523+0000 7f1fdaffd700 1 -- 172.21.15.43:0/2414397171 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f1fec0ccf00 con 0x7f1fec0cd930 2023-06-08T03:49:04.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:04.527 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:04.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1fcc06ace0 msgr2=0x7f1fcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1fcc06ace0 0x7f1fcc06d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c900 tx=0x7f1fe0008040 comp rx=0 tx=0).stop 2023-06-08T03:49:04.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 msgr2=0x7f1fec0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0cb6c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0011e0 tx=0x7f1fdc00cae0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 shutdown_connections 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1fcc06ace0 0x7f1fcc06d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fec159380 0x7f1fec152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1fec0b1dc0 0x7f1fec0c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 --2- 172.21.15.43:0/2414397171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fec0cd930 0x7f1fec0cb6c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 >> 172.21.15.43:0/2414397171 conn(0x7f1fec06aec0 msgr2=0x7f1fec0c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 shutdown_connections 2023-06-08T03:49:04.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.525+0000 7f1ff0c0c700 1 -- 172.21.15.43:0/2414397171 wait complete. 2023-06-08T03:49:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-08T03:49:04.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:49:04.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.662+0000 7f09c80d2700 1 Processor -- start 2023-06-08T03:49:04.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.662+0000 7f09c80d2700 1 -- start start 2023-06-08T03:49:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c80d2700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09c00af220 0x7f09c00ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c80d2700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00af050 con 0x7f09c006a4c0 2023-06-08T03:49:04.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c80d2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00af800 con 0x7f09c015c590 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c80d2700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00afae0 con 0x7f09c00af220 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c666f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09c00af220 0x7f09c00ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c566d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f09c006a4c0 0x7f09c00ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53178/0 (socket says 172.21.15.43:53178) 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c566d700 1 -- 172.21.15.43:0/3354611222 learned_addr learned my addr 172.21.15.43:0/3354611222 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c666f700 1 -- 172.21.15.43:0/3354611222 >> v1:172.21.15.135:6789/0 conn(0x7f09c015c590 legacy=0x7f09c0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c666f700 1 -- 172.21.15.43:0/3354611222 >> v1:172.21.15.43:6789/0 conn(0x7f09c006a4c0 legacy=0x7f09c00ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c666f700 1 -- 172.21.15.43:0/3354611222 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00cc0c0 con 0x7f09c00af220 2023-06-08T03:49:04.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c666f700 1 --2- 172.21.15.43:0/3354611222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c00ccba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009d90 tx=0x7f09b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d1474a99fc745d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:04.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c4e6c700 1 -- 172.21.15.43:0/3354611222 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800e070 con 0x7f09c00af220 2023-06-08T03:49:04.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c4e6c700 1 -- 172.21.15.43:0/3354611222 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b800bbd0 con 0x7f09c00af220 2023-06-08T03:49:04.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.663+0000 7f09c4e6c700 1 -- 172.21.15.43:0/3354611222 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8003a20 con 0x7f09c00af220 2023-06-08T03:49:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 -- 172.21.15.43:0/3354611222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 msgr2=0x7f09c00ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 --2- 172.21.15.43:0/3354611222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c00ccba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009d90 tx=0x7f09b800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:04.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 -- 172.21.15.43:0/3354611222 shutdown_connections 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 --2- 172.21.15.43:0/3354611222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c00ccba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 -- 172.21.15.43:0/3354611222 >> 172.21.15.43:0/3354611222 conn(0x7f09c006b7e0 msgr2=0x7f09c00cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 -- 172.21.15.43:0/3354611222 shutdown_connections 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.664+0000 7f09c80d2700 1 -- 172.21.15.43:0/3354611222 wait complete. 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.665+0000 7f09c80d2700 1 Processor -- start 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.665+0000 7f09c80d2700 1 -- start start 2023-06-08T03:49:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c80d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c006a4c0 0x7f09c00c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c80d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c80d2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015c590 0x7f09c00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c80d2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00af620 con 0x7f09c00af220 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c80d2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c4120 con 0x7f09c006a4c0 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c80d2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c015db30 con 0x7f09c015c590 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c015e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58282/0 (socket says 172.21.15.43:58282) 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 -- 172.21.15.43:0/1513443839 learned_addr learned my addr 172.21.15.43:0/1513443839 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c5e6e700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c006a4c0 0x7f09c00c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c666f700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015c590 0x7f09c00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 -- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015c590 msgr2=0x7f09c00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015c590 0x7f09c00ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 -- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c006a4c0 msgr2=0x7f09c00c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c006a4c0 0x7f09c00c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.666+0000 7f09c566d700 1 -- 172.21.15.43:0/1513443839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009a70 con 0x7f09c00af220 2023-06-08T03:49:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.667+0000 7f09c566d700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c015e1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c520 tx=0x7f09b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.667+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4005d70 con 0x7f09c00af220 2023-06-08T03:49:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.667+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40070d0 con 0x7f09c00af220 2023-06-08T03:49:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.667+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c0153030 con 0x7f09c00af220 2023-06-08T03:49:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.667+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4007440 con 0x7f09c00af220 2023-06-08T03:49:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.667+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c00c52b0 con 0x7f09c00af220 2023-06-08T03:49:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.668+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c0073fa0 con 0x7f09c00af220 2023-06-08T03:49:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.668+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09b40075a0 con 0x7f09c00af220 2023-06-08T03:49:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.669+0000 7f09b27fc700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f09a406ace0 0x7f09a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.669+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f09b4088b80 con 0x7f09c00af220 2023-06-08T03:49:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.669+0000 7f09c5e6e700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f09a406ace0 0x7f09a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.669+0000 7f09c5e6e700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f09a406ace0 0x7f09a406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09bc006fd0 tx=0x7f09bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.673+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09b40539f0 con 0x7f09c00af220 2023-06-08T03:49:04.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.865+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09c00cc680 con 0x7f09a406ace0 2023-06-08T03:49:04.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.877+0000 7f09b27fc700 1 -- 172.21.15.43:0/1513443839 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367507 (secure 0 0 0) 0x7f09bc0123e0 con 0x7f09a406ace0 2023-06-08T03:49:04.884 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f09a406ace0 msgr2=0x7f09a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f09a406ace0 0x7f09a406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09bc006fd0 tx=0x7f09bc008040 comp rx=0 tx=0).stop 2023-06-08T03:49:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 msgr2=0x7f09c015e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c015e1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c520 tx=0x7f09b400c8e0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 shutdown_connections 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f09a406ace0 0x7f09a406d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09c015c590 0x7f09c00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09c006a4c0 0x7f09c00c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 --2- 172.21.15.43:0/1513443839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c00af220 0x7f09c015e1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 >> 172.21.15.43:0/1513443839 conn(0x7f09c006b7e0 msgr2=0x7f09c006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 shutdown_connections 2023-06-08T03:49:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:04.880+0000 7f09c80d2700 1 -- 172.21.15.43:0/1513443839 wait complete. 2023-06-08T03:49:04.888 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:49:04.896 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-06-08T03:49:03.565935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594819,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":3383296,"data_stored":2064846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003592"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535614+0000","last_change":"2023-06-08T03:48:46.695933+0000","last_active":"2023-06-08T03:48:51.535614+0000","last_peered":"2023-06-08T03:48:51.535614+0000","last_clean":"2023-06-08T03:48:51.535614+0000","last_became_active":"2023-06-08T03:48:46.695656+0000","last_became_peered":"2023-06-08T03:48:46.695656+0000","last_unstale":"2023-06-08T03:48:51.535614+0000","last_undegraded":"2023-06-08T03:48:51.535614+0000","last_fullsized":"2023-06-08T03:48:51.535614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:30:50.250635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537474+0000","last_change":"2023-06-08T03:48:46.714866+0000","last_active":"2023-06-08T03:48:51.537474+0000","last_peered":"2023-06-08T03:48:51.537474+0000","last_clean":"2023-06-08T03:48:51.537474+0000","last_became_active":"2023-06-08T03:48:46.714589+0000","last_became_peered":"2023-06-08T03:48:46.714589+0000","last_unstale":"2023-06-08T03:48:51.537474+0000","last_undegraded":"2023-06-08T03:48:51.537474+0000","last_fullsized":"2023-06-08T03:48:51.537474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152613+0000","last_change":"2023-06-08T03:48:46.706256+0000","last_active":"2023-06-08T03:48:51.152613+0000","last_peered":"2023-06-08T03:48:51.152613+0000","last_clean":"2023-06-08T03:48:51.152613+0000","last_became_active":"2023-06-08T03:48:46.705978+0000","last_became_peered":"2023-06-08T03:48:46.705978+0000","last_unstale":"2023-06-08T03:48:51.152613+0000","last_undegraded":"2023-06-08T03:48:51.152613+0000","last_fullsized":"2023-06-08T03:48:51.152613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:22:14.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151950+0000","last_change":"2023-06-08T03:48:46.707135+0000","last_active":"2023-06-08T03:48:51.151950+0000","last_peered":"2023-06-08T03:48:51.151950+0000","last_clean":"2023-06-08T03:48:51.151950+0000","last_became_active":"2023-06-08T03:48:46.706761+0000","last_became_peered":"2023-06-08T03:48:46.706761+0000","last_unstale":"2023-06-08T03:48:51.151950+0000","last_undegraded":"2023-06-08T03:48:51.151950+0000","last_fullsized":"2023-06-08T03:48:51.151950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:56.493538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294344+0000","last_change":"2023-06-08T03:48:46.699911+0000","last_active":"2023-06-08T03:48:51.294344+0000","last_peered":"2023-06-08T03:48:51.294344+0000","last_clean":"2023-06-08T03:48:51.294344+0000","last_became_active":"2023-06-08T03:48:46.699664+0000","last_became_peered":"2023-06-08T03:48:46.699664+0000","last_unstale":"2023-06-08T03:48:51.294344+0000","last_undegraded":"2023-06-08T03:48:51.294344+0000","last_fullsized":"2023-06-08T03:48:51.294344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152397+0000","last_change":"2023-06-08T03:48:46.705516+0000","last_active":"2023-06-08T03:48:51.152397+0000","last_peered":"2023-06-08T03:48:51.152397+0000","last_clean":"2023-06-08T03:48:51.152397+0000","last_became_active":"2023-06-08T03:48:46.705065+0000","last_became_peered":"2023-06-08T03:48:46.705065+0000","last_unstale":"2023-06-08T03:48:51.152397+0000","last_undegraded":"2023-06-08T03:48:51.152397+0000","last_fullsized":"2023-06-08T03:48:51.152397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:14:12.765404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536130+0000","last_change":"2023-06-08T03:48:46.715167+0000","last_active":"2023-06-08T03:48:51.536130+0000","last_peered":"2023-06-08T03:48:51.536130+0000","last_clean":"2023-06-08T03:48:51.536130+0000","last_became_active":"2023-06-08T03:48:46.714516+0000","last_became_peered":"2023-06-08T03:48:46.714516+0000","last_unstale":"2023-06-08T03:48:51.536130+0000","last_undegraded":"2023-06-08T03:48:51.536130+0000","last_fullsized":"2023-06-08T03:48:51.536130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535554+0000","last_change":"2023-06-08T03:48:46.711469+0000","last_active":"2023-06-08T03:48:51.535554+0000","last_peered":"2023-06-08T03:48:51.535554+0000","last_clean":"2023-06-08T03:48:51.535554+0000","last_became_active":"2023-06-08T03:48:46.711192+0000","last_became_peered":"2023-06-08T03:48:46.711192+0000","last_unstale":"2023-06-08T03:48:51.535554+0000","last_undegraded":"2023-06-08T03:48:51.535554+0000","last_fullsized":"2023-06-08T03:48:51.535554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294108+0000","last_change":"2023-06-08T03:48:46.699402+0000","last_active":"2023-06-08T03:48:51.294108+0000","last_peered":"2023-06-08T03:48:51.294108+0000","last_clean":"2023-06-08T03:48:51.294108+0000","last_became_active":"2023-06-08T03:48:46.699147+0000","last_became_peered":"2023-06-08T03:48:46.699147+0000","last_unstale":"2023-06-08T03:48:51.294108+0000","last_undegraded":"2023-06-08T03:48:51.294108+0000","last_fullsized":"2023-06-08T03:48:51.294108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537669+0000","last_change":"2023-06-08T03:48:46.704142+0000","last_active":"2023-06-08T03:48:51.537669+0000","last_peered":"2023-06-08T03:48:51.537669+0000","last_clean":"2023-06-08T03:48:51.537669+0000","last_became_active":"2023-06-08T03:48:46.703834+0000","last_became_peered":"2023-06-08T03:48:46.703834+0000","last_unstale":"2023-06-08T03:48:51.537669+0000","last_undegraded":"2023-06-08T03:48:51.537669+0000","last_fullsized":"2023-06-08T03:48:51.537669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152529+0000","last_change":"2023-06-08T03:48:46.714056+0000","last_active":"2023-06-08T03:48:51.152529+0000","last_peered":"2023-06-08T03:48:51.152529+0000","last_clean":"2023-06-08T03:48:51.152529+0000","last_became_active":"2023-06-08T03:48:46.713591+0000","last_became_peered":"2023-06-08T03:48:46.713591+0000","last_unstale":"2023-06-08T03:48:51.152529+0000","last_undegraded":"2023-06-08T03:48:51.152529+0000","last_fullsized":"2023-06-08T03:48:51.152529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:27:27.515952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535329+0000","last_change":"2023-06-08T03:48:46.709172+0000","last_active":"2023-06-08T03:48:51.535329+0000","last_peered":"2023-06-08T03:48:51.535329+0000","last_clean":"2023-06-08T03:48:51.535329+0000","last_became_active":"2023-06-08T03:48:46.708965+0000","last_became_peered":"2023-06-08T03:48:46.708965+0000","last_unstale":"2023-06-08T03:48:51.535329+0000","last_undegraded":"2023-06-08T03:48:51.535329+0000","last_fullsized":"2023-06-08T03:48:51.535329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:08:38.733800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535191+0000","last_change":"2023-06-08T03:48:46.700006+0000","last_active":"2023-06-08T03:48:51.535191+0000","last_peered":"2023-06-08T03:48:51.535191+0000","last_clean":"2023-06-08T03:48:51.535191+0000","last_became_active":"2023-06-08T03:48:46.699757+0000","last_became_peered":"2023-06-08T03:48:46.699757+0000","last_unstale":"2023-06-08T03:48:51.535191+0000","last_undegraded":"2023-06-08T03:48:51.535191+0000","last_fullsized":"2023-06-08T03:48:51.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:03:26.492541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536448+0000","last_change":"2023-06-08T03:48:46.704941+0000","last_active":"2023-06-08T03:48:51.536448+0000","last_peered":"2023-06-08T03:48:51.536448+0000","last_clean":"2023-06-08T03:48:51.536448+0000","last_became_active":"2023-06-08T03:48:46.704597+0000","last_became_peered":"2023-06-08T03:48:46.704597+0000","last_unstale":"2023-06-08T03:48:51.536448+0000","last_undegraded":"2023-06-08T03:48:51.536448+0000","last_fullsized":"2023-06-08T03:48:51.536448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536330+0000","last_change":"2023-06-08T03:48:46.715344+0000","last_active":"2023-06-08T03:48:51.536330+0000","last_peered":"2023-06-08T03:48:51.536330+0000","last_clean":"2023-06-08T03:48:51.536330+0000","last_became_active":"2023-06-08T03:48:46.714900+0000","last_became_peered":"2023-06-08T03:48:46.714900+0000","last_unstale":"2023-06-08T03:48:51.536330+0000","last_undegraded":"2023-06-08T03:48:51.536330+0000","last_fullsized":"2023-06-08T03:48:51.536330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.706828+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.706509+0000","last_became_peered":"2023-06-08T03:48:46.706509+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:46.242079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294194+0000","last_change":"2023-06-08T03:48:46.695842+0000","last_active":"2023-06-08T03:48:51.294194+0000","last_peered":"2023-06-08T03:48:51.294194+0000","last_clean":"2023-06-08T03:48:51.294194+0000","last_became_active":"2023-06-08T03:48:46.695612+0000","last_became_peered":"2023-06-08T03:48:46.695612+0000","last_unstale":"2023-06-08T03:48:51.294194+0000","last_undegraded":"2023-06-08T03:48:51.294194+0000","last_fullsized":"2023-06-08T03:48:51.294194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:20:54.828539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152362+0000","last_change":"2023-06-08T03:48:46.697084+0000","last_active":"2023-06-08T03:48:51.152362+0000","last_peered":"2023-06-08T03:48:51.152362+0000","last_clean":"2023-06-08T03:48:51.152362+0000","last_became_active":"2023-06-08T03:48:46.696841+0000","last_became_peered":"2023-06-08T03:48:46.696841+0000","last_unstale":"2023-06-08T03:48:51.152362+0000","last_undegraded":"2023-06-08T03:48:51.152362+0000","last_fullsized":"2023-06-08T03:48:51.152362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:47.104870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535352+0000","last_change":"2023-06-08T03:48:46.707641+0000","last_active":"2023-06-08T03:48:51.535352+0000","last_peered":"2023-06-08T03:48:51.535352+0000","last_clean":"2023-06-08T03:48:51.535352+0000","last_became_active":"2023-06-08T03:48:46.707211+0000","last_became_peered":"2023-06-08T03:48:46.707211+0000","last_unstale":"2023-06-08T03:48:51.535352+0000","last_undegraded":"2023-06-08T03:48:51.535352+0000","last_fullsized":"2023-06-08T03:48:51.535352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:39.020693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151721+0000","last_change":"2023-06-08T03:48:46.709738+0000","last_active":"2023-06-08T03:48:51.151721+0000","last_peered":"2023-06-08T03:48:51.151721+0000","last_clean":"2023-06-08T03:48:51.151721+0000","last_became_active":"2023-06-08T03:48:46.709340+0000","last_became_peered":"2023-06-08T03:48:46.709340+0000","last_unstale":"2023-06-08T03:48:51.151721+0000","last_undegraded":"2023-06-08T03:48:51.151721+0000","last_fullsized":"2023-06-08T03:48:51.151721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:23.681916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536282+0000","last_change":"2023-06-08T03:48:46.709790+0000","last_active":"2023-06-08T03:48:51.536282+0000","last_peered":"2023-06-08T03:48:51.536282+0000","last_clean":"2023-06-08T03:48:51.536282+0000","last_became_active":"2023-06-08T03:48:46.709528+0000","last_became_peered":"2023-06-08T03:48:46.709528+0000","last_unstale":"2023-06-08T03:48:51.536282+0000","last_undegraded":"2023-06-08T03:48:51.536282+0000","last_fullsized":"2023-06-08T03:48:51.536282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:53.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293720+0000","last_change":"2023-06-08T03:48:46.712267+0000","last_active":"2023-06-08T03:48:51.293720+0000","last_peered":"2023-06-08T03:48:51.293720+0000","last_clean":"2023-06-08T03:48:51.293720+0000","last_became_active":"2023-06-08T03:48:46.712008+0000","last_became_peered":"2023-06-08T03:48:46.712008+0000","last_unstale":"2023-06-08T03:48:51.293720+0000","last_undegraded":"2023-06-08T03:48:51.293720+0000","last_fullsized":"2023-06-08T03:48:51.293720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:15.552998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149899+0000","last_change":"2023-06-08T03:48:46.699795+0000","last_active":"2023-06-08T03:48:51.149899+0000","last_peered":"2023-06-08T03:48:51.149899+0000","last_clean":"2023-06-08T03:48:51.149899+0000","last_became_active":"2023-06-08T03:48:46.699537+0000","last_became_peered":"2023-06-08T03:48:46.699537+0000","last_unstale":"2023-06-08T03:48:51.149899+0000","last_undegraded":"2023-06-08T03:48:51.149899+0000","last_fullsized":"2023-06-08T03:48:51.149899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535864+0000","last_change":"2023-06-08T03:48:46.710846+0000","last_active":"2023-06-08T03:48:51.535864+0000","last_peered":"2023-06-08T03:48:51.535864+0000","last_clean":"2023-06-08T03:48:51.535864+0000","last_became_active":"2023-06-08T03:48:46.710550+0000","last_became_peered":"2023-06-08T03:48:46.710550+0000","last_unstale":"2023-06-08T03:48:51.535864+0000","last_undegraded":"2023-06-08T03:48:51.535864+0000","last_fullsized":"2023-06-08T03:48:51.535864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297076+0000","last_change":"2023-06-08T03:48:46.713844+0000","last_active":"2023-06-08T03:48:51.297076+0000","last_peered":"2023-06-08T03:48:51.297076+0000","last_clean":"2023-06-08T03:48:51.297076+0000","last_became_active":"2023-06-08T03:48:46.713550+0000","last_became_peered":"2023-06-08T03:48:46.713550+0000","last_unstale":"2023-06-08T03:48:51.297076+0000","last_undegraded":"2023-06-08T03:48:51.297076+0000","last_fullsized":"2023-06-08T03:48:51.297076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:06.159783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296797+0000","last_change":"2023-06-08T03:48:46.711918+0000","last_active":"2023-06-08T03:48:51.296797+0000","last_peered":"2023-06-08T03:48:51.296797+0000","last_clean":"2023-06-08T03:48:51.296797+0000","last_became_active":"2023-06-08T03:48:46.711662+0000","last_became_peered":"2023-06-08T03:48:46.711662+0000","last_unstale":"2023-06-08T03:48:51.296797+0000","last_undegraded":"2023-06-08T03:48:51.296797+0000","last_fullsized":"2023-06-08T03:48:51.296797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:40.934017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537069+0000","last_change":"2023-06-08T03:48:46.708436+0000","last_active":"2023-06-08T03:48:51.537069+0000","last_peered":"2023-06-08T03:48:51.537069+0000","last_clean":"2023-06-08T03:48:51.537069+0000","last_became_active":"2023-06-08T03:48:46.708003+0000","last_became_peered":"2023-06-08T03:48:46.708003+0000","last_unstale":"2023-06-08T03:48:51.537069+0000","last_undegraded":"2023-06-08T03:48:51.537069+0000","last_fullsized":"2023-06-08T03:48:51.537069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:33.522665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152308+0000","last_change":"2023-06-08T03:48:50.740643+0000","last_active":"2023-06-08T03:48:51.152308+0000","last_peered":"2023-06-08T03:48:51.152308+0000","last_clean":"2023-06-08T03:48:51.152308+0000","last_became_active":"2023-06-08T03:48:50.740283+0000","last_became_peered":"2023-06-08T03:48:50.740283+0000","last_unstale":"2023-06-08T03:48:51.152308+0000","last_undegraded":"2023-06-08T03:48:51.152308+0000","last_fullsized":"2023-06-08T03:48:51.152308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:09:55.615848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152091+0000","last_change":"2023-06-08T03:48:46.278224+0000","last_active":"2023-06-08T03:48:51.152091+0000","last_peered":"2023-06-08T03:48:51.152091+0000","last_clean":"2023-06-08T03:48:51.152091+0000","last_became_active":"2023-06-08T03:48:46.277952+0000","last_became_peered":"2023-06-08T03:48:46.277952+0000","last_unstale":"2023-06-08T03:48:51.152091+0000","last_undegraded":"2023-06-08T03:48:51.152091+0000","last_fullsized":"2023-06-08T03:48:51.152091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:10:42.875919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150566+0000","last_change":"2023-06-08T03:48:46.712050+0000","last_active":"2023-06-08T03:48:51.150566+0000","last_peered":"2023-06-08T03:48:51.150566+0000","last_clean":"2023-06-08T03:48:51.150566+0000","last_became_active":"2023-06-08T03:48:46.711791+0000","last_became_peered":"2023-06-08T03:48:46.711791+0000","last_unstale":"2023-06-08T03:48:51.150566+0000","last_undegraded":"2023-06-08T03:48:51.150566+0000","last_fullsized":"2023-06-08T03:48:51.150566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:48.552832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151606+0000","last_change":"2023-06-08T03:48:50.739355+0000","last_active":"2023-06-08T03:48:51.151606+0000","last_peered":"2023-06-08T03:48:51.151606+0000","last_clean":"2023-06-08T03:48:51.151606+0000","last_became_active":"2023-06-08T03:48:50.738867+0000","last_became_peered":"2023-06-08T03:48:50.738867+0000","last_unstale":"2023-06-08T03:48:51.151606+0000","last_undegraded":"2023-06-08T03:48:51.151606+0000","last_fullsized":"2023-06-08T03:48:51.151606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:39.206726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296216+0000","last_change":"2023-06-08T03:48:46.277487+0000","last_active":"2023-06-08T03:48:51.296216+0000","last_peered":"2023-06-08T03:48:51.296216+0000","last_clean":"2023-06-08T03:48:51.296216+0000","last_became_active":"2023-06-08T03:48:46.277147+0000","last_became_peered":"2023-06-08T03:48:46.277147+0000","last_unstale":"2023-06-08T03:48:51.296216+0000","last_undegraded":"2023-06-08T03:48:51.296216+0000","last_fullsized":"2023-06-08T03:48:51.296216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:15.249130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294014+0000","last_change":"2023-06-08T03:48:46.698321+0000","last_active":"2023-06-08T03:48:51.294014+0000","last_peered":"2023-06-08T03:48:51.294014+0000","last_clean":"2023-06-08T03:48:51.294014+0000","last_became_active":"2023-06-08T03:48:46.698051+0000","last_became_peered":"2023-06-08T03:48:46.698051+0000","last_unstale":"2023-06-08T03:48:51.294014+0000","last_undegraded":"2023-06-08T03:48:51.294014+0000","last_fullsized":"2023-06-08T03:48:51.294014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294220+0000","last_change":"2023-06-08T03:48:50.747722+0000","last_active":"2023-06-08T03:48:51.294220+0000","last_peered":"2023-06-08T03:48:51.294220+0000","last_clean":"2023-06-08T03:48:51.294220+0000","last_became_active":"2023-06-08T03:48:50.747297+0000","last_became_peered":"2023-06-08T03:48:50.747297+0000","last_unstale":"2023-06-08T03:48:51.294220+0000","last_undegraded":"2023-06-08T03:48:51.294220+0000","last_fullsized":"2023-06-08T03:48:51.294220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:08:44.335450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150061+0000","last_change":"2023-06-08T03:48:46.276409+0000","last_active":"2023-06-08T03:48:51.150061+0000","last_peered":"2023-06-08T03:48:51.150061+0000","last_clean":"2023-06-08T03:48:51.150061+0000","last_became_active":"2023-06-08T03:48:46.276099+0000","last_became_peered":"2023-06-08T03:48:46.276099+0000","last_unstale":"2023-06-08T03:48:51.150061+0000","last_undegraded":"2023-06-08T03:48:51.150061+0000","last_fullsized":"2023-06-08T03:48:51.150061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:32.517367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151843+0000","last_change":"2023-06-08T03:48:46.707301+0000","last_active":"2023-06-08T03:48:51.151843+0000","last_peered":"2023-06-08T03:48:51.151843+0000","last_clean":"2023-06-08T03:48:51.151843+0000","last_became_active":"2023-06-08T03:48:46.706988+0000","last_became_peered":"2023-06-08T03:48:46.706988+0000","last_unstale":"2023-06-08T03:48:51.151843+0000","last_undegraded":"2023-06-08T03:48:51.151843+0000","last_fullsized":"2023-06-08T03:48:51.151843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151210+0000","last_change":"2023-06-08T03:48:50.741708+0000","last_active":"2023-06-08T03:48:51.151210+0000","last_peered":"2023-06-08T03:48:51.151210+0000","last_clean":"2023-06-08T03:48:51.151210+0000","last_became_active":"2023-06-08T03:48:50.741299+0000","last_became_peered":"2023-06-08T03:48:50.741299+0000","last_unstale":"2023-06-08T03:48:51.151210+0000","last_undegraded":"2023-06-08T03:48:51.151210+0000","last_fullsized":"2023-06-08T03:48:51.151210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:13:01.589674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294322+0000","last_change":"2023-06-08T03:48:46.281457+0000","last_active":"2023-06-08T03:48:51.294322+0000","last_peered":"2023-06-08T03:48:51.294322+0000","last_clean":"2023-06-08T03:48:51.294322+0000","last_became_active":"2023-06-08T03:48:46.279939+0000","last_became_peered":"2023-06-08T03:48:46.279939+0000","last_unstale":"2023-06-08T03:48:51.294322+0000","last_undegraded":"2023-06-08T03:48:51.294322+0000","last_fullsized":"2023-06-08T03:48:51.294322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149914+0000","last_change":"2023-06-08T03:48:46.712616+0000","last_active":"2023-06-08T03:48:51.149914+0000","last_peered":"2023-06-08T03:48:51.149914+0000","last_clean":"2023-06-08T03:48:51.149914+0000","last_became_active":"2023-06-08T03:48:46.712276+0000","last_became_peered":"2023-06-08T03:48:46.712276+0000","last_unstale":"2023-06-08T03:48:51.149914+0000","last_undegraded":"2023-06-08T03:48:51.149914+0000","last_fullsized":"2023-06-08T03:48:51.149914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:01.718524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535551+0000","last_change":"2023-06-08T03:48:50.740006+0000","last_active":"2023-06-08T03:48:51.535551+0000","last_peered":"2023-06-08T03:48:51.535551+0000","last_clean":"2023-06-08T03:48:51.535551+0000","last_became_active":"2023-06-08T03:48:50.739564+0000","last_became_peered":"2023-06-08T03:48:50.739564+0000","last_unstale":"2023-06-08T03:48:51.535551+0000","last_undegraded":"2023-06-08T03:48:51.535551+0000","last_fullsized":"2023-06-08T03:48:51.535551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:05.176785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537564+0000","last_change":"2023-06-08T03:48:46.280740+0000","last_active":"2023-06-08T03:48:51.537564+0000","last_peered":"2023-06-08T03:48:51.537564+0000","last_clean":"2023-06-08T03:48:51.537564+0000","last_became_active":"2023-06-08T03:48:46.280343+0000","last_became_peered":"2023-06-08T03:48:46.280343+0000","last_unstale":"2023-06-08T03:48:51.537564+0000","last_undegraded":"2023-06-08T03:48:51.537564+0000","last_fullsized":"2023-06-08T03:48:51.537564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:52.150651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149747+0000","last_change":"2023-06-08T03:48:46.705918+0000","last_active":"2023-06-08T03:48:51.149747+0000","last_peered":"2023-06-08T03:48:51.149747+0000","last_clean":"2023-06-08T03:48:51.149747+0000","last_became_active":"2023-06-08T03:48:46.704743+0000","last_became_peered":"2023-06-08T03:48:46.704743+0000","last_unstale":"2023-06-08T03:48:51.149747+0000","last_undegraded":"2023-06-08T03:48:51.149747+0000","last_fullsized":"2023-06-08T03:48:51.149747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:45:00.911565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150382+0000","last_change":"2023-06-08T03:48:50.743251+0000","last_active":"2023-06-08T03:48:51.150382+0000","last_peered":"2023-06-08T03:48:51.150382+0000","last_clean":"2023-06-08T03:48:51.150382+0000","last_became_active":"2023-06-08T03:48:50.742850+0000","last_became_peered":"2023-06-08T03:48:50.742850+0000","last_unstale":"2023-06-08T03:48:51.150382+0000","last_undegraded":"2023-06-08T03:48:51.150382+0000","last_fullsized":"2023-06-08T03:48:51.150382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:16.576491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536288+0000","last_change":"2023-06-08T03:48:46.278683+0000","last_active":"2023-06-08T03:48:51.536288+0000","last_peered":"2023-06-08T03:48:51.536288+0000","last_clean":"2023-06-08T03:48:51.536288+0000","last_became_active":"2023-06-08T03:48:46.278372+0000","last_became_peered":"2023-06-08T03:48:46.278372+0000","last_unstale":"2023-06-08T03:48:51.536288+0000","last_undegraded":"2023-06-08T03:48:51.536288+0000","last_fullsized":"2023-06-08T03:48:51.536288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:07.547618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296438+0000","last_change":"2023-06-08T03:48:46.712049+0000","last_active":"2023-06-08T03:48:51.296438+0000","last_peered":"2023-06-08T03:48:51.296438+0000","last_clean":"2023-06-08T03:48:51.296438+0000","last_became_active":"2023-06-08T03:48:46.711788+0000","last_became_peered":"2023-06-08T03:48:46.711788+0000","last_unstale":"2023-06-08T03:48:51.296438+0000","last_undegraded":"2023-06-08T03:48:51.296438+0000","last_fullsized":"2023-06-08T03:48:51.296438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296638+0000","last_change":"2023-06-08T03:48:50.741729+0000","last_active":"2023-06-08T03:48:51.296638+0000","last_peered":"2023-06-08T03:48:51.296638+0000","last_clean":"2023-06-08T03:48:51.296638+0000","last_became_active":"2023-06-08T03:48:50.741267+0000","last_became_peered":"2023-06-08T03:48:50.741267+0000","last_unstale":"2023-06-08T03:48:51.296638+0000","last_undegraded":"2023-06-08T03:48:51.296638+0000","last_fullsized":"2023-06-08T03:48:51.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:55.520331+0000","last_change":"2023-06-08T03:48:46.279495+0000","last_active":"2023-06-08T03:48:55.520331+0000","last_peered":"2023-06-08T03:48:55.520331+0000","last_clean":"2023-06-08T03:48:55.520331+0000","last_became_active":"2023-06-08T03:48:46.279119+0000","last_became_peered":"2023-06-08T03:48:46.279119+0000","last_unstale":"2023-06-08T03:48:55.520331+0000","last_undegraded":"2023-06-08T03:48:55.520331+0000","last_fullsized":"2023-06-08T03:48:55.520331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:02.149567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152693+0000","last_change":"2023-06-08T03:48:46.708107+0000","last_active":"2023-06-08T03:48:51.152693+0000","last_peered":"2023-06-08T03:48:51.152693+0000","last_clean":"2023-06-08T03:48:51.152693+0000","last_became_active":"2023-06-08T03:48:46.707899+0000","last_became_peered":"2023-06-08T03:48:46.707899+0000","last_unstale":"2023-06-08T03:48:51.152693+0000","last_undegraded":"2023-06-08T03:48:51.152693+0000","last_fullsized":"2023-06-08T03:48:51.152693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:39:42.981044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537245+0000","last_change":"2023-06-08T03:48:50.745708+0000","last_active":"2023-06-08T03:48:51.537245+0000","last_peered":"2023-06-08T03:48:51.537245+0000","last_clean":"2023-06-08T03:48:51.537245+0000","last_became_active":"2023-06-08T03:48:50.742554+0000","last_became_peered":"2023-06-08T03:48:50.742554+0000","last_unstale":"2023-06-08T03:48:51.537245+0000","last_undegraded":"2023-06-08T03:48:51.537245+0000","last_fullsized":"2023-06-08T03:48:51.537245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:39.476075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535988+0000","last_change":"2023-06-08T03:48:46.285246+0000","last_active":"2023-06-08T03:48:51.535988+0000","last_peered":"2023-06-08T03:48:51.535988+0000","last_clean":"2023-06-08T03:48:51.535988+0000","last_became_active":"2023-06-08T03:48:46.284966+0000","last_became_peered":"2023-06-08T03:48:46.284966+0000","last_unstale":"2023-06-08T03:48:51.535988+0000","last_undegraded":"2023-06-08T03:48:51.535988+0000","last_fullsized":"2023-06-08T03:48:51.535988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150409+0000","last_change":"2023-06-08T03:48:46.716123+0000","last_active":"2023-06-08T03:48:51.150409+0000","last_peered":"2023-06-08T03:48:51.150409+0000","last_clean":"2023-06-08T03:48:51.150409+0000","last_became_active":"2023-06-08T03:48:46.715806+0000","last_became_peered":"2023-06-08T03:48:46.715806+0000","last_unstale":"2023-06-08T03:48:51.150409+0000","last_undegraded":"2023-06-08T03:48:51.150409+0000","last_fullsized":"2023-06-08T03:48:51.150409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150674+0000","last_change":"2023-06-08T03:48:50.742064+0000","last_active":"2023-06-08T03:48:51.150674+0000","last_peered":"2023-06-08T03:48:51.150674+0000","last_clean":"2023-06-08T03:48:51.150674+0000","last_became_active":"2023-06-08T03:48:50.741695+0000","last_became_peered":"2023-06-08T03:48:50.741695+0000","last_unstale":"2023-06-08T03:48:51.150674+0000","last_undegraded":"2023-06-08T03:48:51.150674+0000","last_fullsized":"2023-06-08T03:48:51.150674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:07.233826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294053+0000","last_change":"2023-06-08T03:48:46.278885+0000","last_active":"2023-06-08T03:48:51.294053+0000","last_peered":"2023-06-08T03:48:51.294053+0000","last_clean":"2023-06-08T03:48:51.294053+0000","last_became_active":"2023-06-08T03:48:46.278561+0000","last_became_peered":"2023-06-08T03:48:46.278561+0000","last_unstale":"2023-06-08T03:48:51.294053+0000","last_undegraded":"2023-06-08T03:48:51.294053+0000","last_fullsized":"2023-06-08T03:48:51.294053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:06:31.293995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537077+0000","last_change":"2023-06-08T03:48:46.708244+0000","last_active":"2023-06-08T03:48:51.537077+0000","last_peered":"2023-06-08T03:48:51.537077+0000","last_clean":"2023-06-08T03:48:51.537077+0000","last_became_active":"2023-06-08T03:48:46.707643+0000","last_became_peered":"2023-06-08T03:48:46.707643+0000","last_unstale":"2023-06-08T03:48:51.537077+0000","last_undegraded":"2023-06-08T03:48:51.537077+0000","last_fullsized":"2023-06-08T03:48:51.537077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150661+0000","last_change":"2023-06-08T03:48:50.745965+0000","last_active":"2023-06-08T03:48:51.150661+0000","last_peered":"2023-06-08T03:48:51.150661+0000","last_clean":"2023-06-08T03:48:51.150661+0000","last_became_active":"2023-06-08T03:48:50.745561+0000","last_became_peered":"2023-06-08T03:48:50.745561+0000","last_unstale":"2023-06-08T03:48:51.150661+0000","last_undegraded":"2023-06-08T03:48:51.150661+0000","last_fullsized":"2023-06-08T03:48:51.150661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:37.313561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535839+0000","last_change":"2023-06-08T03:48:46.284576+0000","last_active":"2023-06-08T03:48:51.535839+0000","last_peered":"2023-06-08T03:48:51.535839+0000","last_clean":"2023-06-08T03:48:51.535839+0000","last_became_active":"2023-06-08T03:48:46.284324+0000","last_became_peered":"2023-06-08T03:48:46.284324+0000","last_unstale":"2023-06-08T03:48:51.535839+0000","last_undegraded":"2023-06-08T03:48:51.535839+0000","last_fullsized":"2023-06-08T03:48:51.535839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294519+0000","last_change":"2023-06-08T03:48:46.699501+0000","last_active":"2023-06-08T03:48:51.294519+0000","last_peered":"2023-06-08T03:48:51.294519+0000","last_clean":"2023-06-08T03:48:51.294519+0000","last_became_active":"2023-06-08T03:48:46.699227+0000","last_became_peered":"2023-06-08T03:48:46.699227+0000","last_unstale":"2023-06-08T03:48:51.294519+0000","last_undegraded":"2023-06-08T03:48:51.294519+0000","last_fullsized":"2023-06-08T03:48:51.294519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536807+0000","last_change":"2023-06-08T03:48:50.752340+0000","last_active":"2023-06-08T03:48:51.536807+0000","last_peered":"2023-06-08T03:48:51.536807+0000","last_clean":"2023-06-08T03:48:51.536807+0000","last_became_active":"2023-06-08T03:48:50.751962+0000","last_became_peered":"2023-06-08T03:48:50.751962+0000","last_unstale":"2023-06-08T03:48:51.536807+0000","last_undegraded":"2023-06-08T03:48:51.536807+0000","last_fullsized":"2023-06-08T03:48:51.536807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:48.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151454+0000","last_change":"2023-06-08T03:48:46.274849+0000","last_active":"2023-06-08T03:48:51.151454+0000","last_peered":"2023-06-08T03:48:51.151454+0000","last_clean":"2023-06-08T03:48:51.151454+0000","last_became_active":"2023-06-08T03:48:46.274502+0000","last_became_peered":"2023-06-08T03:48:46.274502+0000","last_unstale":"2023-06-08T03:48:51.151454+0000","last_undegraded":"2023-06-08T03:48:51.151454+0000","last_fullsized":"2023-06-08T03:48:51.151454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:22:56.444477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150868+0000","last_change":"2023-06-08T03:48:46.704969+0000","last_active":"2023-06-08T03:48:51.150868+0000","last_peered":"2023-06-08T03:48:51.150868+0000","last_clean":"2023-06-08T03:48:51.150868+0000","last_became_active":"2023-06-08T03:48:46.704688+0000","last_became_peered":"2023-06-08T03:48:46.704688+0000","last_unstale":"2023-06-08T03:48:51.150868+0000","last_undegraded":"2023-06-08T03:48:51.150868+0000","last_fullsized":"2023-06-08T03:48:51.150868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:03.154866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536425+0000","last_change":"2023-06-08T03:48:50.751168+0000","last_active":"2023-06-08T03:48:51.536425+0000","last_peered":"2023-06-08T03:48:51.536425+0000","last_clean":"2023-06-08T03:48:51.536425+0000","last_became_active":"2023-06-08T03:48:50.750781+0000","last_became_peered":"2023-06-08T03:48:50.750781+0000","last_unstale":"2023-06-08T03:48:51.536425+0000","last_undegraded":"2023-06-08T03:48:51.536425+0000","last_fullsized":"2023-06-08T03:48:51.536425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:59.334663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536464+0000","last_change":"2023-06-08T03:48:46.284225+0000","last_active":"2023-06-08T03:48:51.536464+0000","last_peered":"2023-06-08T03:48:51.536464+0000","last_clean":"2023-06-08T03:48:51.536464+0000","last_became_active":"2023-06-08T03:48:46.283964+0000","last_became_peered":"2023-06-08T03:48:46.283964+0000","last_unstale":"2023-06-08T03:48:51.536464+0000","last_undegraded":"2023-06-08T03:48:51.536464+0000","last_fullsized":"2023-06-08T03:48:51.536464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:02.770266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535467+0000","last_change":"2023-06-08T03:48:46.705264+0000","last_active":"2023-06-08T03:48:51.535467+0000","last_peered":"2023-06-08T03:48:51.535467+0000","last_clean":"2023-06-08T03:48:51.535467+0000","last_became_active":"2023-06-08T03:48:46.704968+0000","last_became_peered":"2023-06-08T03:48:46.704968+0000","last_unstale":"2023-06-08T03:48:51.535467+0000","last_undegraded":"2023-06-08T03:48:51.535467+0000","last_fullsized":"2023-06-08T03:48:51.535467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:19.849225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535037+0000","last_change":"2023-06-08T03:48:50.747984+0000","last_active":"2023-06-08T03:48:51.535037+0000","last_peered":"2023-06-08T03:48:51.535037+0000","last_clean":"2023-06-08T03:48:51.535037+0000","last_became_active":"2023-06-08T03:48:50.747678+0000","last_became_peered":"2023-06-08T03:48:50.747678+0000","last_unstale":"2023-06-08T03:48:51.535037+0000","last_undegraded":"2023-06-08T03:48:51.535037+0000","last_fullsized":"2023-06-08T03:48:51.535037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:20:02.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536442+0000","last_change":"2023-06-08T03:48:46.284040+0000","last_active":"2023-06-08T03:48:51.536442+0000","last_peered":"2023-06-08T03:48:51.536442+0000","last_clean":"2023-06-08T03:48:51.536442+0000","last_became_active":"2023-06-08T03:48:46.283769+0000","last_became_peered":"2023-06-08T03:48:46.283769+0000","last_unstale":"2023-06-08T03:48:51.536442+0000","last_undegraded":"2023-06-08T03:48:51.536442+0000","last_fullsized":"2023-06-08T03:48:51.536442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:32.850002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151726+0000","last_change":"2023-06-08T03:48:46.714226+0000","last_active":"2023-06-08T03:48:51.151726+0000","last_peered":"2023-06-08T03:48:51.151726+0000","last_clean":"2023-06-08T03:48:51.151726+0000","last_became_active":"2023-06-08T03:48:46.713960+0000","last_became_peered":"2023-06-08T03:48:46.713960+0000","last_unstale":"2023-06-08T03:48:51.151726+0000","last_undegraded":"2023-06-08T03:48:51.151726+0000","last_fullsized":"2023-06-08T03:48:51.151726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:27:56.879349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535261+0000","last_change":"2023-06-08T03:48:50.746373+0000","last_active":"2023-06-08T03:48:51.535261+0000","last_peered":"2023-06-08T03:48:51.535261+0000","last_clean":"2023-06-08T03:48:51.535261+0000","last_became_active":"2023-06-08T03:48:50.745785+0000","last_became_peered":"2023-06-08T03:48:50.745785+0000","last_unstale":"2023-06-08T03:48:51.535261+0000","last_undegraded":"2023-06-08T03:48:51.535261+0000","last_fullsized":"2023-06-08T03:48:51.535261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:46:48.225879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536088+0000","last_change":"2023-06-08T03:48:46.280813+0000","last_active":"2023-06-08T03:48:51.536088+0000","last_peered":"2023-06-08T03:48:51.536088+0000","last_clean":"2023-06-08T03:48:51.536088+0000","last_became_active":"2023-06-08T03:48:46.280534+0000","last_became_peered":"2023-06-08T03:48:46.280534+0000","last_unstale":"2023-06-08T03:48:51.536088+0000","last_undegraded":"2023-06-08T03:48:51.536088+0000","last_fullsized":"2023-06-08T03:48:51.536088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:41.910566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152106+0000","last_change":"2023-06-08T03:48:46.716189+0000","last_active":"2023-06-08T03:48:51.152106+0000","last_peered":"2023-06-08T03:48:51.152106+0000","last_clean":"2023-06-08T03:48:51.152106+0000","last_became_active":"2023-06-08T03:48:46.715886+0000","last_became_peered":"2023-06-08T03:48:46.715886+0000","last_unstale":"2023-06-08T03:48:51.152106+0000","last_undegraded":"2023-06-08T03:48:51.152106+0000","last_fullsized":"2023-06-08T03:48:51.152106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.739296+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.738841+0000","last_became_peered":"2023-06-08T03:48:50.738841+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:50.270846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536854+0000","last_change":"2023-06-08T03:48:46.279229+0000","last_active":"2023-06-08T03:48:51.536854+0000","last_peered":"2023-06-08T03:48:51.536854+0000","last_clean":"2023-06-08T03:48:51.536854+0000","last_became_active":"2023-06-08T03:48:46.278915+0000","last_became_peered":"2023-06-08T03:48:46.278915+0000","last_unstale":"2023-06-08T03:48:51.536854+0000","last_undegraded":"2023-06-08T03:48:51.536854+0000","last_fullsized":"2023-06-08T03:48:51.536854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294432+0000","last_change":"2023-06-08T03:48:46.712160+0000","last_active":"2023-06-08T03:48:51.294432+0000","last_peered":"2023-06-08T03:48:51.294432+0000","last_clean":"2023-06-08T03:48:51.294432+0000","last_became_active":"2023-06-08T03:48:46.711866+0000","last_became_peered":"2023-06-08T03:48:46.711866+0000","last_unstale":"2023-06-08T03:48:51.294432+0000","last_undegraded":"2023-06-08T03:48:51.294432+0000","last_fullsized":"2023-06-08T03:48:51.294432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.746274+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.745820+0000","last_became_peered":"2023-06-08T03:48:50.745820+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:59:19.751648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150205+0000","last_change":"2023-06-08T03:48:46.276528+0000","last_active":"2023-06-08T03:48:51.150205+0000","last_peered":"2023-06-08T03:48:51.150205+0000","last_clean":"2023-06-08T03:48:51.150205+0000","last_became_active":"2023-06-08T03:48:46.276141+0000","last_became_peered":"2023-06-08T03:48:46.276141+0000","last_unstale":"2023-06-08T03:48:51.150205+0000","last_undegraded":"2023-06-08T03:48:51.150205+0000","last_fullsized":"2023-06-08T03:48:51.150205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:35.012515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151420+0000","last_change":"2023-06-08T03:48:46.709069+0000","last_active":"2023-06-08T03:48:51.151420+0000","last_peered":"2023-06-08T03:48:51.151420+0000","last_clean":"2023-06-08T03:48:51.151420+0000","last_became_active":"2023-06-08T03:48:46.708427+0000","last_became_peered":"2023-06-08T03:48:46.708427+0000","last_unstale":"2023-06-08T03:48:51.151420+0000","last_undegraded":"2023-06-08T03:48:51.151420+0000","last_fullsized":"2023-06-08T03:48:51.151420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:33.855300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296822+0000","last_change":"2023-06-08T03:48:50.744633+0000","last_active":"2023-06-08T03:48:51.296822+0000","last_peered":"2023-06-08T03:48:51.296822+0000","last_clean":"2023-06-08T03:48:51.296822+0000","last_became_active":"2023-06-08T03:48:50.744230+0000","last_became_peered":"2023-06-08T03:48:50.744230+0000","last_unstale":"2023-06-08T03:48:51.296822+0000","last_undegraded":"2023-06-08T03:48:51.296822+0000","last_fullsized":"2023-06-08T03:48:51.296822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:04.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152143+0000","last_change":"2023-06-08T03:48:46.277921+0000","last_active":"2023-06-08T03:48:51.152143+0000","last_peered":"2023-06-08T03:48:51.152143+0000","last_clean":"2023-06-08T03:48:51.152143+0000","last_became_active":"2023-06-08T03:48:46.277634+0000","last_became_peered":"2023-06-08T03:48:46.277634+0000","last_unstale":"2023-06-08T03:48:51.152143+0000","last_undegraded":"2023-06-08T03:48:51.152143+0000","last_fullsized":"2023-06-08T03:48:51.152143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:20.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152053+0000","last_change":"2023-06-08T03:48:46.706196+0000","last_active":"2023-06-08T03:48:51.152053+0000","last_peered":"2023-06-08T03:48:51.152053+0000","last_clean":"2023-06-08T03:48:51.152053+0000","last_became_active":"2023-06-08T03:48:46.705906+0000","last_became_peered":"2023-06-08T03:48:46.705906+0000","last_unstale":"2023-06-08T03:48:51.152053+0000","last_undegraded":"2023-06-08T03:48:51.152053+0000","last_fullsized":"2023-06-08T03:48:51.152053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:02:18.561814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537144+0000","last_change":"2023-06-08T03:48:50.747319+0000","last_active":"2023-06-08T03:48:51.537144+0000","last_peered":"2023-06-08T03:48:51.537144+0000","last_clean":"2023-06-08T03:48:51.537144+0000","last_became_active":"2023-06-08T03:48:50.746943+0000","last_became_peered":"2023-06-08T03:48:50.746943+0000","last_unstale":"2023-06-08T03:48:51.537144+0000","last_undegraded":"2023-06-08T03:48:51.537144+0000","last_fullsized":"2023-06-08T03:48:51.537144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:46.374125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151194+0000","last_change":"2023-06-08T03:48:46.277755+0000","last_active":"2023-06-08T03:48:51.151194+0000","last_peered":"2023-06-08T03:48:51.151194+0000","last_clean":"2023-06-08T03:48:51.151194+0000","last_became_active":"2023-06-08T03:48:46.277421+0000","last_became_peered":"2023-06-08T03:48:46.277421+0000","last_unstale":"2023-06-08T03:48:51.151194+0000","last_undegraded":"2023-06-08T03:48:51.151194+0000","last_fullsized":"2023-06-08T03:48:51.151194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.153481+0000","last_change":"2023-06-08T03:48:46.708084+0000","last_active":"2023-06-08T03:48:51.153481+0000","last_peered":"2023-06-08T03:48:51.153481+0000","last_clean":"2023-06-08T03:48:51.153481+0000","last_became_active":"2023-06-08T03:48:46.707810+0000","last_became_peered":"2023-06-08T03:48:46.707810+0000","last_unstale":"2023-06-08T03:48:51.153481+0000","last_undegraded":"2023-06-08T03:48:51.153481+0000","last_fullsized":"2023-06-08T03:48:51.153481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:42:31.285512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151893+0000","last_change":"2023-06-08T03:48:50.746365+0000","last_active":"2023-06-08T03:48:51.151893+0000","last_peered":"2023-06-08T03:48:51.151893+0000","last_clean":"2023-06-08T03:48:51.151893+0000","last_became_active":"2023-06-08T03:48:50.745965+0000","last_became_peered":"2023-06-08T03:48:50.745965+0000","last_unstale":"2023-06-08T03:48:51.151893+0000","last_undegraded":"2023-06-08T03:48:51.151893+0000","last_fullsized":"2023-06-08T03:48:51.151893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:50:52.715702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149902+0000","last_change":"2023-06-08T03:48:46.281571+0000","last_active":"2023-06-08T03:48:51.149902+0000","last_peered":"2023-06-08T03:48:51.149902+0000","last_clean":"2023-06-08T03:48:51.149902+0000","last_became_active":"2023-06-08T03:48:46.281171+0000","last_became_peered":"2023-06-08T03:48:46.281171+0000","last_unstale":"2023-06-08T03:48:51.149902+0000","last_undegraded":"2023-06-08T03:48:51.149902+0000","last_fullsized":"2023-06-08T03:48:51.149902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297204+0000","last_change":"2023-06-08T03:48:46.705939+0000","last_active":"2023-06-08T03:48:51.297204+0000","last_peered":"2023-06-08T03:48:51.297204+0000","last_clean":"2023-06-08T03:48:51.297204+0000","last_became_active":"2023-06-08T03:48:46.705467+0000","last_became_peered":"2023-06-08T03:48:46.705467+0000","last_unstale":"2023-06-08T03:48:51.297204+0000","last_undegraded":"2023-06-08T03:48:51.297204+0000","last_fullsized":"2023-06-08T03:48:51.297204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:32.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151964+0000","last_change":"2023-06-08T03:48:50.741943+0000","last_active":"2023-06-08T03:48:51.151964+0000","last_peered":"2023-06-08T03:48:51.151964+0000","last_clean":"2023-06-08T03:48:51.151964+0000","last_became_active":"2023-06-08T03:48:50.741608+0000","last_became_peered":"2023-06-08T03:48:50.741608+0000","last_unstale":"2023-06-08T03:48:51.151964+0000","last_undegraded":"2023-06-08T03:48:51.151964+0000","last_fullsized":"2023-06-08T03:48:51.151964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:51:13.186018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150823+0000","last_change":"2023-06-08T03:48:46.278306+0000","last_active":"2023-06-08T03:48:51.150823+0000","last_peered":"2023-06-08T03:48:51.150823+0000","last_clean":"2023-06-08T03:48:51.150823+0000","last_became_active":"2023-06-08T03:48:46.277947+0000","last_became_peered":"2023-06-08T03:48:46.277947+0000","last_unstale":"2023-06-08T03:48:51.150823+0000","last_undegraded":"2023-06-08T03:48:51.150823+0000","last_fullsized":"2023-06-08T03:48:51.150823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:49.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152311+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:48:51.152311+0000","last_peered":"2023-06-08T03:48:51.152311+0000","last_clean":"2023-06-08T03:48:51.152311+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:48:51.152311+0000","last_undegraded":"2023-06-08T03:48:51.152311+0000","last_fullsized":"2023-06-08T03:48:51.152311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:31:06.762730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:46.705629+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:46.705364+0000","last_became_peered":"2023-06-08T03:48:46.705364+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:50.749541+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:50.749054+0000","last_became_peered":"2023-06-08T03:48:50.749054+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:10.319490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150370+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:48:51.150370+0000","last_peered":"2023-06-08T03:48:51.150370+0000","last_clean":"2023-06-08T03:48:51.150370+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:48:51.150370+0000","last_undegraded":"2023-06-08T03:48:51.150370+0000","last_fullsized":"2023-06-08T03:48:51.150370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:47.060840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294022+0000","last_change":"2023-06-08T03:48:46.278145+0000","last_active":"2023-06-08T03:48:51.294022+0000","last_peered":"2023-06-08T03:48:51.294022+0000","last_clean":"2023-06-08T03:48:51.294022+0000","last_became_active":"2023-06-08T03:48:46.277856+0000","last_became_peered":"2023-06-08T03:48:46.277856+0000","last_unstale":"2023-06-08T03:48:51.294022+0000","last_undegraded":"2023-06-08T03:48:51.294022+0000","last_fullsized":"2023-06-08T03:48:51.294022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:05.154485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151419+0000","last_change":"2023-06-08T03:48:46.710096+0000","last_active":"2023-06-08T03:48:51.151419+0000","last_peered":"2023-06-08T03:48:51.151419+0000","last_clean":"2023-06-08T03:48:51.151419+0000","last_became_active":"2023-06-08T03:48:46.709818+0000","last_became_peered":"2023-06-08T03:48:46.709818+0000","last_unstale":"2023-06-08T03:48:51.151419+0000","last_undegraded":"2023-06-08T03:48:51.151419+0000","last_fullsized":"2023-06-08T03:48:51.151419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536871+0000","last_change":"2023-06-08T03:48:50.741926+0000","last_active":"2023-06-08T03:48:51.536871+0000","last_peered":"2023-06-08T03:48:51.536871+0000","last_clean":"2023-06-08T03:48:51.536871+0000","last_became_active":"2023-06-08T03:48:50.741525+0000","last_became_peered":"2023-06-08T03:48:50.741525+0000","last_unstale":"2023-06-08T03:48:51.536871+0000","last_undegraded":"2023-06-08T03:48:51.536871+0000","last_fullsized":"2023-06-08T03:48:51.536871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:51.416831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296460+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:48:51.296460+0000","last_peered":"2023-06-08T03:48:51.296460+0000","last_clean":"2023-06-08T03:48:51.296460+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:48:51.296460+0000","last_undegraded":"2023-06-08T03:48:51.296460+0000","last_fullsized":"2023-06-08T03:48:51.296460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:15.592925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536615+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:48:51.536615+0000","last_peered":"2023-06-08T03:48:51.536615+0000","last_clean":"2023-06-08T03:48:51.536615+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:48:51.536615+0000","last_undegraded":"2023-06-08T03:48:51.536615+0000","last_fullsized":"2023-06-08T03:48:51.536615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:57.059756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293693+0000","last_change":"2023-06-08T03:48:46.271960+0000","last_active":"2023-06-08T03:48:51.293693+0000","last_peered":"2023-06-08T03:48:51.293693+0000","last_clean":"2023-06-08T03:48:51.293693+0000","last_became_active":"2023-06-08T03:48:46.271631+0000","last_became_peered":"2023-06-08T03:48:46.271631+0000","last_unstale":"2023-06-08T03:48:51.293693+0000","last_undegraded":"2023-06-08T03:48:51.293693+0000","last_fullsized":"2023-06-08T03:48:51.293693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:39.928718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294243+0000","last_change":"2023-06-08T03:48:46.713531+0000","last_active":"2023-06-08T03:48:51.294243+0000","last_peered":"2023-06-08T03:48:51.294243+0000","last_clean":"2023-06-08T03:48:51.294243+0000","last_became_active":"2023-06-08T03:48:46.713244+0000","last_became_peered":"2023-06-08T03:48:46.713244+0000","last_unstale":"2023-06-08T03:48:51.294243+0000","last_undegraded":"2023-06-08T03:48:51.294243+0000","last_fullsized":"2023-06-08T03:48:51.294243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:15.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535548+0000","last_change":"2023-06-08T03:48:50.741357+0000","last_active":"2023-06-08T03:48:51.535548+0000","last_peered":"2023-06-08T03:48:51.535548+0000","last_clean":"2023-06-08T03:48:51.535548+0000","last_became_active":"2023-06-08T03:48:50.740948+0000","last_became_peered":"2023-06-08T03:48:50.740948+0000","last_unstale":"2023-06-08T03:48:51.535548+0000","last_undegraded":"2023-06-08T03:48:51.535548+0000","last_fullsized":"2023-06-08T03:48:51.535548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:30:29.499824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536124+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:48:51.536124+0000","last_peered":"2023-06-08T03:48:51.536124+0000","last_clean":"2023-06-08T03:48:51.536124+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:48:51.536124+0000","last_undegraded":"2023-06-08T03:48:51.536124+0000","last_fullsized":"2023-06-08T03:48:51.536124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:29.922704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296203+0000","last_change":"2023-06-08T03:48:46.277931+0000","last_active":"2023-06-08T03:48:51.296203+0000","last_peered":"2023-06-08T03:48:51.296203+0000","last_clean":"2023-06-08T03:48:51.296203+0000","last_became_active":"2023-06-08T03:48:46.277604+0000","last_became_peered":"2023-06-08T03:48:46.277604+0000","last_unstale":"2023-06-08T03:48:51.296203+0000","last_undegraded":"2023-06-08T03:48:51.296203+0000","last_fullsized":"2023-06-08T03:48:51.296203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:34.743166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297099+0000","last_change":"2023-06-08T03:48:46.705736+0000","last_active":"2023-06-08T03:48:51.297099+0000","last_peered":"2023-06-08T03:48:51.297099+0000","last_clean":"2023-06-08T03:48:51.297099+0000","last_became_active":"2023-06-08T03:48:46.705176+0000","last_became_peered":"2023-06-08T03:48:46.705176+0000","last_unstale":"2023-06-08T03:48:51.297099+0000","last_undegraded":"2023-06-08T03:48:51.297099+0000","last_fullsized":"2023-06-08T03:48:51.297099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536231+0000","last_change":"2023-06-08T03:48:50.742690+0000","last_active":"2023-06-08T03:48:51.536231+0000","last_peered":"2023-06-08T03:48:51.536231+0000","last_clean":"2023-06-08T03:48:51.536231+0000","last_became_active":"2023-06-08T03:48:50.742283+0000","last_became_peered":"2023-06-08T03:48:50.742283+0000","last_unstale":"2023-06-08T03:48:51.536231+0000","last_undegraded":"2023-06-08T03:48:51.536231+0000","last_fullsized":"2023-06-08T03:48:51.536231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:36.980926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535737+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:48:51.535737+0000","last_peered":"2023-06-08T03:48:51.535737+0000","last_clean":"2023-06-08T03:48:51.535737+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:48:51.535737+0000","last_undegraded":"2023-06-08T03:48:51.535737+0000","last_fullsized":"2023-06-08T03:48:51.535737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:37.932523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150042+0000","last_change":"2023-06-08T03:48:46.281860+0000","last_active":"2023-06-08T03:48:51.150042+0000","last_peered":"2023-06-08T03:48:51.150042+0000","last_clean":"2023-06-08T03:48:51.150042+0000","last_became_active":"2023-06-08T03:48:46.281558+0000","last_became_peered":"2023-06-08T03:48:46.281558+0000","last_unstale":"2023-06-08T03:48:51.150042+0000","last_undegraded":"2023-06-08T03:48:51.150042+0000","last_fullsized":"2023-06-08T03:48:51.150042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.712745+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.712473+0000","last_became_peered":"2023-06-08T03:48:46.712473+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:11.555796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294139+0000","last_change":"2023-06-08T03:48:50.741909+0000","last_active":"2023-06-08T03:48:51.294139+0000","last_peered":"2023-06-08T03:48:51.294139+0000","last_clean":"2023-06-08T03:48:51.294139+0000","last_became_active":"2023-06-08T03:48:50.741480+0000","last_became_peered":"2023-06-08T03:48:50.741480+0000","last_unstale":"2023-06-08T03:48:51.294139+0000","last_undegraded":"2023-06-08T03:48:51.294139+0000","last_fullsized":"2023-06-08T03:48:51.294139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:23:11.394158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535613+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:48:51.535613+0000","last_peered":"2023-06-08T03:48:51.535613+0000","last_clean":"2023-06-08T03:48:51.535613+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:48:51.535613+0000","last_undegraded":"2023-06-08T03:48:51.535613+0000","last_fullsized":"2023-06-08T03:48:51.535613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:08.960350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152806+0000","last_change":"2023-06-08T03:48:46.277332+0000","last_active":"2023-06-08T03:48:51.152806+0000","last_peered":"2023-06-08T03:48:51.152806+0000","last_clean":"2023-06-08T03:48:51.152806+0000","last_became_active":"2023-06-08T03:48:46.277048+0000","last_became_peered":"2023-06-08T03:48:46.277048+0000","last_unstale":"2023-06-08T03:48:51.152806+0000","last_undegraded":"2023-06-08T03:48:51.152806+0000","last_fullsized":"2023-06-08T03:48:51.152806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:20:43.010981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296324+0000","last_change":"2023-06-08T03:48:46.713941+0000","last_active":"2023-06-08T03:48:51.296324+0000","last_peered":"2023-06-08T03:48:51.296324+0000","last_clean":"2023-06-08T03:48:51.296324+0000","last_became_active":"2023-06-08T03:48:46.713519+0000","last_became_peered":"2023-06-08T03:48:46.713519+0000","last_unstale":"2023-06-08T03:48:51.296324+0000","last_undegraded":"2023-06-08T03:48:51.296324+0000","last_fullsized":"2023-06-08T03:48:51.296324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152339+0000","last_change":"2023-06-08T03:48:50.746277+0000","last_active":"2023-06-08T03:48:51.152339+0000","last_peered":"2023-06-08T03:48:51.152339+0000","last_clean":"2023-06-08T03:48:51.152339+0000","last_became_active":"2023-06-08T03:48:50.745762+0000","last_became_peered":"2023-06-08T03:48:50.745762+0000","last_unstale":"2023-06-08T03:48:51.152339+0000","last_undegraded":"2023-06-08T03:48:51.152339+0000","last_fullsized":"2023-06-08T03:48:51.152339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151603+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:48:51.151603+0000","last_peered":"2023-06-08T03:48:51.151603+0000","last_clean":"2023-06-08T03:48:51.151603+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:48:51.151603+0000","last_undegraded":"2023-06-08T03:48:51.151603+0000","last_fullsized":"2023-06-08T03:48:51.151603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:16.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296662+0000","last_change":"2023-06-08T03:48:46.280443+0000","last_active":"2023-06-08T03:48:51.296662+0000","last_peered":"2023-06-08T03:48:51.296662+0000","last_clean":"2023-06-08T03:48:51.296662+0000","last_became_active":"2023-06-08T03:48:46.280150+0000","last_became_peered":"2023-06-08T03:48:46.280150+0000","last_unstale":"2023-06-08T03:48:51.296662+0000","last_undegraded":"2023-06-08T03:48:51.296662+0000","last_fullsized":"2023-06-08T03:48:51.296662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:10.550497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294224+0000","last_change":"2023-06-08T03:48:46.704536+0000","last_active":"2023-06-08T03:48:51.294224+0000","last_peered":"2023-06-08T03:48:51.294224+0000","last_clean":"2023-06-08T03:48:51.294224+0000","last_became_active":"2023-06-08T03:48:46.704247+0000","last_became_peered":"2023-06-08T03:48:46.704247+0000","last_unstale":"2023-06-08T03:48:51.294224+0000","last_undegraded":"2023-06-08T03:48:51.294224+0000","last_fullsized":"2023-06-08T03:48:51.294224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294090+0000","last_change":"2023-06-08T03:48:50.746038+0000","last_active":"2023-06-08T03:48:51.294090+0000","last_peered":"2023-06-08T03:48:51.294090+0000","last_clean":"2023-06-08T03:48:51.294090+0000","last_became_active":"2023-06-08T03:48:50.742671+0000","last_became_peered":"2023-06-08T03:48:50.742671+0000","last_unstale":"2023-06-08T03:48:51.294090+0000","last_undegraded":"2023-06-08T03:48:51.294090+0000","last_fullsized":"2023-06-08T03:48:51.294090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:35.814289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151774+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:48:51.151774+0000","last_peered":"2023-06-08T03:48:51.151774+0000","last_clean":"2023-06-08T03:48:51.151774+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:48:51.151774+0000","last_undegraded":"2023-06-08T03:48:51.151774+0000","last_fullsized":"2023-06-08T03:48:51.151774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:42.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536891+0000","last_change":"2023-06-08T03:48:46.279903+0000","last_active":"2023-06-08T03:48:51.536891+0000","last_peered":"2023-06-08T03:48:51.536891+0000","last_clean":"2023-06-08T03:48:51.536891+0000","last_became_active":"2023-06-08T03:48:46.279643+0000","last_became_peered":"2023-06-08T03:48:46.279643+0000","last_unstale":"2023-06-08T03:48:51.536891+0000","last_undegraded":"2023-06-08T03:48:51.536891+0000","last_fullsized":"2023-06-08T03:48:51.536891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296218+0000","last_change":"2023-06-08T03:48:46.710102+0000","last_active":"2023-06-08T03:48:51.296218+0000","last_peered":"2023-06-08T03:48:51.296218+0000","last_clean":"2023-06-08T03:48:51.296218+0000","last_became_active":"2023-06-08T03:48:46.708006+0000","last_became_peered":"2023-06-08T03:48:46.708006+0000","last_unstale":"2023-06-08T03:48:51.296218+0000","last_undegraded":"2023-06-08T03:48:51.296218+0000","last_fullsized":"2023-06-08T03:48:51.296218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:22.614696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296866+0000","last_change":"2023-06-08T03:48:50.745383+0000","last_active":"2023-06-08T03:48:51.296866+0000","last_peered":"2023-06-08T03:48:51.296866+0000","last_clean":"2023-06-08T03:48:51.296866+0000","last_became_active":"2023-06-08T03:48:50.744898+0000","last_became_peered":"2023-06-08T03:48:50.744898+0000","last_unstale":"2023-06-08T03:48:51.296866+0000","last_undegraded":"2023-06-08T03:48:51.296866+0000","last_fullsized":"2023-06-08T03:48:51.296866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:19.011259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294205+0000","last_change":"2023-06-08T03:48:46.272132+0000","last_active":"2023-06-08T03:48:51.294205+0000","last_peered":"2023-06-08T03:48:51.294205+0000","last_clean":"2023-06-08T03:48:51.294205+0000","last_became_active":"2023-06-08T03:48:46.271635+0000","last_became_peered":"2023-06-08T03:48:46.271635+0000","last_unstale":"2023-06-08T03:48:51.294205+0000","last_undegraded":"2023-06-08T03:48:51.294205+0000","last_fullsized":"2023-06-08T03:48:51.294205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:18.843927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535531+0000","last_change":"2023-06-08T03:48:46.716188+0000","last_active":"2023-06-08T03:48:51.535531+0000","last_peered":"2023-06-08T03:48:51.535531+0000","last_clean":"2023-06-08T03:48:51.535531+0000","last_became_active":"2023-06-08T03:48:46.715960+0000","last_became_peered":"2023-06-08T03:48:46.715960+0000","last_unstale":"2023-06-08T03:48:51.535531+0000","last_undegraded":"2023-06-08T03:48:51.535531+0000","last_fullsized":"2023-06-08T03:48:51.535531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:59:38.213584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536363+0000","last_change":"2023-06-08T03:48:50.741907+0000","last_active":"2023-06-08T03:48:51.536363+0000","last_peered":"2023-06-08T03:48:51.536363+0000","last_clean":"2023-06-08T03:48:51.536363+0000","last_became_active":"2023-06-08T03:48:50.741526+0000","last_became_peered":"2023-06-08T03:48:50.741526+0000","last_unstale":"2023-06-08T03:48:51.536363+0000","last_undegraded":"2023-06-08T03:48:51.536363+0000","last_fullsized":"2023-06-08T03:48:51.536363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536462+0000","last_change":"2023-06-08T03:48:46.283972+0000","last_active":"2023-06-08T03:48:51.536462+0000","last_peered":"2023-06-08T03:48:51.536462+0000","last_clean":"2023-06-08T03:48:51.536462+0000","last_became_active":"2023-06-08T03:48:46.283686+0000","last_became_peered":"2023-06-08T03:48:46.283686+0000","last_unstale":"2023-06-08T03:48:51.536462+0000","last_undegraded":"2023-06-08T03:48:51.536462+0000","last_fullsized":"2023-06-08T03:48:51.536462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152862+0000","last_change":"2023-06-08T03:48:46.708793+0000","last_active":"2023-06-08T03:48:51.152862+0000","last_peered":"2023-06-08T03:48:51.152862+0000","last_clean":"2023-06-08T03:48:51.152862+0000","last_became_active":"2023-06-08T03:48:46.708492+0000","last_became_peered":"2023-06-08T03:48:46.708492+0000","last_unstale":"2023-06-08T03:48:51.152862+0000","last_undegraded":"2023-06-08T03:48:51.152862+0000","last_fullsized":"2023-06-08T03:48:51.152862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:54:28.053659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537064+0000","last_change":"2023-06-08T03:48:50.748191+0000","last_active":"2023-06-08T03:48:51.537064+0000","last_peered":"2023-06-08T03:48:51.537064+0000","last_clean":"2023-06-08T03:48:51.537064+0000","last_became_active":"2023-06-08T03:48:50.747824+0000","last_became_peered":"2023-06-08T03:48:50.747824+0000","last_unstale":"2023-06-08T03:48:51.537064+0000","last_undegraded":"2023-06-08T03:48:51.537064+0000","last_fullsized":"2023-06-08T03:48:51.537064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:16.373129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536733+0000","last_change":"2023-06-08T03:48:46.283956+0000","last_active":"2023-06-08T03:48:51.536733+0000","last_peered":"2023-06-08T03:48:51.536733+0000","last_clean":"2023-06-08T03:48:51.536733+0000","last_became_active":"2023-06-08T03:48:46.283667+0000","last_became_peered":"2023-06-08T03:48:46.283667+0000","last_unstale":"2023-06-08T03:48:51.536733+0000","last_undegraded":"2023-06-08T03:48:51.536733+0000","last_fullsized":"2023-06-08T03:48:51.536733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:43.022334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151349+0000","last_change":"2023-06-08T03:48:46.705342+0000","last_active":"2023-06-08T03:48:51.151349+0000","last_peered":"2023-06-08T03:48:51.151349+0000","last_clean":"2023-06-08T03:48:51.151349+0000","last_became_active":"2023-06-08T03:48:46.704758+0000","last_became_peered":"2023-06-08T03:48:46.704758+0000","last_unstale":"2023-06-08T03:48:51.151349+0000","last_undegraded":"2023-06-08T03:48:51.151349+0000","last_fullsized":"2023-06-08T03:48:51.151349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:03.775564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150985+0000","last_change":"2023-06-08T03:48:50.749457+0000","last_active":"2023-06-08T03:48:51.150985+0000","last_peered":"2023-06-08T03:48:51.150985+0000","last_clean":"2023-06-08T03:48:51.150985+0000","last_became_active":"2023-06-08T03:48:50.749024+0000","last_became_peered":"2023-06-08T03:48:50.749024+0000","last_unstale":"2023-06-08T03:48:51.150985+0000","last_undegraded":"2023-06-08T03:48:51.150985+0000","last_fullsized":"2023-06-08T03:48:51.150985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150602+0000","last_change":"2023-06-08T03:48:46.274180+0000","last_active":"2023-06-08T03:48:51.150602+0000","last_peered":"2023-06-08T03:48:51.150602+0000","last_clean":"2023-06-08T03:48:51.150602+0000","last_became_active":"2023-06-08T03:48:46.273751+0000","last_became_peered":"2023-06-08T03:48:46.273751+0000","last_unstale":"2023-06-08T03:48:51.150602+0000","last_undegraded":"2023-06-08T03:48:51.150602+0000","last_fullsized":"2023-06-08T03:48:51.150602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149813+0000","last_change":"2023-06-08T03:48:46.699197+0000","last_active":"2023-06-08T03:48:51.149813+0000","last_peered":"2023-06-08T03:48:51.149813+0000","last_clean":"2023-06-08T03:48:51.149813+0000","last_became_active":"2023-06-08T03:48:46.698921+0000","last_became_peered":"2023-06-08T03:48:46.698921+0000","last_unstale":"2023-06-08T03:48:51.149813+0000","last_undegraded":"2023-06-08T03:48:51.149813+0000","last_fullsized":"2023-06-08T03:48:51.149813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296459+0000","last_change":"2023-06-08T03:48:50.742031+0000","last_active":"2023-06-08T03:48:51.296459+0000","last_peered":"2023-06-08T03:48:51.296459+0000","last_clean":"2023-06-08T03:48:51.296459+0000","last_became_active":"2023-06-08T03:48:50.741621+0000","last_became_peered":"2023-06-08T03:48:50.741621+0000","last_unstale":"2023-06-08T03:48:51.296459+0000","last_undegraded":"2023-06-08T03:48:51.296459+0000","last_fullsized":"2023-06-08T03:48:51.296459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:59.951799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294491+0000","last_change":"2023-06-08T03:48:46.280946+0000","last_active":"2023-06-08T03:48:51.294491+0000","last_peered":"2023-06-08T03:48:51.294491+0000","last_clean":"2023-06-08T03:48:51.294491+0000","last_became_active":"2023-06-08T03:48:46.279562+0000","last_became_peered":"2023-06-08T03:48:46.279562+0000","last_unstale":"2023-06-08T03:48:51.294491+0000","last_undegraded":"2023-06-08T03:48:51.294491+0000","last_fullsized":"2023-06-08T03:48:51.294491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151164+0000","last_change":"2023-06-08T03:48:46.709469+0000","last_active":"2023-06-08T03:48:51.151164+0000","last_peered":"2023-06-08T03:48:51.151164+0000","last_clean":"2023-06-08T03:48:51.151164+0000","last_became_active":"2023-06-08T03:48:46.709131+0000","last_became_peered":"2023-06-08T03:48:46.709131+0000","last_unstale":"2023-06-08T03:48:51.151164+0000","last_undegraded":"2023-06-08T03:48:51.151164+0000","last_fullsized":"2023-06-08T03:48:51.151164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:09.642499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151705+0000","last_change":"2023-06-08T03:48:46.699962+0000","last_active":"2023-06-08T03:48:51.151705+0000","last_peered":"2023-06-08T03:48:51.151705+0000","last_clean":"2023-06-08T03:48:51.151705+0000","last_became_active":"2023-06-08T03:48:46.699670+0000","last_became_peered":"2023-06-08T03:48:46.699670+0000","last_unstale":"2023-06-08T03:48:51.151705+0000","last_undegraded":"2023-06-08T03:48:51.151705+0000","last_fullsized":"2023-06-08T03:48:51.151705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:16.254429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150141+0000","last_change":"2023-06-08T03:48:46.712641+0000","last_active":"2023-06-08T03:48:51.150141+0000","last_peered":"2023-06-08T03:48:51.150141+0000","last_clean":"2023-06-08T03:48:51.150141+0000","last_became_active":"2023-06-08T03:48:46.712338+0000","last_became_peered":"2023-06-08T03:48:46.712338+0000","last_unstale":"2023-06-08T03:48:51.150141+0000","last_undegraded":"2023-06-08T03:48:51.150141+0000","last_fullsized":"2023-06-08T03:48:51.150141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:42.915864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152242+0000","last_change":"2023-06-08T03:48:46.711282+0000","last_active":"2023-06-08T03:48:51.152242+0000","last_peered":"2023-06-08T03:48:51.152242+0000","last_clean":"2023-06-08T03:48:51.152242+0000","last_became_active":"2023-06-08T03:48:46.711006+0000","last_became_peered":"2023-06-08T03:48:46.711006+0000","last_unstale":"2023-06-08T03:48:51.152242+0000","last_undegraded":"2023-06-08T03:48:51.152242+0000","last_fullsized":"2023-06-08T03:48:51.152242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:23:18.302863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150081+0000","last_change":"2023-06-08T03:48:46.711221+0000","last_active":"2023-06-08T03:48:51.150081+0000","last_peered":"2023-06-08T03:48:51.150081+0000","last_clean":"2023-06-08T03:48:51.150081+0000","last_became_active":"2023-06-08T03:48:46.710772+0000","last_became_peered":"2023-06-08T03:48:46.710772+0000","last_unstale":"2023-06-08T03:48:51.150081+0000","last_undegraded":"2023-06-08T03:48:51.150081+0000","last_fullsized":"2023-06-08T03:48:51.150081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296341+0000","last_change":"2023-06-08T03:48:46.712982+0000","last_active":"2023-06-08T03:48:51.296341+0000","last_peered":"2023-06-08T03:48:51.296341+0000","last_clean":"2023-06-08T03:48:51.296341+0000","last_became_active":"2023-06-08T03:48:46.712737+0000","last_became_peered":"2023-06-08T03:48:46.712737+0000","last_unstale":"2023-06-08T03:48:51.296341+0000","last_undegraded":"2023-06-08T03:48:51.296341+0000","last_fullsized":"2023-06-08T03:48:51.296341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:48.748581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4451,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":703638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:49:04.906 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:49:05.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.057+0000 7f602c42d700 1 Processor -- start 2023-06-08T03:49:05.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.057+0000 7f602c42d700 1 -- start start 2023-06-08T03:49:05.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602c42d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6024158fc0 0x7f6024069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602c42d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f602406d9d0 0x7f60240cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602c42d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6024159390 con 0x7f602406c8f0 2023-06-08T03:49:05.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602c42d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240caee0 con 0x7f602406d9d0 2023-06-08T03:49:05.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602c42d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240ae770 con 0x7f6024158fc0 2023-06-08T03:49:05.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f602406d9d0 0x7f60240cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f602406d9d0 0x7f60240cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58292/0 (socket says 172.21.15.43:58292) 2023-06-08T03:49:05.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 -- 172.21.15.43:0/2740854060 learned_addr learned my addr 172.21.15.43:0/2740854060 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a1c9700 1 --2- 172.21.15.43:0/2740854060 >> v2:172.21.15.135:3300/0 conn(0x7f6024158fc0 0x7f6024069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 -- 172.21.15.43:0/2740854060 >> v2:172.21.15.135:3300/0 conn(0x7f6024158fc0 msgr2=0x7f6024069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 --2- 172.21.15.43:0/2740854060 >> v2:172.21.15.135:3300/0 conn(0x7f6024158fc0 0x7f6024069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 -- 172.21.15.43:0/2740854060 >> v1:172.21.15.135:6789/0 conn(0x7f602406c8f0 legacy=0x7f602406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.058+0000 7f602a9ca700 1 -- 172.21.15.43:0/2740854060 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240ca920 con 0x7f602406d9d0 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602a1c9700 1 --2- 172.21.15.43:0/2740854060 >> v2:172.21.15.135:3300/0 conn(0x7f6024158fc0 0x7f6024069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:05.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602a9ca700 1 --2- 172.21.15.43:0/2740854060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406d9d0 0x7f60240cd440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f60240c5f50 tx=0x7f601c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45384519cdd5e57 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f60291c7700 1 -- 172.21.15.43:0/2740854060 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00e070 con 0x7f602406d9d0 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f60291c7700 1 -- 172.21.15.43:0/2740854060 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c003a20 con 0x7f602406d9d0 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f60291c7700 1 -- 172.21.15.43:0/2740854060 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c003dd0 con 0x7f602406d9d0 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 -- 172.21.15.43:0/2740854060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406d9d0 msgr2=0x7f60240cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 --2- 172.21.15.43:0/2740854060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406d9d0 0x7f60240cd440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f60240c5f50 tx=0x7f601c00b330 comp rx=0 tx=0).stop 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 -- 172.21.15.43:0/2740854060 shutdown_connections 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 --2- 172.21.15.43:0/2740854060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406d9d0 0x7f60240cd440 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 --2- 172.21.15.43:0/2740854060 >> v2:172.21.15.135:3300/0 conn(0x7f6024158fc0 0x7f6024069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 -- 172.21.15.43:0/2740854060 >> 172.21.15.43:0/2740854060 conn(0x7f60240ceed0 msgr2=0x7f60240cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:05.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.059+0000 7f602c42d700 1 -- 172.21.15.43:0/2740854060 shutdown_connections 2023-06-08T03:49:05.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.060+0000 7f602c42d700 1 -- 172.21.15.43:0/2740854060 wait complete. 2023-06-08T03:49:05.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 Processor -- start 2023-06-08T03:49:05.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 -- start start 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 0x7f6024153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f602406d9d0 0x7f602415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6024158fc0 0x7f602415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602415c0b0 con 0x7f602406c8f0 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c2ad0 con 0x7f6024158fc0 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.061+0000 7f602c42d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c2db0 con 0x7f602406d9d0 2023-06-08T03:49:05.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 0x7f6024153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 0x7f6024153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58294/0 (socket says 172.21.15.43:58294) 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 -- 172.21.15.43:0/1684070404 learned_addr learned my addr 172.21.15.43:0/1684070404 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a9ca700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6024158fc0 0x7f602415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f60299c8700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f602406d9d0 0x7f602415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 -- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f602406d9d0 msgr2=0x7f602415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f602406d9d0 0x7f602415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 -- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6024158fc0 msgr2=0x7f602415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6024158fc0 0x7f602415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 -- 172.21.15.43:0/1684070404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009b30 con 0x7f602406c8f0 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602a1c9700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 0x7f6024153f70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f601400c750 tx=0x7f601400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014011800 con 0x7f602406c8f0 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014011960 con 0x7f602406c8f0 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240c3090 con 0x7f602406c8f0 2023-06-08T03:49:05.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014011cd0 con 0x7f602406c8f0 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.062+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240c3650 con 0x7f602406c8f0 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.063+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6024073fa0 con 0x7f602406c8f0 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.064+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6014021350 con 0x7f602406c8f0 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.064+0000 7f601affd700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f600806ace0 0x7f600806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.064+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f60140895a0 con 0x7f602406c8f0 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.064+0000 7f60299c8700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f600806ace0 0x7f600806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.065+0000 7f60299c8700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f600806ace0 0x7f600806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f602415bcf0 tx=0x7f60200090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.069+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6014057df0 con 0x7f602406c8f0 2023-06-08T03:49:05.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.262+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60240ccc40 con 0x7f600806ace0 2023-06-08T03:49:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.272+0000 7f601affd700 1 -- 172.21.15.43:0/1684070404 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367507 (secure 0 0 0) 0x7f6020009e00 con 0x7f600806ace0 2023-06-08T03:49:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:05.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f600806ace0 msgr2=0x7f600806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f600806ace0 0x7f600806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f602415bcf0 tx=0x7f60200090e0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 msgr2=0x7f6024153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 0x7f6024153f70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f601400c750 tx=0x7f601400ca60 comp rx=0 tx=0).stop 2023-06-08T03:49:05.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 shutdown_connections 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f600806ace0 0x7f600806d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f602406c8f0 0x7f6024153f70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6024158fc0 0x7f602415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 --2- 172.21.15.43:0/1684070404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f602406d9d0 0x7f602415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 >> 172.21.15.43:0/1684070404 conn(0x7f60240ceed0 msgr2=0x7f6024158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 shutdown_connections 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.276+0000 7f602c42d700 1 -- 172.21.15.43:0/1684070404 wait complete. 2023-06-08T03:49:05.283 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:49:05.292 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-06-08T03:49:03.565935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594819,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":3383296,"data_stored":2064846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003592"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535614+0000","last_change":"2023-06-08T03:48:46.695933+0000","last_active":"2023-06-08T03:48:51.535614+0000","last_peered":"2023-06-08T03:48:51.535614+0000","last_clean":"2023-06-08T03:48:51.535614+0000","last_became_active":"2023-06-08T03:48:46.695656+0000","last_became_peered":"2023-06-08T03:48:46.695656+0000","last_unstale":"2023-06-08T03:48:51.535614+0000","last_undegraded":"2023-06-08T03:48:51.535614+0000","last_fullsized":"2023-06-08T03:48:51.535614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:30:50.250635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537474+0000","last_change":"2023-06-08T03:48:46.714866+0000","last_active":"2023-06-08T03:48:51.537474+0000","last_peered":"2023-06-08T03:48:51.537474+0000","last_clean":"2023-06-08T03:48:51.537474+0000","last_became_active":"2023-06-08T03:48:46.714589+0000","last_became_peered":"2023-06-08T03:48:46.714589+0000","last_unstale":"2023-06-08T03:48:51.537474+0000","last_undegraded":"2023-06-08T03:48:51.537474+0000","last_fullsized":"2023-06-08T03:48:51.537474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152613+0000","last_change":"2023-06-08T03:48:46.706256+0000","last_active":"2023-06-08T03:48:51.152613+0000","last_peered":"2023-06-08T03:48:51.152613+0000","last_clean":"2023-06-08T03:48:51.152613+0000","last_became_active":"2023-06-08T03:48:46.705978+0000","last_became_peered":"2023-06-08T03:48:46.705978+0000","last_unstale":"2023-06-08T03:48:51.152613+0000","last_undegraded":"2023-06-08T03:48:51.152613+0000","last_fullsized":"2023-06-08T03:48:51.152613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:22:14.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151950+0000","last_change":"2023-06-08T03:48:46.707135+0000","last_active":"2023-06-08T03:48:51.151950+0000","last_peered":"2023-06-08T03:48:51.151950+0000","last_clean":"2023-06-08T03:48:51.151950+0000","last_became_active":"2023-06-08T03:48:46.706761+0000","last_became_peered":"2023-06-08T03:48:46.706761+0000","last_unstale":"2023-06-08T03:48:51.151950+0000","last_undegraded":"2023-06-08T03:48:51.151950+0000","last_fullsized":"2023-06-08T03:48:51.151950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:56.493538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294344+0000","last_change":"2023-06-08T03:48:46.699911+0000","last_active":"2023-06-08T03:48:51.294344+0000","last_peered":"2023-06-08T03:48:51.294344+0000","last_clean":"2023-06-08T03:48:51.294344+0000","last_became_active":"2023-06-08T03:48:46.699664+0000","last_became_peered":"2023-06-08T03:48:46.699664+0000","last_unstale":"2023-06-08T03:48:51.294344+0000","last_undegraded":"2023-06-08T03:48:51.294344+0000","last_fullsized":"2023-06-08T03:48:51.294344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152397+0000","last_change":"2023-06-08T03:48:46.705516+0000","last_active":"2023-06-08T03:48:51.152397+0000","last_peered":"2023-06-08T03:48:51.152397+0000","last_clean":"2023-06-08T03:48:51.152397+0000","last_became_active":"2023-06-08T03:48:46.705065+0000","last_became_peered":"2023-06-08T03:48:46.705065+0000","last_unstale":"2023-06-08T03:48:51.152397+0000","last_undegraded":"2023-06-08T03:48:51.152397+0000","last_fullsized":"2023-06-08T03:48:51.152397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:14:12.765404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536130+0000","last_change":"2023-06-08T03:48:46.715167+0000","last_active":"2023-06-08T03:48:51.536130+0000","last_peered":"2023-06-08T03:48:51.536130+0000","last_clean":"2023-06-08T03:48:51.536130+0000","last_became_active":"2023-06-08T03:48:46.714516+0000","last_became_peered":"2023-06-08T03:48:46.714516+0000","last_unstale":"2023-06-08T03:48:51.536130+0000","last_undegraded":"2023-06-08T03:48:51.536130+0000","last_fullsized":"2023-06-08T03:48:51.536130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535554+0000","last_change":"2023-06-08T03:48:46.711469+0000","last_active":"2023-06-08T03:48:51.535554+0000","last_peered":"2023-06-08T03:48:51.535554+0000","last_clean":"2023-06-08T03:48:51.535554+0000","last_became_active":"2023-06-08T03:48:46.711192+0000","last_became_peered":"2023-06-08T03:48:46.711192+0000","last_unstale":"2023-06-08T03:48:51.535554+0000","last_undegraded":"2023-06-08T03:48:51.535554+0000","last_fullsized":"2023-06-08T03:48:51.535554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294108+0000","last_change":"2023-06-08T03:48:46.699402+0000","last_active":"2023-06-08T03:48:51.294108+0000","last_peered":"2023-06-08T03:48:51.294108+0000","last_clean":"2023-06-08T03:48:51.294108+0000","last_became_active":"2023-06-08T03:48:46.699147+0000","last_became_peered":"2023-06-08T03:48:46.699147+0000","last_unstale":"2023-06-08T03:48:51.294108+0000","last_undegraded":"2023-06-08T03:48:51.294108+0000","last_fullsized":"2023-06-08T03:48:51.294108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537669+0000","last_change":"2023-06-08T03:48:46.704142+0000","last_active":"2023-06-08T03:48:51.537669+0000","last_peered":"2023-06-08T03:48:51.537669+0000","last_clean":"2023-06-08T03:48:51.537669+0000","last_became_active":"2023-06-08T03:48:46.703834+0000","last_became_peered":"2023-06-08T03:48:46.703834+0000","last_unstale":"2023-06-08T03:48:51.537669+0000","last_undegraded":"2023-06-08T03:48:51.537669+0000","last_fullsized":"2023-06-08T03:48:51.537669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152529+0000","last_change":"2023-06-08T03:48:46.714056+0000","last_active":"2023-06-08T03:48:51.152529+0000","last_peered":"2023-06-08T03:48:51.152529+0000","last_clean":"2023-06-08T03:48:51.152529+0000","last_became_active":"2023-06-08T03:48:46.713591+0000","last_became_peered":"2023-06-08T03:48:46.713591+0000","last_unstale":"2023-06-08T03:48:51.152529+0000","last_undegraded":"2023-06-08T03:48:51.152529+0000","last_fullsized":"2023-06-08T03:48:51.152529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:27:27.515952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535329+0000","last_change":"2023-06-08T03:48:46.709172+0000","last_active":"2023-06-08T03:48:51.535329+0000","last_peered":"2023-06-08T03:48:51.535329+0000","last_clean":"2023-06-08T03:48:51.535329+0000","last_became_active":"2023-06-08T03:48:46.708965+0000","last_became_peered":"2023-06-08T03:48:46.708965+0000","last_unstale":"2023-06-08T03:48:51.535329+0000","last_undegraded":"2023-06-08T03:48:51.535329+0000","last_fullsized":"2023-06-08T03:48:51.535329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:08:38.733800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535191+0000","last_change":"2023-06-08T03:48:46.700006+0000","last_active":"2023-06-08T03:48:51.535191+0000","last_peered":"2023-06-08T03:48:51.535191+0000","last_clean":"2023-06-08T03:48:51.535191+0000","last_became_active":"2023-06-08T03:48:46.699757+0000","last_became_peered":"2023-06-08T03:48:46.699757+0000","last_unstale":"2023-06-08T03:48:51.535191+0000","last_undegraded":"2023-06-08T03:48:51.535191+0000","last_fullsized":"2023-06-08T03:48:51.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:03:26.492541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536448+0000","last_change":"2023-06-08T03:48:46.704941+0000","last_active":"2023-06-08T03:48:51.536448+0000","last_peered":"2023-06-08T03:48:51.536448+0000","last_clean":"2023-06-08T03:48:51.536448+0000","last_became_active":"2023-06-08T03:48:46.704597+0000","last_became_peered":"2023-06-08T03:48:46.704597+0000","last_unstale":"2023-06-08T03:48:51.536448+0000","last_undegraded":"2023-06-08T03:48:51.536448+0000","last_fullsized":"2023-06-08T03:48:51.536448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536330+0000","last_change":"2023-06-08T03:48:46.715344+0000","last_active":"2023-06-08T03:48:51.536330+0000","last_peered":"2023-06-08T03:48:51.536330+0000","last_clean":"2023-06-08T03:48:51.536330+0000","last_became_active":"2023-06-08T03:48:46.714900+0000","last_became_peered":"2023-06-08T03:48:46.714900+0000","last_unstale":"2023-06-08T03:48:51.536330+0000","last_undegraded":"2023-06-08T03:48:51.536330+0000","last_fullsized":"2023-06-08T03:48:51.536330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.706828+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.706509+0000","last_became_peered":"2023-06-08T03:48:46.706509+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:46.242079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294194+0000","last_change":"2023-06-08T03:48:46.695842+0000","last_active":"2023-06-08T03:48:51.294194+0000","last_peered":"2023-06-08T03:48:51.294194+0000","last_clean":"2023-06-08T03:48:51.294194+0000","last_became_active":"2023-06-08T03:48:46.695612+0000","last_became_peered":"2023-06-08T03:48:46.695612+0000","last_unstale":"2023-06-08T03:48:51.294194+0000","last_undegraded":"2023-06-08T03:48:51.294194+0000","last_fullsized":"2023-06-08T03:48:51.294194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:20:54.828539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152362+0000","last_change":"2023-06-08T03:48:46.697084+0000","last_active":"2023-06-08T03:48:51.152362+0000","last_peered":"2023-06-08T03:48:51.152362+0000","last_clean":"2023-06-08T03:48:51.152362+0000","last_became_active":"2023-06-08T03:48:46.696841+0000","last_became_peered":"2023-06-08T03:48:46.696841+0000","last_unstale":"2023-06-08T03:48:51.152362+0000","last_undegraded":"2023-06-08T03:48:51.152362+0000","last_fullsized":"2023-06-08T03:48:51.152362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:47.104870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535352+0000","last_change":"2023-06-08T03:48:46.707641+0000","last_active":"2023-06-08T03:48:51.535352+0000","last_peered":"2023-06-08T03:48:51.535352+0000","last_clean":"2023-06-08T03:48:51.535352+0000","last_became_active":"2023-06-08T03:48:46.707211+0000","last_became_peered":"2023-06-08T03:48:46.707211+0000","last_unstale":"2023-06-08T03:48:51.535352+0000","last_undegraded":"2023-06-08T03:48:51.535352+0000","last_fullsized":"2023-06-08T03:48:51.535352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:39.020693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151721+0000","last_change":"2023-06-08T03:48:46.709738+0000","last_active":"2023-06-08T03:48:51.151721+0000","last_peered":"2023-06-08T03:48:51.151721+0000","last_clean":"2023-06-08T03:48:51.151721+0000","last_became_active":"2023-06-08T03:48:46.709340+0000","last_became_peered":"2023-06-08T03:48:46.709340+0000","last_unstale":"2023-06-08T03:48:51.151721+0000","last_undegraded":"2023-06-08T03:48:51.151721+0000","last_fullsized":"2023-06-08T03:48:51.151721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:23.681916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536282+0000","last_change":"2023-06-08T03:48:46.709790+0000","last_active":"2023-06-08T03:48:51.536282+0000","last_peered":"2023-06-08T03:48:51.536282+0000","last_clean":"2023-06-08T03:48:51.536282+0000","last_became_active":"2023-06-08T03:48:46.709528+0000","last_became_peered":"2023-06-08T03:48:46.709528+0000","last_unstale":"2023-06-08T03:48:51.536282+0000","last_undegraded":"2023-06-08T03:48:51.536282+0000","last_fullsized":"2023-06-08T03:48:51.536282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:53.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293720+0000","last_change":"2023-06-08T03:48:46.712267+0000","last_active":"2023-06-08T03:48:51.293720+0000","last_peered":"2023-06-08T03:48:51.293720+0000","last_clean":"2023-06-08T03:48:51.293720+0000","last_became_active":"2023-06-08T03:48:46.712008+0000","last_became_peered":"2023-06-08T03:48:46.712008+0000","last_unstale":"2023-06-08T03:48:51.293720+0000","last_undegraded":"2023-06-08T03:48:51.293720+0000","last_fullsized":"2023-06-08T03:48:51.293720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:15.552998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149899+0000","last_change":"2023-06-08T03:48:46.699795+0000","last_active":"2023-06-08T03:48:51.149899+0000","last_peered":"2023-06-08T03:48:51.149899+0000","last_clean":"2023-06-08T03:48:51.149899+0000","last_became_active":"2023-06-08T03:48:46.699537+0000","last_became_peered":"2023-06-08T03:48:46.699537+0000","last_unstale":"2023-06-08T03:48:51.149899+0000","last_undegraded":"2023-06-08T03:48:51.149899+0000","last_fullsized":"2023-06-08T03:48:51.149899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535864+0000","last_change":"2023-06-08T03:48:46.710846+0000","last_active":"2023-06-08T03:48:51.535864+0000","last_peered":"2023-06-08T03:48:51.535864+0000","last_clean":"2023-06-08T03:48:51.535864+0000","last_became_active":"2023-06-08T03:48:46.710550+0000","last_became_peered":"2023-06-08T03:48:46.710550+0000","last_unstale":"2023-06-08T03:48:51.535864+0000","last_undegraded":"2023-06-08T03:48:51.535864+0000","last_fullsized":"2023-06-08T03:48:51.535864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297076+0000","last_change":"2023-06-08T03:48:46.713844+0000","last_active":"2023-06-08T03:48:51.297076+0000","last_peered":"2023-06-08T03:48:51.297076+0000","last_clean":"2023-06-08T03:48:51.297076+0000","last_became_active":"2023-06-08T03:48:46.713550+0000","last_became_peered":"2023-06-08T03:48:46.713550+0000","last_unstale":"2023-06-08T03:48:51.297076+0000","last_undegraded":"2023-06-08T03:48:51.297076+0000","last_fullsized":"2023-06-08T03:48:51.297076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:06.159783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296797+0000","last_change":"2023-06-08T03:48:46.711918+0000","last_active":"2023-06-08T03:48:51.296797+0000","last_peered":"2023-06-08T03:48:51.296797+0000","last_clean":"2023-06-08T03:48:51.296797+0000","last_became_active":"2023-06-08T03:48:46.711662+0000","last_became_peered":"2023-06-08T03:48:46.711662+0000","last_unstale":"2023-06-08T03:48:51.296797+0000","last_undegraded":"2023-06-08T03:48:51.296797+0000","last_fullsized":"2023-06-08T03:48:51.296797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:40.934017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537069+0000","last_change":"2023-06-08T03:48:46.708436+0000","last_active":"2023-06-08T03:48:51.537069+0000","last_peered":"2023-06-08T03:48:51.537069+0000","last_clean":"2023-06-08T03:48:51.537069+0000","last_became_active":"2023-06-08T03:48:46.708003+0000","last_became_peered":"2023-06-08T03:48:46.708003+0000","last_unstale":"2023-06-08T03:48:51.537069+0000","last_undegraded":"2023-06-08T03:48:51.537069+0000","last_fullsized":"2023-06-08T03:48:51.537069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:33.522665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152308+0000","last_change":"2023-06-08T03:48:50.740643+0000","last_active":"2023-06-08T03:48:51.152308+0000","last_peered":"2023-06-08T03:48:51.152308+0000","last_clean":"2023-06-08T03:48:51.152308+0000","last_became_active":"2023-06-08T03:48:50.740283+0000","last_became_peered":"2023-06-08T03:48:50.740283+0000","last_unstale":"2023-06-08T03:48:51.152308+0000","last_undegraded":"2023-06-08T03:48:51.152308+0000","last_fullsized":"2023-06-08T03:48:51.152308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:09:55.615848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152091+0000","last_change":"2023-06-08T03:48:46.278224+0000","last_active":"2023-06-08T03:48:51.152091+0000","last_peered":"2023-06-08T03:48:51.152091+0000","last_clean":"2023-06-08T03:48:51.152091+0000","last_became_active":"2023-06-08T03:48:46.277952+0000","last_became_peered":"2023-06-08T03:48:46.277952+0000","last_unstale":"2023-06-08T03:48:51.152091+0000","last_undegraded":"2023-06-08T03:48:51.152091+0000","last_fullsized":"2023-06-08T03:48:51.152091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:10:42.875919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150566+0000","last_change":"2023-06-08T03:48:46.712050+0000","last_active":"2023-06-08T03:48:51.150566+0000","last_peered":"2023-06-08T03:48:51.150566+0000","last_clean":"2023-06-08T03:48:51.150566+0000","last_became_active":"2023-06-08T03:48:46.711791+0000","last_became_peered":"2023-06-08T03:48:46.711791+0000","last_unstale":"2023-06-08T03:48:51.150566+0000","last_undegraded":"2023-06-08T03:48:51.150566+0000","last_fullsized":"2023-06-08T03:48:51.150566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:48.552832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151606+0000","last_change":"2023-06-08T03:48:50.739355+0000","last_active":"2023-06-08T03:48:51.151606+0000","last_peered":"2023-06-08T03:48:51.151606+0000","last_clean":"2023-06-08T03:48:51.151606+0000","last_became_active":"2023-06-08T03:48:50.738867+0000","last_became_peered":"2023-06-08T03:48:50.738867+0000","last_unstale":"2023-06-08T03:48:51.151606+0000","last_undegraded":"2023-06-08T03:48:51.151606+0000","last_fullsized":"2023-06-08T03:48:51.151606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:39.206726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296216+0000","last_change":"2023-06-08T03:48:46.277487+0000","last_active":"2023-06-08T03:48:51.296216+0000","last_peered":"2023-06-08T03:48:51.296216+0000","last_clean":"2023-06-08T03:48:51.296216+0000","last_became_active":"2023-06-08T03:48:46.277147+0000","last_became_peered":"2023-06-08T03:48:46.277147+0000","last_unstale":"2023-06-08T03:48:51.296216+0000","last_undegraded":"2023-06-08T03:48:51.296216+0000","last_fullsized":"2023-06-08T03:48:51.296216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:15.249130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294014+0000","last_change":"2023-06-08T03:48:46.698321+0000","last_active":"2023-06-08T03:48:51.294014+0000","last_peered":"2023-06-08T03:48:51.294014+0000","last_clean":"2023-06-08T03:48:51.294014+0000","last_became_active":"2023-06-08T03:48:46.698051+0000","last_became_peered":"2023-06-08T03:48:46.698051+0000","last_unstale":"2023-06-08T03:48:51.294014+0000","last_undegraded":"2023-06-08T03:48:51.294014+0000","last_fullsized":"2023-06-08T03:48:51.294014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294220+0000","last_change":"2023-06-08T03:48:50.747722+0000","last_active":"2023-06-08T03:48:51.294220+0000","last_peered":"2023-06-08T03:48:51.294220+0000","last_clean":"2023-06-08T03:48:51.294220+0000","last_became_active":"2023-06-08T03:48:50.747297+0000","last_became_peered":"2023-06-08T03:48:50.747297+0000","last_unstale":"2023-06-08T03:48:51.294220+0000","last_undegraded":"2023-06-08T03:48:51.294220+0000","last_fullsized":"2023-06-08T03:48:51.294220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:08:44.335450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150061+0000","last_change":"2023-06-08T03:48:46.276409+0000","last_active":"2023-06-08T03:48:51.150061+0000","last_peered":"2023-06-08T03:48:51.150061+0000","last_clean":"2023-06-08T03:48:51.150061+0000","last_became_active":"2023-06-08T03:48:46.276099+0000","last_became_peered":"2023-06-08T03:48:46.276099+0000","last_unstale":"2023-06-08T03:48:51.150061+0000","last_undegraded":"2023-06-08T03:48:51.150061+0000","last_fullsized":"2023-06-08T03:48:51.150061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:32.517367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151843+0000","last_change":"2023-06-08T03:48:46.707301+0000","last_active":"2023-06-08T03:48:51.151843+0000","last_peered":"2023-06-08T03:48:51.151843+0000","last_clean":"2023-06-08T03:48:51.151843+0000","last_became_active":"2023-06-08T03:48:46.706988+0000","last_became_peered":"2023-06-08T03:48:46.706988+0000","last_unstale":"2023-06-08T03:48:51.151843+0000","last_undegraded":"2023-06-08T03:48:51.151843+0000","last_fullsized":"2023-06-08T03:48:51.151843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151210+0000","last_change":"2023-06-08T03:48:50.741708+0000","last_active":"2023-06-08T03:48:51.151210+0000","last_peered":"2023-06-08T03:48:51.151210+0000","last_clean":"2023-06-08T03:48:51.151210+0000","last_became_active":"2023-06-08T03:48:50.741299+0000","last_became_peered":"2023-06-08T03:48:50.741299+0000","last_unstale":"2023-06-08T03:48:51.151210+0000","last_undegraded":"2023-06-08T03:48:51.151210+0000","last_fullsized":"2023-06-08T03:48:51.151210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:13:01.589674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294322+0000","last_change":"2023-06-08T03:48:46.281457+0000","last_active":"2023-06-08T03:48:51.294322+0000","last_peered":"2023-06-08T03:48:51.294322+0000","last_clean":"2023-06-08T03:48:51.294322+0000","last_became_active":"2023-06-08T03:48:46.279939+0000","last_became_peered":"2023-06-08T03:48:46.279939+0000","last_unstale":"2023-06-08T03:48:51.294322+0000","last_undegraded":"2023-06-08T03:48:51.294322+0000","last_fullsized":"2023-06-08T03:48:51.294322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149914+0000","last_change":"2023-06-08T03:48:46.712616+0000","last_active":"2023-06-08T03:48:51.149914+0000","last_peered":"2023-06-08T03:48:51.149914+0000","last_clean":"2023-06-08T03:48:51.149914+0000","last_became_active":"2023-06-08T03:48:46.712276+0000","last_became_peered":"2023-06-08T03:48:46.712276+0000","last_unstale":"2023-06-08T03:48:51.149914+0000","last_undegraded":"2023-06-08T03:48:51.149914+0000","last_fullsized":"2023-06-08T03:48:51.149914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:01.718524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535551+0000","last_change":"2023-06-08T03:48:50.740006+0000","last_active":"2023-06-08T03:48:51.535551+0000","last_peered":"2023-06-08T03:48:51.535551+0000","last_clean":"2023-06-08T03:48:51.535551+0000","last_became_active":"2023-06-08T03:48:50.739564+0000","last_became_peered":"2023-06-08T03:48:50.739564+0000","last_unstale":"2023-06-08T03:48:51.535551+0000","last_undegraded":"2023-06-08T03:48:51.535551+0000","last_fullsized":"2023-06-08T03:48:51.535551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:05.176785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537564+0000","last_change":"2023-06-08T03:48:46.280740+0000","last_active":"2023-06-08T03:48:51.537564+0000","last_peered":"2023-06-08T03:48:51.537564+0000","last_clean":"2023-06-08T03:48:51.537564+0000","last_became_active":"2023-06-08T03:48:46.280343+0000","last_became_peered":"2023-06-08T03:48:46.280343+0000","last_unstale":"2023-06-08T03:48:51.537564+0000","last_undegraded":"2023-06-08T03:48:51.537564+0000","last_fullsized":"2023-06-08T03:48:51.537564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:52.150651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149747+0000","last_change":"2023-06-08T03:48:46.705918+0000","last_active":"2023-06-08T03:48:51.149747+0000","last_peered":"2023-06-08T03:48:51.149747+0000","last_clean":"2023-06-08T03:48:51.149747+0000","last_became_active":"2023-06-08T03:48:46.704743+0000","last_became_peered":"2023-06-08T03:48:46.704743+0000","last_unstale":"2023-06-08T03:48:51.149747+0000","last_undegraded":"2023-06-08T03:48:51.149747+0000","last_fullsized":"2023-06-08T03:48:51.149747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:45:00.911565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150382+0000","last_change":"2023-06-08T03:48:50.743251+0000","last_active":"2023-06-08T03:48:51.150382+0000","last_peered":"2023-06-08T03:48:51.150382+0000","last_clean":"2023-06-08T03:48:51.150382+0000","last_became_active":"2023-06-08T03:48:50.742850+0000","last_became_peered":"2023-06-08T03:48:50.742850+0000","last_unstale":"2023-06-08T03:48:51.150382+0000","last_undegraded":"2023-06-08T03:48:51.150382+0000","last_fullsized":"2023-06-08T03:48:51.150382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:16.576491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536288+0000","last_change":"2023-06-08T03:48:46.278683+0000","last_active":"2023-06-08T03:48:51.536288+0000","last_peered":"2023-06-08T03:48:51.536288+0000","last_clean":"2023-06-08T03:48:51.536288+0000","last_became_active":"2023-06-08T03:48:46.278372+0000","last_became_peered":"2023-06-08T03:48:46.278372+0000","last_unstale":"2023-06-08T03:48:51.536288+0000","last_undegraded":"2023-06-08T03:48:51.536288+0000","last_fullsized":"2023-06-08T03:48:51.536288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:07.547618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296438+0000","last_change":"2023-06-08T03:48:46.712049+0000","last_active":"2023-06-08T03:48:51.296438+0000","last_peered":"2023-06-08T03:48:51.296438+0000","last_clean":"2023-06-08T03:48:51.296438+0000","last_became_active":"2023-06-08T03:48:46.711788+0000","last_became_peered":"2023-06-08T03:48:46.711788+0000","last_unstale":"2023-06-08T03:48:51.296438+0000","last_undegraded":"2023-06-08T03:48:51.296438+0000","last_fullsized":"2023-06-08T03:48:51.296438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296638+0000","last_change":"2023-06-08T03:48:50.741729+0000","last_active":"2023-06-08T03:48:51.296638+0000","last_peered":"2023-06-08T03:48:51.296638+0000","last_clean":"2023-06-08T03:48:51.296638+0000","last_became_active":"2023-06-08T03:48:50.741267+0000","last_became_peered":"2023-06-08T03:48:50.741267+0000","last_unstale":"2023-06-08T03:48:51.296638+0000","last_undegraded":"2023-06-08T03:48:51.296638+0000","last_fullsized":"2023-06-08T03:48:51.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:55.520331+0000","last_change":"2023-06-08T03:48:46.279495+0000","last_active":"2023-06-08T03:48:55.520331+0000","last_peered":"2023-06-08T03:48:55.520331+0000","last_clean":"2023-06-08T03:48:55.520331+0000","last_became_active":"2023-06-08T03:48:46.279119+0000","last_became_peered":"2023-06-08T03:48:46.279119+0000","last_unstale":"2023-06-08T03:48:55.520331+0000","last_undegraded":"2023-06-08T03:48:55.520331+0000","last_fullsized":"2023-06-08T03:48:55.520331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:02.149567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152693+0000","last_change":"2023-06-08T03:48:46.708107+0000","last_active":"2023-06-08T03:48:51.152693+0000","last_peered":"2023-06-08T03:48:51.152693+0000","last_clean":"2023-06-08T03:48:51.152693+0000","last_became_active":"2023-06-08T03:48:46.707899+0000","last_became_peered":"2023-06-08T03:48:46.707899+0000","last_unstale":"2023-06-08T03:48:51.152693+0000","last_undegraded":"2023-06-08T03:48:51.152693+0000","last_fullsized":"2023-06-08T03:48:51.152693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:39:42.981044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537245+0000","last_change":"2023-06-08T03:48:50.745708+0000","last_active":"2023-06-08T03:48:51.537245+0000","last_peered":"2023-06-08T03:48:51.537245+0000","last_clean":"2023-06-08T03:48:51.537245+0000","last_became_active":"2023-06-08T03:48:50.742554+0000","last_became_peered":"2023-06-08T03:48:50.742554+0000","last_unstale":"2023-06-08T03:48:51.537245+0000","last_undegraded":"2023-06-08T03:48:51.537245+0000","last_fullsized":"2023-06-08T03:48:51.537245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:39.476075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535988+0000","last_change":"2023-06-08T03:48:46.285246+0000","last_active":"2023-06-08T03:48:51.535988+0000","last_peered":"2023-06-08T03:48:51.535988+0000","last_clean":"2023-06-08T03:48:51.535988+0000","last_became_active":"2023-06-08T03:48:46.284966+0000","last_became_peered":"2023-06-08T03:48:46.284966+0000","last_unstale":"2023-06-08T03:48:51.535988+0000","last_undegraded":"2023-06-08T03:48:51.535988+0000","last_fullsized":"2023-06-08T03:48:51.535988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150409+0000","last_change":"2023-06-08T03:48:46.716123+0000","last_active":"2023-06-08T03:48:51.150409+0000","last_peered":"2023-06-08T03:48:51.150409+0000","last_clean":"2023-06-08T03:48:51.150409+0000","last_became_active":"2023-06-08T03:48:46.715806+0000","last_became_peered":"2023-06-08T03:48:46.715806+0000","last_unstale":"2023-06-08T03:48:51.150409+0000","last_undegraded":"2023-06-08T03:48:51.150409+0000","last_fullsized":"2023-06-08T03:48:51.150409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150674+0000","last_change":"2023-06-08T03:48:50.742064+0000","last_active":"2023-06-08T03:48:51.150674+0000","last_peered":"2023-06-08T03:48:51.150674+0000","last_clean":"2023-06-08T03:48:51.150674+0000","last_became_active":"2023-06-08T03:48:50.741695+0000","last_became_peered":"2023-06-08T03:48:50.741695+0000","last_unstale":"2023-06-08T03:48:51.150674+0000","last_undegraded":"2023-06-08T03:48:51.150674+0000","last_fullsized":"2023-06-08T03:48:51.150674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:07.233826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294053+0000","last_change":"2023-06-08T03:48:46.278885+0000","last_active":"2023-06-08T03:48:51.294053+0000","last_peered":"2023-06-08T03:48:51.294053+0000","last_clean":"2023-06-08T03:48:51.294053+0000","last_became_active":"2023-06-08T03:48:46.278561+0000","last_became_peered":"2023-06-08T03:48:46.278561+0000","last_unstale":"2023-06-08T03:48:51.294053+0000","last_undegraded":"2023-06-08T03:48:51.294053+0000","last_fullsized":"2023-06-08T03:48:51.294053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:06:31.293995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537077+0000","last_change":"2023-06-08T03:48:46.708244+0000","last_active":"2023-06-08T03:48:51.537077+0000","last_peered":"2023-06-08T03:48:51.537077+0000","last_clean":"2023-06-08T03:48:51.537077+0000","last_became_active":"2023-06-08T03:48:46.707643+0000","last_became_peered":"2023-06-08T03:48:46.707643+0000","last_unstale":"2023-06-08T03:48:51.537077+0000","last_undegraded":"2023-06-08T03:48:51.537077+0000","last_fullsized":"2023-06-08T03:48:51.537077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150661+0000","last_change":"2023-06-08T03:48:50.745965+0000","last_active":"2023-06-08T03:48:51.150661+0000","last_peered":"2023-06-08T03:48:51.150661+0000","last_clean":"2023-06-08T03:48:51.150661+0000","last_became_active":"2023-06-08T03:48:50.745561+0000","last_became_peered":"2023-06-08T03:48:50.745561+0000","last_unstale":"2023-06-08T03:48:51.150661+0000","last_undegraded":"2023-06-08T03:48:51.150661+0000","last_fullsized":"2023-06-08T03:48:51.150661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:37.313561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535839+0000","last_change":"2023-06-08T03:48:46.284576+0000","last_active":"2023-06-08T03:48:51.535839+0000","last_peered":"2023-06-08T03:48:51.535839+0000","last_clean":"2023-06-08T03:48:51.535839+0000","last_became_active":"2023-06-08T03:48:46.284324+0000","last_became_peered":"2023-06-08T03:48:46.284324+0000","last_unstale":"2023-06-08T03:48:51.535839+0000","last_undegraded":"2023-06-08T03:48:51.535839+0000","last_fullsized":"2023-06-08T03:48:51.535839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294519+0000","last_change":"2023-06-08T03:48:46.699501+0000","last_active":"2023-06-08T03:48:51.294519+0000","last_peered":"2023-06-08T03:48:51.294519+0000","last_clean":"2023-06-08T03:48:51.294519+0000","last_became_active":"2023-06-08T03:48:46.699227+0000","last_became_peered":"2023-06-08T03:48:46.699227+0000","last_unstale":"2023-06-08T03:48:51.294519+0000","last_undegraded":"2023-06-08T03:48:51.294519+0000","last_fullsized":"2023-06-08T03:48:51.294519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536807+0000","last_change":"2023-06-08T03:48:50.752340+0000","last_active":"2023-06-08T03:48:51.536807+0000","last_peered":"2023-06-08T03:48:51.536807+0000","last_clean":"2023-06-08T03:48:51.536807+0000","last_became_active":"2023-06-08T03:48:50.751962+0000","last_became_peered":"2023-06-08T03:48:50.751962+0000","last_unstale":"2023-06-08T03:48:51.536807+0000","last_undegraded":"2023-06-08T03:48:51.536807+0000","last_fullsized":"2023-06-08T03:48:51.536807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:48.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151454+0000","last_change":"2023-06-08T03:48:46.274849+0000","last_active":"2023-06-08T03:48:51.151454+0000","last_peered":"2023-06-08T03:48:51.151454+0000","last_clean":"2023-06-08T03:48:51.151454+0000","last_became_active":"2023-06-08T03:48:46.274502+0000","last_became_peered":"2023-06-08T03:48:46.274502+0000","last_unstale":"2023-06-08T03:48:51.151454+0000","last_undegraded":"2023-06-08T03:48:51.151454+0000","last_fullsized":"2023-06-08T03:48:51.151454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:22:56.444477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150868+0000","last_change":"2023-06-08T03:48:46.704969+0000","last_active":"2023-06-08T03:48:51.150868+0000","last_peered":"2023-06-08T03:48:51.150868+0000","last_clean":"2023-06-08T03:48:51.150868+0000","last_became_active":"2023-06-08T03:48:46.704688+0000","last_became_peered":"2023-06-08T03:48:46.704688+0000","last_unstale":"2023-06-08T03:48:51.150868+0000","last_undegraded":"2023-06-08T03:48:51.150868+0000","last_fullsized":"2023-06-08T03:48:51.150868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:03.154866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536425+0000","last_change":"2023-06-08T03:48:50.751168+0000","last_active":"2023-06-08T03:48:51.536425+0000","last_peered":"2023-06-08T03:48:51.536425+0000","last_clean":"2023-06-08T03:48:51.536425+0000","last_became_active":"2023-06-08T03:48:50.750781+0000","last_became_peered":"2023-06-08T03:48:50.750781+0000","last_unstale":"2023-06-08T03:48:51.536425+0000","last_undegraded":"2023-06-08T03:48:51.536425+0000","last_fullsized":"2023-06-08T03:48:51.536425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:59.334663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536464+0000","last_change":"2023-06-08T03:48:46.284225+0000","last_active":"2023-06-08T03:48:51.536464+0000","last_peered":"2023-06-08T03:48:51.536464+0000","last_clean":"2023-06-08T03:48:51.536464+0000","last_became_active":"2023-06-08T03:48:46.283964+0000","last_became_peered":"2023-06-08T03:48:46.283964+0000","last_unstale":"2023-06-08T03:48:51.536464+0000","last_undegraded":"2023-06-08T03:48:51.536464+0000","last_fullsized":"2023-06-08T03:48:51.536464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:02.770266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535467+0000","last_change":"2023-06-08T03:48:46.705264+0000","last_active":"2023-06-08T03:48:51.535467+0000","last_peered":"2023-06-08T03:48:51.535467+0000","last_clean":"2023-06-08T03:48:51.535467+0000","last_became_active":"2023-06-08T03:48:46.704968+0000","last_became_peered":"2023-06-08T03:48:46.704968+0000","last_unstale":"2023-06-08T03:48:51.535467+0000","last_undegraded":"2023-06-08T03:48:51.535467+0000","last_fullsized":"2023-06-08T03:48:51.535467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:19.849225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535037+0000","last_change":"2023-06-08T03:48:50.747984+0000","last_active":"2023-06-08T03:48:51.535037+0000","last_peered":"2023-06-08T03:48:51.535037+0000","last_clean":"2023-06-08T03:48:51.535037+0000","last_became_active":"2023-06-08T03:48:50.747678+0000","last_became_peered":"2023-06-08T03:48:50.747678+0000","last_unstale":"2023-06-08T03:48:51.535037+0000","last_undegraded":"2023-06-08T03:48:51.535037+0000","last_fullsized":"2023-06-08T03:48:51.535037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:20:02.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536442+0000","last_change":"2023-06-08T03:48:46.284040+0000","last_active":"2023-06-08T03:48:51.536442+0000","last_peered":"2023-06-08T03:48:51.536442+0000","last_clean":"2023-06-08T03:48:51.536442+0000","last_became_active":"2023-06-08T03:48:46.283769+0000","last_became_peered":"2023-06-08T03:48:46.283769+0000","last_unstale":"2023-06-08T03:48:51.536442+0000","last_undegraded":"2023-06-08T03:48:51.536442+0000","last_fullsized":"2023-06-08T03:48:51.536442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:32.850002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151726+0000","last_change":"2023-06-08T03:48:46.714226+0000","last_active":"2023-06-08T03:48:51.151726+0000","last_peered":"2023-06-08T03:48:51.151726+0000","last_clean":"2023-06-08T03:48:51.151726+0000","last_became_active":"2023-06-08T03:48:46.713960+0000","last_became_peered":"2023-06-08T03:48:46.713960+0000","last_unstale":"2023-06-08T03:48:51.151726+0000","last_undegraded":"2023-06-08T03:48:51.151726+0000","last_fullsized":"2023-06-08T03:48:51.151726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:27:56.879349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535261+0000","last_change":"2023-06-08T03:48:50.746373+0000","last_active":"2023-06-08T03:48:51.535261+0000","last_peered":"2023-06-08T03:48:51.535261+0000","last_clean":"2023-06-08T03:48:51.535261+0000","last_became_active":"2023-06-08T03:48:50.745785+0000","last_became_peered":"2023-06-08T03:48:50.745785+0000","last_unstale":"2023-06-08T03:48:51.535261+0000","last_undegraded":"2023-06-08T03:48:51.535261+0000","last_fullsized":"2023-06-08T03:48:51.535261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:46:48.225879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536088+0000","last_change":"2023-06-08T03:48:46.280813+0000","last_active":"2023-06-08T03:48:51.536088+0000","last_peered":"2023-06-08T03:48:51.536088+0000","last_clean":"2023-06-08T03:48:51.536088+0000","last_became_active":"2023-06-08T03:48:46.280534+0000","last_became_peered":"2023-06-08T03:48:46.280534+0000","last_unstale":"2023-06-08T03:48:51.536088+0000","last_undegraded":"2023-06-08T03:48:51.536088+0000","last_fullsized":"2023-06-08T03:48:51.536088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:41.910566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152106+0000","last_change":"2023-06-08T03:48:46.716189+0000","last_active":"2023-06-08T03:48:51.152106+0000","last_peered":"2023-06-08T03:48:51.152106+0000","last_clean":"2023-06-08T03:48:51.152106+0000","last_became_active":"2023-06-08T03:48:46.715886+0000","last_became_peered":"2023-06-08T03:48:46.715886+0000","last_unstale":"2023-06-08T03:48:51.152106+0000","last_undegraded":"2023-06-08T03:48:51.152106+0000","last_fullsized":"2023-06-08T03:48:51.152106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.739296+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.738841+0000","last_became_peered":"2023-06-08T03:48:50.738841+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:50.270846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536854+0000","last_change":"2023-06-08T03:48:46.279229+0000","last_active":"2023-06-08T03:48:51.536854+0000","last_peered":"2023-06-08T03:48:51.536854+0000","last_clean":"2023-06-08T03:48:51.536854+0000","last_became_active":"2023-06-08T03:48:46.278915+0000","last_became_peered":"2023-06-08T03:48:46.278915+0000","last_unstale":"2023-06-08T03:48:51.536854+0000","last_undegraded":"2023-06-08T03:48:51.536854+0000","last_fullsized":"2023-06-08T03:48:51.536854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294432+0000","last_change":"2023-06-08T03:48:46.712160+0000","last_active":"2023-06-08T03:48:51.294432+0000","last_peered":"2023-06-08T03:48:51.294432+0000","last_clean":"2023-06-08T03:48:51.294432+0000","last_became_active":"2023-06-08T03:48:46.711866+0000","last_became_peered":"2023-06-08T03:48:46.711866+0000","last_unstale":"2023-06-08T03:48:51.294432+0000","last_undegraded":"2023-06-08T03:48:51.294432+0000","last_fullsized":"2023-06-08T03:48:51.294432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.746274+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.745820+0000","last_became_peered":"2023-06-08T03:48:50.745820+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:59:19.751648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150205+0000","last_change":"2023-06-08T03:48:46.276528+0000","last_active":"2023-06-08T03:48:51.150205+0000","last_peered":"2023-06-08T03:48:51.150205+0000","last_clean":"2023-06-08T03:48:51.150205+0000","last_became_active":"2023-06-08T03:48:46.276141+0000","last_became_peered":"2023-06-08T03:48:46.276141+0000","last_unstale":"2023-06-08T03:48:51.150205+0000","last_undegraded":"2023-06-08T03:48:51.150205+0000","last_fullsized":"2023-06-08T03:48:51.150205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:35.012515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151420+0000","last_change":"2023-06-08T03:48:46.709069+0000","last_active":"2023-06-08T03:48:51.151420+0000","last_peered":"2023-06-08T03:48:51.151420+0000","last_clean":"2023-06-08T03:48:51.151420+0000","last_became_active":"2023-06-08T03:48:46.708427+0000","last_became_peered":"2023-06-08T03:48:46.708427+0000","last_unstale":"2023-06-08T03:48:51.151420+0000","last_undegraded":"2023-06-08T03:48:51.151420+0000","last_fullsized":"2023-06-08T03:48:51.151420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:33.855300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296822+0000","last_change":"2023-06-08T03:48:50.744633+0000","last_active":"2023-06-08T03:48:51.296822+0000","last_peered":"2023-06-08T03:48:51.296822+0000","last_clean":"2023-06-08T03:48:51.296822+0000","last_became_active":"2023-06-08T03:48:50.744230+0000","last_became_peered":"2023-06-08T03:48:50.744230+0000","last_unstale":"2023-06-08T03:48:51.296822+0000","last_undegraded":"2023-06-08T03:48:51.296822+0000","last_fullsized":"2023-06-08T03:48:51.296822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:04.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152143+0000","last_change":"2023-06-08T03:48:46.277921+0000","last_active":"2023-06-08T03:48:51.152143+0000","last_peered":"2023-06-08T03:48:51.152143+0000","last_clean":"2023-06-08T03:48:51.152143+0000","last_became_active":"2023-06-08T03:48:46.277634+0000","last_became_peered":"2023-06-08T03:48:46.277634+0000","last_unstale":"2023-06-08T03:48:51.152143+0000","last_undegraded":"2023-06-08T03:48:51.152143+0000","last_fullsized":"2023-06-08T03:48:51.152143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:20.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152053+0000","last_change":"2023-06-08T03:48:46.706196+0000","last_active":"2023-06-08T03:48:51.152053+0000","last_peered":"2023-06-08T03:48:51.152053+0000","last_clean":"2023-06-08T03:48:51.152053+0000","last_became_active":"2023-06-08T03:48:46.705906+0000","last_became_peered":"2023-06-08T03:48:46.705906+0000","last_unstale":"2023-06-08T03:48:51.152053+0000","last_undegraded":"2023-06-08T03:48:51.152053+0000","last_fullsized":"2023-06-08T03:48:51.152053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:02:18.561814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537144+0000","last_change":"2023-06-08T03:48:50.747319+0000","last_active":"2023-06-08T03:48:51.537144+0000","last_peered":"2023-06-08T03:48:51.537144+0000","last_clean":"2023-06-08T03:48:51.537144+0000","last_became_active":"2023-06-08T03:48:50.746943+0000","last_became_peered":"2023-06-08T03:48:50.746943+0000","last_unstale":"2023-06-08T03:48:51.537144+0000","last_undegraded":"2023-06-08T03:48:51.537144+0000","last_fullsized":"2023-06-08T03:48:51.537144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:46.374125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151194+0000","last_change":"2023-06-08T03:48:46.277755+0000","last_active":"2023-06-08T03:48:51.151194+0000","last_peered":"2023-06-08T03:48:51.151194+0000","last_clean":"2023-06-08T03:48:51.151194+0000","last_became_active":"2023-06-08T03:48:46.277421+0000","last_became_peered":"2023-06-08T03:48:46.277421+0000","last_unstale":"2023-06-08T03:48:51.151194+0000","last_undegraded":"2023-06-08T03:48:51.151194+0000","last_fullsized":"2023-06-08T03:48:51.151194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.153481+0000","last_change":"2023-06-08T03:48:46.708084+0000","last_active":"2023-06-08T03:48:51.153481+0000","last_peered":"2023-06-08T03:48:51.153481+0000","last_clean":"2023-06-08T03:48:51.153481+0000","last_became_active":"2023-06-08T03:48:46.707810+0000","last_became_peered":"2023-06-08T03:48:46.707810+0000","last_unstale":"2023-06-08T03:48:51.153481+0000","last_undegraded":"2023-06-08T03:48:51.153481+0000","last_fullsized":"2023-06-08T03:48:51.153481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:42:31.285512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151893+0000","last_change":"2023-06-08T03:48:50.746365+0000","last_active":"2023-06-08T03:48:51.151893+0000","last_peered":"2023-06-08T03:48:51.151893+0000","last_clean":"2023-06-08T03:48:51.151893+0000","last_became_active":"2023-06-08T03:48:50.745965+0000","last_became_peered":"2023-06-08T03:48:50.745965+0000","last_unstale":"2023-06-08T03:48:51.151893+0000","last_undegraded":"2023-06-08T03:48:51.151893+0000","last_fullsized":"2023-06-08T03:48:51.151893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:50:52.715702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149902+0000","last_change":"2023-06-08T03:48:46.281571+0000","last_active":"2023-06-08T03:48:51.149902+0000","last_peered":"2023-06-08T03:48:51.149902+0000","last_clean":"2023-06-08T03:48:51.149902+0000","last_became_active":"2023-06-08T03:48:46.281171+0000","last_became_peered":"2023-06-08T03:48:46.281171+0000","last_unstale":"2023-06-08T03:48:51.149902+0000","last_undegraded":"2023-06-08T03:48:51.149902+0000","last_fullsized":"2023-06-08T03:48:51.149902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297204+0000","last_change":"2023-06-08T03:48:46.705939+0000","last_active":"2023-06-08T03:48:51.297204+0000","last_peered":"2023-06-08T03:48:51.297204+0000","last_clean":"2023-06-08T03:48:51.297204+0000","last_became_active":"2023-06-08T03:48:46.705467+0000","last_became_peered":"2023-06-08T03:48:46.705467+0000","last_unstale":"2023-06-08T03:48:51.297204+0000","last_undegraded":"2023-06-08T03:48:51.297204+0000","last_fullsized":"2023-06-08T03:48:51.297204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:32.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151964+0000","last_change":"2023-06-08T03:48:50.741943+0000","last_active":"2023-06-08T03:48:51.151964+0000","last_peered":"2023-06-08T03:48:51.151964+0000","last_clean":"2023-06-08T03:48:51.151964+0000","last_became_active":"2023-06-08T03:48:50.741608+0000","last_became_peered":"2023-06-08T03:48:50.741608+0000","last_unstale":"2023-06-08T03:48:51.151964+0000","last_undegraded":"2023-06-08T03:48:51.151964+0000","last_fullsized":"2023-06-08T03:48:51.151964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:51:13.186018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150823+0000","last_change":"2023-06-08T03:48:46.278306+0000","last_active":"2023-06-08T03:48:51.150823+0000","last_peered":"2023-06-08T03:48:51.150823+0000","last_clean":"2023-06-08T03:48:51.150823+0000","last_became_active":"2023-06-08T03:48:46.277947+0000","last_became_peered":"2023-06-08T03:48:46.277947+0000","last_unstale":"2023-06-08T03:48:51.150823+0000","last_undegraded":"2023-06-08T03:48:51.150823+0000","last_fullsized":"2023-06-08T03:48:51.150823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:49.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152311+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:48:51.152311+0000","last_peered":"2023-06-08T03:48:51.152311+0000","last_clean":"2023-06-08T03:48:51.152311+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:48:51.152311+0000","last_undegraded":"2023-06-08T03:48:51.152311+0000","last_fullsized":"2023-06-08T03:48:51.152311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:31:06.762730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:46.705629+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:46.705364+0000","last_became_peered":"2023-06-08T03:48:46.705364+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:50.749541+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:50.749054+0000","last_became_peered":"2023-06-08T03:48:50.749054+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:10.319490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150370+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:48:51.150370+0000","last_peered":"2023-06-08T03:48:51.150370+0000","last_clean":"2023-06-08T03:48:51.150370+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:48:51.150370+0000","last_undegraded":"2023-06-08T03:48:51.150370+0000","last_fullsized":"2023-06-08T03:48:51.150370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:47.060840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294022+0000","last_change":"2023-06-08T03:48:46.278145+0000","last_active":"2023-06-08T03:48:51.294022+0000","last_peered":"2023-06-08T03:48:51.294022+0000","last_clean":"2023-06-08T03:48:51.294022+0000","last_became_active":"2023-06-08T03:48:46.277856+0000","last_became_peered":"2023-06-08T03:48:46.277856+0000","last_unstale":"2023-06-08T03:48:51.294022+0000","last_undegraded":"2023-06-08T03:48:51.294022+0000","last_fullsized":"2023-06-08T03:48:51.294022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:05.154485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151419+0000","last_change":"2023-06-08T03:48:46.710096+0000","last_active":"2023-06-08T03:48:51.151419+0000","last_peered":"2023-06-08T03:48:51.151419+0000","last_clean":"2023-06-08T03:48:51.151419+0000","last_became_active":"2023-06-08T03:48:46.709818+0000","last_became_peered":"2023-06-08T03:48:46.709818+0000","last_unstale":"2023-06-08T03:48:51.151419+0000","last_undegraded":"2023-06-08T03:48:51.151419+0000","last_fullsized":"2023-06-08T03:48:51.151419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536871+0000","last_change":"2023-06-08T03:48:50.741926+0000","last_active":"2023-06-08T03:48:51.536871+0000","last_peered":"2023-06-08T03:48:51.536871+0000","last_clean":"2023-06-08T03:48:51.536871+0000","last_became_active":"2023-06-08T03:48:50.741525+0000","last_became_peered":"2023-06-08T03:48:50.741525+0000","last_unstale":"2023-06-08T03:48:51.536871+0000","last_undegraded":"2023-06-08T03:48:51.536871+0000","last_fullsized":"2023-06-08T03:48:51.536871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:51.416831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296460+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:48:51.296460+0000","last_peered":"2023-06-08T03:48:51.296460+0000","last_clean":"2023-06-08T03:48:51.296460+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:48:51.296460+0000","last_undegraded":"2023-06-08T03:48:51.296460+0000","last_fullsized":"2023-06-08T03:48:51.296460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:15.592925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536615+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:48:51.536615+0000","last_peered":"2023-06-08T03:48:51.536615+0000","last_clean":"2023-06-08T03:48:51.536615+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:48:51.536615+0000","last_undegraded":"2023-06-08T03:48:51.536615+0000","last_fullsized":"2023-06-08T03:48:51.536615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:57.059756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293693+0000","last_change":"2023-06-08T03:48:46.271960+0000","last_active":"2023-06-08T03:48:51.293693+0000","last_peered":"2023-06-08T03:48:51.293693+0000","last_clean":"2023-06-08T03:48:51.293693+0000","last_became_active":"2023-06-08T03:48:46.271631+0000","last_became_peered":"2023-06-08T03:48:46.271631+0000","last_unstale":"2023-06-08T03:48:51.293693+0000","last_undegraded":"2023-06-08T03:48:51.293693+0000","last_fullsized":"2023-06-08T03:48:51.293693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:39.928718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294243+0000","last_change":"2023-06-08T03:48:46.713531+0000","last_active":"2023-06-08T03:48:51.294243+0000","last_peered":"2023-06-08T03:48:51.294243+0000","last_clean":"2023-06-08T03:48:51.294243+0000","last_became_active":"2023-06-08T03:48:46.713244+0000","last_became_peered":"2023-06-08T03:48:46.713244+0000","last_unstale":"2023-06-08T03:48:51.294243+0000","last_undegraded":"2023-06-08T03:48:51.294243+0000","last_fullsized":"2023-06-08T03:48:51.294243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:15.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535548+0000","last_change":"2023-06-08T03:48:50.741357+0000","last_active":"2023-06-08T03:48:51.535548+0000","last_peered":"2023-06-08T03:48:51.535548+0000","last_clean":"2023-06-08T03:48:51.535548+0000","last_became_active":"2023-06-08T03:48:50.740948+0000","last_became_peered":"2023-06-08T03:48:50.740948+0000","last_unstale":"2023-06-08T03:48:51.535548+0000","last_undegraded":"2023-06-08T03:48:51.535548+0000","last_fullsized":"2023-06-08T03:48:51.535548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:30:29.499824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536124+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:48:51.536124+0000","last_peered":"2023-06-08T03:48:51.536124+0000","last_clean":"2023-06-08T03:48:51.536124+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:48:51.536124+0000","last_undegraded":"2023-06-08T03:48:51.536124+0000","last_fullsized":"2023-06-08T03:48:51.536124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:29.922704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296203+0000","last_change":"2023-06-08T03:48:46.277931+0000","last_active":"2023-06-08T03:48:51.296203+0000","last_peered":"2023-06-08T03:48:51.296203+0000","last_clean":"2023-06-08T03:48:51.296203+0000","last_became_active":"2023-06-08T03:48:46.277604+0000","last_became_peered":"2023-06-08T03:48:46.277604+0000","last_unstale":"2023-06-08T03:48:51.296203+0000","last_undegraded":"2023-06-08T03:48:51.296203+0000","last_fullsized":"2023-06-08T03:48:51.296203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:34.743166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297099+0000","last_change":"2023-06-08T03:48:46.705736+0000","last_active":"2023-06-08T03:48:51.297099+0000","last_peered":"2023-06-08T03:48:51.297099+0000","last_clean":"2023-06-08T03:48:51.297099+0000","last_became_active":"2023-06-08T03:48:46.705176+0000","last_became_peered":"2023-06-08T03:48:46.705176+0000","last_unstale":"2023-06-08T03:48:51.297099+0000","last_undegraded":"2023-06-08T03:48:51.297099+0000","last_fullsized":"2023-06-08T03:48:51.297099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536231+0000","last_change":"2023-06-08T03:48:50.742690+0000","last_active":"2023-06-08T03:48:51.536231+0000","last_peered":"2023-06-08T03:48:51.536231+0000","last_clean":"2023-06-08T03:48:51.536231+0000","last_became_active":"2023-06-08T03:48:50.742283+0000","last_became_peered":"2023-06-08T03:48:50.742283+0000","last_unstale":"2023-06-08T03:48:51.536231+0000","last_undegraded":"2023-06-08T03:48:51.536231+0000","last_fullsized":"2023-06-08T03:48:51.536231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:36.980926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535737+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:48:51.535737+0000","last_peered":"2023-06-08T03:48:51.535737+0000","last_clean":"2023-06-08T03:48:51.535737+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:48:51.535737+0000","last_undegraded":"2023-06-08T03:48:51.535737+0000","last_fullsized":"2023-06-08T03:48:51.535737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:37.932523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150042+0000","last_change":"2023-06-08T03:48:46.281860+0000","last_active":"2023-06-08T03:48:51.150042+0000","last_peered":"2023-06-08T03:48:51.150042+0000","last_clean":"2023-06-08T03:48:51.150042+0000","last_became_active":"2023-06-08T03:48:46.281558+0000","last_became_peered":"2023-06-08T03:48:46.281558+0000","last_unstale":"2023-06-08T03:48:51.150042+0000","last_undegraded":"2023-06-08T03:48:51.150042+0000","last_fullsized":"2023-06-08T03:48:51.150042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.712745+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.712473+0000","last_became_peered":"2023-06-08T03:48:46.712473+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:11.555796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294139+0000","last_change":"2023-06-08T03:48:50.741909+0000","last_active":"2023-06-08T03:48:51.294139+0000","last_peered":"2023-06-08T03:48:51.294139+0000","last_clean":"2023-06-08T03:48:51.294139+0000","last_became_active":"2023-06-08T03:48:50.741480+0000","last_became_peered":"2023-06-08T03:48:50.741480+0000","last_unstale":"2023-06-08T03:48:51.294139+0000","last_undegraded":"2023-06-08T03:48:51.294139+0000","last_fullsized":"2023-06-08T03:48:51.294139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:23:11.394158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535613+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:48:51.535613+0000","last_peered":"2023-06-08T03:48:51.535613+0000","last_clean":"2023-06-08T03:48:51.535613+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:48:51.535613+0000","last_undegraded":"2023-06-08T03:48:51.535613+0000","last_fullsized":"2023-06-08T03:48:51.535613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:08.960350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152806+0000","last_change":"2023-06-08T03:48:46.277332+0000","last_active":"2023-06-08T03:48:51.152806+0000","last_peered":"2023-06-08T03:48:51.152806+0000","last_clean":"2023-06-08T03:48:51.152806+0000","last_became_active":"2023-06-08T03:48:46.277048+0000","last_became_peered":"2023-06-08T03:48:46.277048+0000","last_unstale":"2023-06-08T03:48:51.152806+0000","last_undegraded":"2023-06-08T03:48:51.152806+0000","last_fullsized":"2023-06-08T03:48:51.152806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:20:43.010981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296324+0000","last_change":"2023-06-08T03:48:46.713941+0000","last_active":"2023-06-08T03:48:51.296324+0000","last_peered":"2023-06-08T03:48:51.296324+0000","last_clean":"2023-06-08T03:48:51.296324+0000","last_became_active":"2023-06-08T03:48:46.713519+0000","last_became_peered":"2023-06-08T03:48:46.713519+0000","last_unstale":"2023-06-08T03:48:51.296324+0000","last_undegraded":"2023-06-08T03:48:51.296324+0000","last_fullsized":"2023-06-08T03:48:51.296324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152339+0000","last_change":"2023-06-08T03:48:50.746277+0000","last_active":"2023-06-08T03:48:51.152339+0000","last_peered":"2023-06-08T03:48:51.152339+0000","last_clean":"2023-06-08T03:48:51.152339+0000","last_became_active":"2023-06-08T03:48:50.745762+0000","last_became_peered":"2023-06-08T03:48:50.745762+0000","last_unstale":"2023-06-08T03:48:51.152339+0000","last_undegraded":"2023-06-08T03:48:51.152339+0000","last_fullsized":"2023-06-08T03:48:51.152339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151603+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:48:51.151603+0000","last_peered":"2023-06-08T03:48:51.151603+0000","last_clean":"2023-06-08T03:48:51.151603+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:48:51.151603+0000","last_undegraded":"2023-06-08T03:48:51.151603+0000","last_fullsized":"2023-06-08T03:48:51.151603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:16.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296662+0000","last_change":"2023-06-08T03:48:46.280443+0000","last_active":"2023-06-08T03:48:51.296662+0000","last_peered":"2023-06-08T03:48:51.296662+0000","last_clean":"2023-06-08T03:48:51.296662+0000","last_became_active":"2023-06-08T03:48:46.280150+0000","last_became_peered":"2023-06-08T03:48:46.280150+0000","last_unstale":"2023-06-08T03:48:51.296662+0000","last_undegraded":"2023-06-08T03:48:51.296662+0000","last_fullsized":"2023-06-08T03:48:51.296662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:10.550497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294224+0000","last_change":"2023-06-08T03:48:46.704536+0000","last_active":"2023-06-08T03:48:51.294224+0000","last_peered":"2023-06-08T03:48:51.294224+0000","last_clean":"2023-06-08T03:48:51.294224+0000","last_became_active":"2023-06-08T03:48:46.704247+0000","last_became_peered":"2023-06-08T03:48:46.704247+0000","last_unstale":"2023-06-08T03:48:51.294224+0000","last_undegraded":"2023-06-08T03:48:51.294224+0000","last_fullsized":"2023-06-08T03:48:51.294224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294090+0000","last_change":"2023-06-08T03:48:50.746038+0000","last_active":"2023-06-08T03:48:51.294090+0000","last_peered":"2023-06-08T03:48:51.294090+0000","last_clean":"2023-06-08T03:48:51.294090+0000","last_became_active":"2023-06-08T03:48:50.742671+0000","last_became_peered":"2023-06-08T03:48:50.742671+0000","last_unstale":"2023-06-08T03:48:51.294090+0000","last_undegraded":"2023-06-08T03:48:51.294090+0000","last_fullsized":"2023-06-08T03:48:51.294090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:35.814289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151774+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:48:51.151774+0000","last_peered":"2023-06-08T03:48:51.151774+0000","last_clean":"2023-06-08T03:48:51.151774+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:48:51.151774+0000","last_undegraded":"2023-06-08T03:48:51.151774+0000","last_fullsized":"2023-06-08T03:48:51.151774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:42.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536891+0000","last_change":"2023-06-08T03:48:46.279903+0000","last_active":"2023-06-08T03:48:51.536891+0000","last_peered":"2023-06-08T03:48:51.536891+0000","last_clean":"2023-06-08T03:48:51.536891+0000","last_became_active":"2023-06-08T03:48:46.279643+0000","last_became_peered":"2023-06-08T03:48:46.279643+0000","last_unstale":"2023-06-08T03:48:51.536891+0000","last_undegraded":"2023-06-08T03:48:51.536891+0000","last_fullsized":"2023-06-08T03:48:51.536891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296218+0000","last_change":"2023-06-08T03:48:46.710102+0000","last_active":"2023-06-08T03:48:51.296218+0000","last_peered":"2023-06-08T03:48:51.296218+0000","last_clean":"2023-06-08T03:48:51.296218+0000","last_became_active":"2023-06-08T03:48:46.708006+0000","last_became_peered":"2023-06-08T03:48:46.708006+0000","last_unstale":"2023-06-08T03:48:51.296218+0000","last_undegraded":"2023-06-08T03:48:51.296218+0000","last_fullsized":"2023-06-08T03:48:51.296218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:22.614696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296866+0000","last_change":"2023-06-08T03:48:50.745383+0000","last_active":"2023-06-08T03:48:51.296866+0000","last_peered":"2023-06-08T03:48:51.296866+0000","last_clean":"2023-06-08T03:48:51.296866+0000","last_became_active":"2023-06-08T03:48:50.744898+0000","last_became_peered":"2023-06-08T03:48:50.744898+0000","last_unstale":"2023-06-08T03:48:51.296866+0000","last_undegraded":"2023-06-08T03:48:51.296866+0000","last_fullsized":"2023-06-08T03:48:51.296866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:19.011259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294205+0000","last_change":"2023-06-08T03:48:46.272132+0000","last_active":"2023-06-08T03:48:51.294205+0000","last_peered":"2023-06-08T03:48:51.294205+0000","last_clean":"2023-06-08T03:48:51.294205+0000","last_became_active":"2023-06-08T03:48:46.271635+0000","last_became_peered":"2023-06-08T03:48:46.271635+0000","last_unstale":"2023-06-08T03:48:51.294205+0000","last_undegraded":"2023-06-08T03:48:51.294205+0000","last_fullsized":"2023-06-08T03:48:51.294205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:18.843927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535531+0000","last_change":"2023-06-08T03:48:46.716188+0000","last_active":"2023-06-08T03:48:51.535531+0000","last_peered":"2023-06-08T03:48:51.535531+0000","last_clean":"2023-06-08T03:48:51.535531+0000","last_became_active":"2023-06-08T03:48:46.715960+0000","last_became_peered":"2023-06-08T03:48:46.715960+0000","last_unstale":"2023-06-08T03:48:51.535531+0000","last_undegraded":"2023-06-08T03:48:51.535531+0000","last_fullsized":"2023-06-08T03:48:51.535531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:59:38.213584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536363+0000","last_change":"2023-06-08T03:48:50.741907+0000","last_active":"2023-06-08T03:48:51.536363+0000","last_peered":"2023-06-08T03:48:51.536363+0000","last_clean":"2023-06-08T03:48:51.536363+0000","last_became_active":"2023-06-08T03:48:50.741526+0000","last_became_peered":"2023-06-08T03:48:50.741526+0000","last_unstale":"2023-06-08T03:48:51.536363+0000","last_undegraded":"2023-06-08T03:48:51.536363+0000","last_fullsized":"2023-06-08T03:48:51.536363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536462+0000","last_change":"2023-06-08T03:48:46.283972+0000","last_active":"2023-06-08T03:48:51.536462+0000","last_peered":"2023-06-08T03:48:51.536462+0000","last_clean":"2023-06-08T03:48:51.536462+0000","last_became_active":"2023-06-08T03:48:46.283686+0000","last_became_peered":"2023-06-08T03:48:46.283686+0000","last_unstale":"2023-06-08T03:48:51.536462+0000","last_undegraded":"2023-06-08T03:48:51.536462+0000","last_fullsized":"2023-06-08T03:48:51.536462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152862+0000","last_change":"2023-06-08T03:48:46.708793+0000","last_active":"2023-06-08T03:48:51.152862+0000","last_peered":"2023-06-08T03:48:51.152862+0000","last_clean":"2023-06-08T03:48:51.152862+0000","last_became_active":"2023-06-08T03:48:46.708492+0000","last_became_peered":"2023-06-08T03:48:46.708492+0000","last_unstale":"2023-06-08T03:48:51.152862+0000","last_undegraded":"2023-06-08T03:48:51.152862+0000","last_fullsized":"2023-06-08T03:48:51.152862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:54:28.053659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537064+0000","last_change":"2023-06-08T03:48:50.748191+0000","last_active":"2023-06-08T03:48:51.537064+0000","last_peered":"2023-06-08T03:48:51.537064+0000","last_clean":"2023-06-08T03:48:51.537064+0000","last_became_active":"2023-06-08T03:48:50.747824+0000","last_became_peered":"2023-06-08T03:48:50.747824+0000","last_unstale":"2023-06-08T03:48:51.537064+0000","last_undegraded":"2023-06-08T03:48:51.537064+0000","last_fullsized":"2023-06-08T03:48:51.537064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:16.373129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536733+0000","last_change":"2023-06-08T03:48:46.283956+0000","last_active":"2023-06-08T03:48:51.536733+0000","last_peered":"2023-06-08T03:48:51.536733+0000","last_clean":"2023-06-08T03:48:51.536733+0000","last_became_active":"2023-06-08T03:48:46.283667+0000","last_became_peered":"2023-06-08T03:48:46.283667+0000","last_unstale":"2023-06-08T03:48:51.536733+0000","last_undegraded":"2023-06-08T03:48:51.536733+0000","last_fullsized":"2023-06-08T03:48:51.536733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:43.022334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151349+0000","last_change":"2023-06-08T03:48:46.705342+0000","last_active":"2023-06-08T03:48:51.151349+0000","last_peered":"2023-06-08T03:48:51.151349+0000","last_clean":"2023-06-08T03:48:51.151349+0000","last_became_active":"2023-06-08T03:48:46.704758+0000","last_became_peered":"2023-06-08T03:48:46.704758+0000","last_unstale":"2023-06-08T03:48:51.151349+0000","last_undegraded":"2023-06-08T03:48:51.151349+0000","last_fullsized":"2023-06-08T03:48:51.151349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:03.775564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150985+0000","last_change":"2023-06-08T03:48:50.749457+0000","last_active":"2023-06-08T03:48:51.150985+0000","last_peered":"2023-06-08T03:48:51.150985+0000","last_clean":"2023-06-08T03:48:51.150985+0000","last_became_active":"2023-06-08T03:48:50.749024+0000","last_became_peered":"2023-06-08T03:48:50.749024+0000","last_unstale":"2023-06-08T03:48:51.150985+0000","last_undegraded":"2023-06-08T03:48:51.150985+0000","last_fullsized":"2023-06-08T03:48:51.150985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150602+0000","last_change":"2023-06-08T03:48:46.274180+0000","last_active":"2023-06-08T03:48:51.150602+0000","last_peered":"2023-06-08T03:48:51.150602+0000","last_clean":"2023-06-08T03:48:51.150602+0000","last_became_active":"2023-06-08T03:48:46.273751+0000","last_became_peered":"2023-06-08T03:48:46.273751+0000","last_unstale":"2023-06-08T03:48:51.150602+0000","last_undegraded":"2023-06-08T03:48:51.150602+0000","last_fullsized":"2023-06-08T03:48:51.150602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149813+0000","last_change":"2023-06-08T03:48:46.699197+0000","last_active":"2023-06-08T03:48:51.149813+0000","last_peered":"2023-06-08T03:48:51.149813+0000","last_clean":"2023-06-08T03:48:51.149813+0000","last_became_active":"2023-06-08T03:48:46.698921+0000","last_became_peered":"2023-06-08T03:48:46.698921+0000","last_unstale":"2023-06-08T03:48:51.149813+0000","last_undegraded":"2023-06-08T03:48:51.149813+0000","last_fullsized":"2023-06-08T03:48:51.149813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296459+0000","last_change":"2023-06-08T03:48:50.742031+0000","last_active":"2023-06-08T03:48:51.296459+0000","last_peered":"2023-06-08T03:48:51.296459+0000","last_clean":"2023-06-08T03:48:51.296459+0000","last_became_active":"2023-06-08T03:48:50.741621+0000","last_became_peered":"2023-06-08T03:48:50.741621+0000","last_unstale":"2023-06-08T03:48:51.296459+0000","last_undegraded":"2023-06-08T03:48:51.296459+0000","last_fullsized":"2023-06-08T03:48:51.296459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:59.951799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294491+0000","last_change":"2023-06-08T03:48:46.280946+0000","last_active":"2023-06-08T03:48:51.294491+0000","last_peered":"2023-06-08T03:48:51.294491+0000","last_clean":"2023-06-08T03:48:51.294491+0000","last_became_active":"2023-06-08T03:48:46.279562+0000","last_became_peered":"2023-06-08T03:48:46.279562+0000","last_unstale":"2023-06-08T03:48:51.294491+0000","last_undegraded":"2023-06-08T03:48:51.294491+0000","last_fullsized":"2023-06-08T03:48:51.294491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151164+0000","last_change":"2023-06-08T03:48:46.709469+0000","last_active":"2023-06-08T03:48:51.151164+0000","last_peered":"2023-06-08T03:48:51.151164+0000","last_clean":"2023-06-08T03:48:51.151164+0000","last_became_active":"2023-06-08T03:48:46.709131+0000","last_became_peered":"2023-06-08T03:48:46.709131+0000","last_unstale":"2023-06-08T03:48:51.151164+0000","last_undegraded":"2023-06-08T03:48:51.151164+0000","last_fullsized":"2023-06-08T03:48:51.151164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:09.642499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151705+0000","last_change":"2023-06-08T03:48:46.699962+0000","last_active":"2023-06-08T03:48:51.151705+0000","last_peered":"2023-06-08T03:48:51.151705+0000","last_clean":"2023-06-08T03:48:51.151705+0000","last_became_active":"2023-06-08T03:48:46.699670+0000","last_became_peered":"2023-06-08T03:48:46.699670+0000","last_unstale":"2023-06-08T03:48:51.151705+0000","last_undegraded":"2023-06-08T03:48:51.151705+0000","last_fullsized":"2023-06-08T03:48:51.151705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:16.254429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150141+0000","last_change":"2023-06-08T03:48:46.712641+0000","last_active":"2023-06-08T03:48:51.150141+0000","last_peered":"2023-06-08T03:48:51.150141+0000","last_clean":"2023-06-08T03:48:51.150141+0000","last_became_active":"2023-06-08T03:48:46.712338+0000","last_became_peered":"2023-06-08T03:48:46.712338+0000","last_unstale":"2023-06-08T03:48:51.150141+0000","last_undegraded":"2023-06-08T03:48:51.150141+0000","last_fullsized":"2023-06-08T03:48:51.150141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:42.915864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152242+0000","last_change":"2023-06-08T03:48:46.711282+0000","last_active":"2023-06-08T03:48:51.152242+0000","last_peered":"2023-06-08T03:48:51.152242+0000","last_clean":"2023-06-08T03:48:51.152242+0000","last_became_active":"2023-06-08T03:48:46.711006+0000","last_became_peered":"2023-06-08T03:48:46.711006+0000","last_unstale":"2023-06-08T03:48:51.152242+0000","last_undegraded":"2023-06-08T03:48:51.152242+0000","last_fullsized":"2023-06-08T03:48:51.152242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:23:18.302863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150081+0000","last_change":"2023-06-08T03:48:46.711221+0000","last_active":"2023-06-08T03:48:51.150081+0000","last_peered":"2023-06-08T03:48:51.150081+0000","last_clean":"2023-06-08T03:48:51.150081+0000","last_became_active":"2023-06-08T03:48:46.710772+0000","last_became_peered":"2023-06-08T03:48:46.710772+0000","last_unstale":"2023-06-08T03:48:51.150081+0000","last_undegraded":"2023-06-08T03:48:51.150081+0000","last_fullsized":"2023-06-08T03:48:51.150081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296341+0000","last_change":"2023-06-08T03:48:46.712982+0000","last_active":"2023-06-08T03:48:51.296341+0000","last_peered":"2023-06-08T03:48:51.296341+0000","last_clean":"2023-06-08T03:48:51.296341+0000","last_became_active":"2023-06-08T03:48:46.712737+0000","last_became_peered":"2023-06-08T03:48:46.712737+0000","last_unstale":"2023-06-08T03:48:51.296341+0000","last_undegraded":"2023-06-08T03:48:51.296341+0000","last_fullsized":"2023-06-08T03:48:51.296341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:48.748581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4451,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":703638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:49:05.300 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-08T03:49:05.300 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-08T03:49:05.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-08T03:49:05.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-08T03:49:05.301 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-08T03:49:05.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.452+0000 7f66afe57700 1 Processor -- start 2023-06-08T03:49:05.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.452+0000 7f66afe57700 1 -- start start 2023-06-08T03:49:05.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66afe57700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 0x7f66a80cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66afe57700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 0x7f66a80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66afe57700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80cf1d0 con 0x7f66a80b80d0 2023-06-08T03:49:05.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66afe57700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80ccfc0 con 0x7f66a80b5000 2023-06-08T03:49:05.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66afe57700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80cd790 con 0x7f66a80cfba0 2023-06-08T03:49:05.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66ae3f4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 0x7f66a80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66ad3f2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 0x7f66a80cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66ad3f2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 0x7f66a80cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:39920/0 (socket says 172.21.15.43:39920) 2023-06-08T03:49:05.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66ae3f4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 0x7f66a80b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51762/0 (socket says 172.21.15.43:51762) 2023-06-08T03:49:05.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.453+0000 7f66ad3f2700 1 -- 172.21.15.43:0/2221589482 learned_addr learned my addr 172.21.15.43:0/2221589482 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:05.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2221589482 >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 msgr2=0x7f66a80cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:05.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66ae3f4700 1 --2- 172.21.15.43:0/2221589482 >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 0x7f66a80cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2221589482 >> v1:172.21.15.135:6789/0 conn(0x7f66a80b80d0 legacy=0x7f66a81606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2221589482 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80cebc0 con 0x7f66a80cfba0 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66ad3f2700 1 --2- 172.21.15.43:0/2221589482 >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 0x7f66a80cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66ae3f4700 1 --2- 172.21.15.43:0/2221589482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 0x7f66a80b43f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009d90 tx=0x7f66a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d384ca961acac2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66acbf1700 1 -- 172.21.15.43:0/2221589482 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000e070 con 0x7f66a80cfba0 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66acbf1700 1 -- 172.21.15.43:0/2221589482 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a000bb20 con 0x7f66a80cfba0 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66acbf1700 1 -- 172.21.15.43:0/2221589482 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0012430 con 0x7f66a80cfba0 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66afe57700 1 -- 172.21.15.43:0/2221589482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 msgr2=0x7f66a80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.454+0000 7f66afe57700 1 --2- 172.21.15.43:0/2221589482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 0x7f66a80b43f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009d90 tx=0x7f66a000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.455+0000 7f66afe57700 1 -- 172.21.15.43:0/2221589482 shutdown_connections 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.455+0000 7f66afe57700 1 --2- 172.21.15.43:0/2221589482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80cfba0 0x7f66a80b43f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.455+0000 7f66afe57700 1 --2- 172.21.15.43:0/2221589482 >> v2:172.21.15.135:3300/0 conn(0x7f66a80b5000 0x7f66a80cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.455+0000 7f66afe57700 1 -- 172.21.15.43:0/2221589482 >> 172.21.15.43:0/2221589482 conn(0x7f66a8072120 msgr2=0x7f66a806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.455+0000 7f66afe57700 1 -- 172.21.15.43:0/2221589482 shutdown_connections 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.455+0000 7f66afe57700 1 -- 172.21.15.43:0/2221589482 wait complete. 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.456+0000 7f66afe57700 1 Processor -- start 2023-06-08T03:49:05.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.456+0000 7f66afe57700 1 -- start start 2023-06-08T03:49:05.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66afe57700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80b5000 0x7f66a814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66afe57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a80b80d0 0x7f66a80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66afe57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 0x7f66a80b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66afe57700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a814e7c0 con 0x7f66a80cfba0 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66afe57700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80d0a70 con 0x7f66a80b80d0 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66afe57700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80d0d50 con 0x7f66a80b5000 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 0x7f66a80b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 0x7f66a80b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58312/0 (socket says 172.21.15.43:58312) 2023-06-08T03:49:05.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2286836026 learned_addr learned my addr 172.21.15.43:0/2286836026 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ad3f2700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a80b80d0 0x7f66a80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66adbf3700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80b5000 0x7f66a814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80b5000 msgr2=0x7f66a814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80b5000 0x7f66a814e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a80b80d0 msgr2=0x7f66a80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a80b80d0 0x7f66a80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 -- 172.21.15.43:0/2286836026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009550 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f66ae3f4700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 0x7f66a80b6630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66a0014040 tx=0x7f66a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.457+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0012430 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.458+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0020070 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.458+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a0009a70 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.458+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003ea0 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.458+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a80d1310 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.458+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a8073fa0 con 0x7f66a80cfba0 2023-06-08T03:49:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.459+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66a0004040 con 0x7f66a80cfba0 2023-06-08T03:49:05.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.459+0000 7f669e7fc700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f668c06ace0 0x7f668c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.459+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f66a0022070 con 0x7f66a80cfba0 2023-06-08T03:49:05.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.460+0000 7f66adbf3700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f668c06ace0 0x7f668c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.460+0000 7f66adbf3700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f668c06ace0 0x7f668c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6698007fd0 tx=0x7f6698009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.464+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f66a0056360 con 0x7f66a80cfba0 2023-06-08T03:49:05.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.720+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f66a806b870 con 0x7f66a80cfba0 2023-06-08T03:49:05.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.723+0000 7f669e7fc700 1 -- 172.21.15.43:0/2286836026 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170844 (secure 0 0 0) 0x7f66a0059980 con 0x7f66a80cfba0 2023-06-08T03:49:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:05.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f668c06ace0 msgr2=0x7f668c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f668c06ace0 0x7f668c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6698007fd0 tx=0x7f6698009040 comp rx=0 tx=0).stop 2023-06-08T03:49:05.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 msgr2=0x7f66a80b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 0x7f66a80b6630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66a0014040 tx=0x7f66a0004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 shutdown_connections 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f668c06ace0 0x7f668c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66a80cfba0 0x7f66a80b6630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a80b5000 0x7f66a814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 --2- 172.21.15.43:0/2286836026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a80b80d0 0x7f66a80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 >> 172.21.15.43:0/2286836026 conn(0x7f66a8072120 msgr2=0x7f66a815db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:05.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 shutdown_connections 2023-06-08T03:49:05.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.726+0000 7f66afe57700 1 -- 172.21.15.43:0/2286836026 wait complete. 2023-06-08T03:49:05.742 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":298241574},{"type":"v1","addr":"172.21.15.135:6833","nonce":298241574}]},"active_addr":"172.21.15.135:6833/298241574","active_change":"2023-06-08T03:48:33.550117+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2812591990}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":329187253}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1819992474}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":129654980}]}]} 2023-06-08T03:49:05.746 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-08T03:49:05.746 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-08T03:49:05.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:05.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.867+0000 7f00c1454700 1 Processor -- start 2023-06-08T03:49:05.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.867+0000 7f00c1454700 1 -- start start 2023-06-08T03:49:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00c1454700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc15c250 0x7f00bc0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00c1454700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f00bc0d23b0 0x7f00bc0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00c1454700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc0d0f50 con 0x7f00bc0d1f60 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00c1454700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc15c620 con 0x7f00bc0d23b0 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00c1454700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0d27f0 con 0x7f00bc15c250 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00bb7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f00bc0d23b0 0x7f00bc0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00ba7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f00bc0d1f60 0x7f00bc0b57c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53220/0 (socket says 172.21.15.43:53220) 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00bb7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f00bc0d23b0 0x7f00bc0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58318/0 (socket says 172.21.15.43:58318) 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.868+0000 7f00ba7fc700 1 -- 172.21.15.43:0/2798537002 learned_addr learned my addr 172.21.15.43:0/2798537002 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00baffd700 1 --2- 172.21.15.43:0/2798537002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc15c250 0x7f00bc0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00bb7fe700 1 -- 172.21.15.43:0/2798537002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc15c250 msgr2=0x7f00bc0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00bb7fe700 1 --2- 172.21.15.43:0/2798537002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc15c250 0x7f00bc0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00bb7fe700 1 -- 172.21.15.43:0/2798537002 >> v1:172.21.15.43:6789/0 conn(0x7f00bc0d1f60 legacy=0x7f00bc0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00bb7fe700 1 -- 172.21.15.43:0/2798537002 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0d11a0 con 0x7f00bc0d23b0 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00b9ffb700 1 -- 172.21.15.43:0/2798537002 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078237659 0 0) 0x7f00bc0d0f50 con 0x7f00bc0d1f60 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00bb7fe700 1 --2- 172.21.15.43:0/2798537002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d23b0 0x7f00bc0cebc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009d90 tx=0x7f00b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cec98a92eb7efa server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00b9ffb700 1 -- 172.21.15.43:0/2798537002 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400e070 con 0x7f00bc0d23b0 2023-06-08T03:49:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00b9ffb700 1 -- 172.21.15.43:0/2798537002 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400bbd0 con 0x7f00bc0d23b0 2023-06-08T03:49:05.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.869+0000 7f00b9ffb700 1 -- 172.21.15.43:0/2798537002 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4012430 con 0x7f00bc0d23b0 2023-06-08T03:49:05.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 -- 172.21.15.43:0/2798537002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d23b0 msgr2=0x7f00bc0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 --2- 172.21.15.43:0/2798537002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d23b0 0x7f00bc0cebc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009d90 tx=0x7f00b400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:05.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 -- 172.21.15.43:0/2798537002 shutdown_connections 2023-06-08T03:49:05.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 --2- 172.21.15.43:0/2798537002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d23b0 0x7f00bc0cebc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 --2- 172.21.15.43:0/2798537002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc15c250 0x7f00bc0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 -- 172.21.15.43:0/2798537002 >> 172.21.15.43:0/2798537002 conn(0x7f00bc072120 msgr2=0x7f00bc06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 -- 172.21.15.43:0/2798537002 shutdown_connections 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.870+0000 7f00c1454700 1 -- 172.21.15.43:0/2798537002 wait complete. 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.871+0000 7f00c1454700 1 Processor -- start 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.871+0000 7f00c1454700 1 -- start start 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00c1454700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 0x7f00bc157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00c1454700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc0d23b0 0x7f00bc156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00c1454700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00bc15c250 0x7f00bc0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00c1454700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0b6e10 con 0x7f00bc0d1f60 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00c1454700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0ca680 con 0x7f00bc15c250 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00c1454700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0cca00 con 0x7f00bc0d23b0 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 0x7f00bc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 0x7f00bc157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58320/0 (socket says 172.21.15.43:58320) 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 -- 172.21.15.43:0/3874310426 learned_addr learned my addr 172.21.15.43:0/3874310426 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:05.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00ba7fc700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc0d23b0 0x7f00bc156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 -- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc0d23b0 msgr2=0x7f00bc156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc0d23b0 0x7f00bc156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00bb7fe700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00bc15c250 0x7f00bc0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 -- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00bc15c250 msgr2=0x7f00bc0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00bc15c250 0x7f00bc0cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:05.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 -- 172.21.15.43:0/3874310426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009a70 con 0x7f00bc0d1f60 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00ba7fc700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc0d23b0 0x7f00bc156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.872+0000 7f00baffd700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 0x7f00bc157770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d800 tx=0x7f00ac00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.873+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0125f0 con 0x7f00bc0d1f60 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.873+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac012750 con 0x7f00bc0d1f60 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.873+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc0b6850 con 0x7f00bc0d1f60 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.873+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac012b00 con 0x7f00bc0d1f60 2023-06-08T03:49:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.873+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc157470 con 0x7f00bc0d1f60 2023-06-08T03:49:05.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.874+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc0ca960 con 0x7f00bc0d1f60 2023-06-08T03:49:05.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.874+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00ac012c60 con 0x7f00bc0d1f60 2023-06-08T03:49:05.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.874+0000 7f00b37fe700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f009c06ace0 0x7f009c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:05.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.875+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00ac089c00 con 0x7f00bc0d1f60 2023-06-08T03:49:05.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.875+0000 7f00ba7fc700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f009c06ace0 0x7f009c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:05.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.875+0000 7f00ba7fc700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f009c06ace0 0x7f009c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f00bc1f4ee0 tx=0x7f00a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:05.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:05.879+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00ac054940 con 0x7f00bc0d1f60 2023-06-08T03:49:06.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.078+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00bc0ca450 con 0x7f00bc0d1f60 2023-06-08T03:49:06.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.079+0000 7f00b37fe700 1 -- 172.21.15.43:0/3874310426 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f00bc0ca450 con 0x7f00bc0d1f60 2023-06-08T03:49:06.083 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:06.084 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:06.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f009c06ace0 msgr2=0x7f009c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f009c06ace0 0x7f009c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f00bc1f4ee0 tx=0x7f00a4009040 comp rx=0 tx=0).stop 2023-06-08T03:49:06.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 msgr2=0x7f00bc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 0x7f00bc157770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d800 tx=0x7f00ac00dbc0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 shutdown_connections 2023-06-08T03:49:06.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f009c06ace0 0x7f009c06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00bc0d1f60 0x7f00bc157770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00bc15c250 0x7f00bc0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 --2- 172.21.15.43:0/3874310426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00bc0d23b0 0x7f00bc156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 >> 172.21.15.43:0/3874310426 conn(0x7f00bc072120 msgr2=0x7f00bc0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 shutdown_connections 2023-06-08T03:49:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.081+0000 7f00c1454700 1 -- 172.21.15.43:0/3874310426 wait complete. 2023-06-08T03:49:06.098 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-08T03:49:06.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:06.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.218+0000 7fc73c092700 1 Processor -- start 2023-06-08T03:49:06.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.218+0000 7fc73c092700 1 -- start start 2023-06-08T03:49:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73c092700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc73406a4c0 0x7fc7340af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73c092700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340ccfa0 con 0x7fc73415c590 2023-06-08T03:49:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73c092700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340af050 con 0x7fc7340ccba0 2023-06-08T03:49:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73c092700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340afae0 con 0x7fc73406a4c0 2023-06-08T03:49:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73962d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc73406a4c0 0x7fc7340af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc739e2e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc73415c590 0x7fc734069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53232/0 (socket says 172.21.15.43:53232) 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc739e2e700 1 -- 172.21.15.43:0/2860429820 learned_addr learned my addr 172.21.15.43:0/2860429820 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73962d700 1 -- 172.21.15.43:0/2860429820 >> v1:172.21.15.135:6789/0 conn(0x7fc7340ccba0 legacy=0x7fc7340ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73962d700 1 -- 172.21.15.43:0/2860429820 >> v1:172.21.15.43:6789/0 conn(0x7fc73415c590 legacy=0x7fc734069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc73962d700 1 -- 172.21.15.43:0/2860429820 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340af800 con 0x7fc73406a4c0 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.219+0000 7fc738e2c700 1 -- 172.21.15.43:0/2860429820 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274551733 0 0) 0x7fc7340ccfa0 con 0x7fc73415c590 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73962d700 1 --2- 172.21.15.43:0/2860429820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7340af220 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc730009840 tx=0x7fc730009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5ce781d354cc13 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc738e2c700 1 -- 172.21.15.43:0/2860429820 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011830 con 0x7fc73406a4c0 2023-06-08T03:49:06.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc738e2c700 1 -- 172.21.15.43:0/2860429820 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730011990 con 0x7fc73406a4c0 2023-06-08T03:49:06.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc738e2c700 1 -- 172.21.15.43:0/2860429820 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011d20 con 0x7fc73406a4c0 2023-06-08T03:49:06.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 -- 172.21.15.43:0/2860429820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 msgr2=0x7fc7340af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 --2- 172.21.15.43:0/2860429820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7340af220 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc730009840 tx=0x7fc730009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 -- 172.21.15.43:0/2860429820 shutdown_connections 2023-06-08T03:49:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 --2- 172.21.15.43:0/2860429820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7340af220 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 -- 172.21.15.43:0/2860429820 >> 172.21.15.43:0/2860429820 conn(0x7fc73406b7e0 msgr2=0x7fc7340cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 -- 172.21.15.43:0/2860429820 shutdown_connections 2023-06-08T03:49:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.220+0000 7fc73c092700 1 -- 172.21.15.43:0/2860429820 wait complete. 2023-06-08T03:49:06.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 Processor -- start 2023-06-08T03:49:06.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 -- start start 2023-06-08T03:49:06.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7341556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7340ccba0 0x7fc7340b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc73415c590 0x7fc7340c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b41d0 con 0x7fc73406a4c0 2023-06-08T03:49:06.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b2ee0 con 0x7fc7340ccba0 2023-06-08T03:49:06.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.222+0000 7fc73c092700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b3130 con 0x7fc73415c590 2023-06-08T03:49:06.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7341556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7341556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58334/0 (socket says 172.21.15.43:58334) 2023-06-08T03:49:06.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 -- 172.21.15.43:0/3056515771 learned_addr learned my addr 172.21.15.43:0/3056515771 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc73962d700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7340ccba0 0x7fc7340b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc73a62f700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc73415c590 0x7fc7340c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 -- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc73415c590 msgr2=0x7fc7340c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc73415c590 0x7fc7340c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 -- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7340ccba0 msgr2=0x7fc7340b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7340ccba0 0x7fc7340b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 -- 172.21.15.43:0/3056515771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300094a0 con 0x7fc73406a4c0 2023-06-08T03:49:06.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc73a62f700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc73415c590 0x7fc7340c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc739e2e700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7341556c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c470 tx=0x7fc72400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240074e0 con 0x7fc73406a4c0 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc724007640 con 0x7fc73406a4c0 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340b3410 con 0x7fc73406a4c0 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724005a50 con 0x7fc73406a4c0 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.223+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7340b39d0 con 0x7fc73406a4c0 2023-06-08T03:49:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.224+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc734067090 con 0x7fc73406a4c0 2023-06-08T03:49:06.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.225+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc724005bb0 con 0x7fc73406a4c0 2023-06-08T03:49:06.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.225+0000 7fc72a7fc700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc71806ace0 0x7fc71806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.225+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc724088c70 con 0x7fc73406a4c0 2023-06-08T03:49:06.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.225+0000 7fc73962d700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc71806ace0 0x7fc71806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.226+0000 7fc73962d700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc71806ace0 0x7fc71806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc73406e360 tx=0x7fc73001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.230+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc724053a30 con 0x7fc73406a4c0 2023-06-08T03:49:06.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.425+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc734073fa0 con 0x7fc73406a4c0 2023-06-08T03:49:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.427+0000 7fc72a7fc700 1 -- 172.21.15.43:0/3056515771 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fc724017090 con 0x7fc73406a4c0 2023-06-08T03:49:06.431 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:06.431 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc71806ace0 msgr2=0x7fc71806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc71806ace0 0x7fc71806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc73406e360 tx=0x7fc73001c040 comp rx=0 tx=0).stop 2023-06-08T03:49:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 msgr2=0x7fc7341556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7341556c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c470 tx=0x7fc72400c830 comp rx=0 tx=0).stop 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 shutdown_connections 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc71806ace0 0x7fc71806d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc73406a4c0 0x7fc7341556c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc73415c590 0x7fc7340c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 --2- 172.21.15.43:0/3056515771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7340ccba0 0x7fc7340b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 >> 172.21.15.43:0/3056515771 conn(0x7fc73406b7e0 msgr2=0x7fc73406e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 shutdown_connections 2023-06-08T03:49:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.429+0000 7fc73c092700 1 -- 172.21.15.43:0/3056515771 wait complete. 2023-06-08T03:49:06.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-08T03:49:06.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-08T03:49:06.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-08T03:49:06.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-08T03:49:06.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-08T03:49:06.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-08T03:49:06.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-08T03:49:06.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-08T03:49:06.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.662+0000 7fb99f72e700 1 Processor -- start 2023-06-08T03:49:06.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.662+0000 7fb99f72e700 1 -- start start 2023-06-08T03:49:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.663+0000 7fb99f72e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb9980b0700 0x7fb9981592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.663+0000 7fb99f72e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9980cd290 0x7fb9980cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.663+0000 7fb99f72e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99806ffe0 con 0x7fb9980b0330 2023-06-08T03:49:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.663+0000 7fb99f72e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb998156140 con 0x7fb9980b0700 2023-06-08T03:49:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.663+0000 7fb99f72e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980c9670 con 0x7fb9980cd290 2023-06-08T03:49:06.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fbf09124700 1 Processor -- start 2023-06-08T03:49:06.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.663+0000 7fb99d4ca700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb9980b0330 0x7fb9980c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53246/0 (socket says 172.21.15.43:53246) 2023-06-08T03:49:06.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99d4ca700 1 -- 172.21.15.43:0/2388597983 learned_addr learned my addr 172.21.15.43:0/2388597983 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99dccb700 1 --2- 172.21.15.43:0/2388597983 >> v2:172.21.15.135:3300/0 conn(0x7fb9980cd290 0x7fb9980cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99ccc9700 1 --2- 172.21.15.43:0/2388597983 >> v2:172.21.15.43:3300/0 conn(0x7fb9980b0700 0x7fb9981592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99dccb700 1 -- 172.21.15.43:0/2388597983 >> v2:172.21.15.43:3300/0 conn(0x7fb9980b0700 msgr2=0x7fb9981592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99dccb700 1 --2- 172.21.15.43:0/2388597983 >> v2:172.21.15.43:3300/0 conn(0x7fb9980b0700 0x7fb9981592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99dccb700 1 -- 172.21.15.43:0/2388597983 >> v1:172.21.15.43:6789/0 conn(0x7fb9980b0330 legacy=0x7fb9980c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fb99dccb700 1 -- 172.21.15.43:0/2388597983 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980c9390 con 0x7fb9980cd290 2023-06-08T03:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.664+0000 7fbf09124700 1 -- start start 2023-06-08T03:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf09124700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf040adc70 0x7fbf040b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf09124700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf040b3600 0x7fbf0406cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf09124700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0406c550 con 0x7fbf041580f0 2023-06-08T03:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf09124700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0406cd60 con 0x7fbf040b3600 2023-06-08T03:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf09124700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf040b2c30 con 0x7fbf040adc70 2023-06-08T03:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf02d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbf041580f0 0x7fbf0415c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:40472/0 (socket says 172.21.15.43:40472) 2023-06-08T03:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf02d9d700 1 -- 172.21.15.43:0/316398462 learned_addr learned my addr 172.21.15.43:0/316398462 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.665+0000 7fbf0359e700 1 --2- 172.21.15.43:0/316398462 >> v2:172.21.15.43:3300/0 conn(0x7fbf040b3600 0x7fbf0406cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0259c700 1 -- 172.21.15.43:0/316398462 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23991501 0 0) 0x7fbf0406c550 con 0x7fbf041580f0 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0259c700 1 -- 172.21.15.43:0/316398462 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef00057c0 con 0x7fbf041580f0 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0359e700 1 -- 172.21.15.43:0/316398462 >> v2:172.21.15.135:3300/0 conn(0x7fbf040adc70 msgr2=0x7fbf040b30c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0359e700 1 --2- 172.21.15.43:0/316398462 >> v2:172.21.15.135:3300/0 conn(0x7fbf040adc70 0x7fbf040b30c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0359e700 1 -- 172.21.15.43:0/316398462 >> v1:172.21.15.135:6789/0 conn(0x7fbf041580f0 legacy=0x7fbf0415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0359e700 1 -- 172.21.15.43:0/316398462 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040b2900 con 0x7fbf040b3600 2023-06-08T03:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0359e700 1 --2- 172.21.15.43:0/316398462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040b3600 0x7fbf0406cf60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf04071770 tx=0x7fbefc009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df52199f10db7c2b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fb99dccb700 1 --2- 172.21.15.43:0/2388597983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 0x7fb9980cd730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb99806e790 tx=0x7fb99400acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e16eb558d2f537 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7f78035ec700 1 Processor -- start 2023-06-08T03:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0259c700 1 -- 172.21.15.43:0/316398462 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00b8c0 con 0x7fbf040b3600 2023-06-08T03:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0259c700 1 -- 172.21.15.43:0/316398462 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00ba20 con 0x7fbf040b3600 2023-06-08T03:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.666+0000 7fbf0259c700 1 -- 172.21.15.43:0/316398462 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00bdd0 con 0x7fbf040b3600 2023-06-08T03:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7f78035ec700 1 -- start start 2023-06-08T03:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7fbf09124700 1 -- 172.21.15.43:0/316398462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040b3600 msgr2=0x7fbf0406cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7fbf09124700 1 --2- 172.21.15.43:0/316398462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040b3600 0x7fbf0406cf60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf04071770 tx=0x7fbefc009f60 comp rx=0 tx=0).stop 2023-06-08T03:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7fbf09124700 1 -- 172.21.15.43:0/316398462 shutdown_connections 2023-06-08T03:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7fbf09124700 1 --2- 172.21.15.43:0/316398462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040b3600 0x7fbf0406cf60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7fbf09124700 1 --2- 172.21.15.43:0/316398462 >> v2:172.21.15.135:3300/0 conn(0x7fbf040adc70 0x7fbf040b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.667+0000 7fbf09124700 1 -- 172.21.15.43:0/316398462 >> 172.21.15.43:0/316398462 conn(0x7fbf04069db0 msgr2=0x7fbf0406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7fbf09124700 1 -- 172.21.15.43:0/316398462 shutdown_connections 2023-06-08T03:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7fbf09124700 1 -- 172.21.15.43:0/316398462 wait complete. 2023-06-08T03:49:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f78035ec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc159260 0x7f77fc071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f78035ec700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0ceb10 con 0x7f77fc0ca5f0 2023-06-08T03:49:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f78035ec700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc159630 con 0x7f77fc0cc730 2023-06-08T03:49:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f78035ec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0aeee0 con 0x7f77fc159260 2023-06-08T03:49:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f7800b87700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f77fc0ca5f0 0x7f77fc0cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53260/0 (socket says 172.21.15.43:53260) 2023-06-08T03:49:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f7800b87700 1 -- 172.21.15.43:0/2815712957 learned_addr learned my addr 172.21.15.43:0/2815712957 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.668+0000 7f7801388700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc159260 0x7f77fc071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.669+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967489536 0 0) 0x7f77ec001110 con 0x7f77fc0ca5f0 2023-06-08T03:49:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.669+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e80035b0 con 0x7f77fc0ca5f0 2023-06-08T03:49:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.669+0000 7fb98ffff700 1 -- 172.21.15.43:0/2388597983 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400cb70 con 0x7fb9980cd290 2023-06-08T03:49:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.669+0000 7fb98ffff700 1 -- 172.21.15.43:0/2388597983 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99400ccd0 con 0x7fb9980cd290 2023-06-08T03:49:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.669+0000 7fb98ffff700 1 -- 172.21.15.43:0/2388597983 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994018620 con 0x7fb9980cd290 2023-06-08T03:49:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 -- 172.21.15.43:0/2388597983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 msgr2=0x7fb9980cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 --2- 172.21.15.43:0/2388597983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 0x7fb9980cd730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb99806e790 tx=0x7fb99400acc0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fbf09124700 1 Processor -- start 2023-06-08T03:49:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 -- 172.21.15.43:0/2388597983 shutdown_connections 2023-06-08T03:49:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 --2- 172.21.15.43:0/2388597983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 0x7fb9980cd730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 --2- 172.21.15.43:0/2388597983 >> v2:172.21.15.43:3300/0 conn(0x7fb9980b0700 0x7fb9981592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 -- 172.21.15.43:0/2388597983 >> 172.21.15.43:0/2388597983 conn(0x7fb9980ce5c0 msgr2=0x7fb9980ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3988161681 0 0) 0x7f77e80035b0 con 0x7f77fc0ca5f0 2023-06-08T03:49:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc159260 msgr2=0x7f77fc071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc159260 0x7f77fc071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 >> v1:172.21.15.135:6789/0 conn(0x7f77fc0cc730 legacy=0x7f77fc15cce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0ce680 con 0x7f77fc0ca5f0 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f77ec001800 con 0x7f77fc0ca5f0 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 >> v1:172.21.15.43:6789/0 conn(0x7f77fc0ca5f0 legacy=0x7f77fc0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e8003a30 0x7f77e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e8004850 0x7f77e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8005320 0x7f77e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0aeee0 con 0x7f77e8003a30 2023-06-08T03:49:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e800c160 con 0x7f77e8004850 2023-06-08T03:49:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e800c320 con 0x7f77e8005320 2023-06-08T03:49:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 -- 172.21.15.43:0/2388597983 shutdown_connections 2023-06-08T03:49:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fbf09124700 1 -- start start 2023-06-08T03:49:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf09124700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040adc70 0x7fbf041fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf09124700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf040b3600 0x7fbf0415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf09124700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf041580f0 0x7fbf04149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf09124700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0415b530 con 0x7fbf040adc70 2023-06-08T03:49:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf09124700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0414d150 con 0x7fbf040b3600 2023-06-08T03:49:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf09124700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0414c580 con 0x7fbf041580f0 2023-06-08T03:49:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7f7800b87700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e8004850 0x7f77e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbefbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf040b3600 0x7fbf0415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbefbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf040b3600 0x7fbf0415aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:39978/0 (socket says 172.21.15.43:39978) 2023-06-08T03:49:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbefbfff700 1 -- 172.21.15.43:0/2144592687 learned_addr learned my addr 172.21.15.43:0/2144592687 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.671+0000 7fbf0359e700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf041580f0 0x7fbf04149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbf02d9d700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040adc70 0x7fbf041fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.670+0000 7fb99f72e700 1 -- 172.21.15.43:0/2388597983 wait complete. 2023-06-08T03:49:06.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fb99f72e700 1 Processor -- start 2023-06-08T03:49:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefbfff700 1 -- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf041580f0 msgr2=0x7fbf04149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefbfff700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf041580f0 0x7fbf04149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefbfff700 1 -- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040adc70 msgr2=0x7fbf041fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefbfff700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf040adc70 0x7fbf041fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefbfff700 1 -- 172.21.15.43:0/2144592687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc00d040 con 0x7fbf040b3600 2023-06-08T03:49:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefbfff700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf040b3600 0x7fbf0415aff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbef400b550 tx=0x7fbef400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011830 con 0x7fbf040b3600 2023-06-08T03:49:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.672+0000 7fb99f72e700 1 -- start start 2023-06-08T03:49:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99f72e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9980b0330 0x7fb9981f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99f72e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9980b0700 0x7fb9980c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99f72e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 0x7fb998157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99f72e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980c5600 con 0x7fb9980b0700 2023-06-08T03:49:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99f72e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981f5120 con 0x7fb9980cd290 2023-06-08T03:49:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99f72e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980c4650 con 0x7fb9980b0330 2023-06-08T03:49:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99d4ca700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9980b0330 0x7fb9981f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99d4ca700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9980b0330 0x7fb9981f4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51826/0 (socket says 172.21.15.43:51826) 2023-06-08T03:49:06.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99ccc9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9980b0700 0x7fb9980c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99d4ca700 1 -- 172.21.15.43:0/3650037110 learned_addr learned my addr 172.21.15.43:0/3650037110 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4011990 con 0x7fbf040b3600 2023-06-08T03:49:06.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf041f6250 con 0x7fbf040b3600 2023-06-08T03:49:06.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0414cb00 con 0x7fbf040b3600 2023-06-08T03:49:06.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7fb99dccb700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 0x7fb998157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fb99ccc9700 1 -- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9980b0330 msgr2=0x7fb9981f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fb99ccc9700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9980b0330 0x7fb9981f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fb99ccc9700 1 -- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 msgr2=0x7fb998157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fb99ccc9700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980cd290 0x7fb998157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fb99ccc9700 1 -- 172.21.15.43:0/3650037110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99400a640 con 0x7fb9980b0700 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801b89700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8005320 0x7f77e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e8003a30 0x7f77e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 -- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8005320 msgr2=0x7f77e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8005320 0x7f77e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 -- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e8004850 msgr2=0x7f77e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e8004850 0x7f77e8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 -- 172.21.15.43:0/2815712957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80035b0 con 0x7f77e8003a30 2023-06-08T03:49:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.673+0000 7f7801388700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e8003a30 0x7f77e8003e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77fc067240 tx=0x7f77e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4fd41b5ea125f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8004230 con 0x7f77e8003a30 2023-06-08T03:49:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8004390 con 0x7f77e8003a30 2023-06-08T03:49:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7f77f3fff700 1 -- 172.21.15.43:0/2815712957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80036a0 con 0x7f77e8003a30 2023-06-08T03:49:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fb99ccc9700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9980b0700 0x7fb9980c3f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb98800d5c0 tx=0x7fb98800d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011d40 con 0x7fbf040b3600 2023-06-08T03:49:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7f83ccd15700 1 Processor -- start 2023-06-08T03:49:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7f79171a3700 1 Processor -- start 2023-06-08T03:49:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.674+0000 7f79171a3700 1 -- start start 2023-06-08T03:49:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f78035ec700 1 -- 172.21.15.43:0/2815712957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e8003a30 msgr2=0x7f77e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f78035ec700 1 --2- 172.21.15.43:0/2815712957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e8003a30 0x7f77e8003e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77fc067240 tx=0x7f77e8005880 comp rx=0 tx=0).stop 2023-06-08T03:49:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f7801b89700 1 -- 172.21.15.43:0/2815712957 reap_dead start 2023-06-08T03:49:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f78035ec700 1 -- 172.21.15.43:0/2815712957 shutdown_connections 2023-06-08T03:49:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f78035ec700 1 -- 172.21.15.43:0/2815712957 >> 172.21.15.43:0/2815712957 conn(0x7f77fc06aec0 msgr2=0x7f77fc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f78035ec700 1 -- 172.21.15.43:0/2815712957 shutdown_connections 2023-06-08T03:49:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880125f0 con 0x7fb9980b0700 2023-06-08T03:49:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988012750 con 0x7fb9980b0700 2023-06-08T03:49:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988012ac0 con 0x7fb9980b0700 2023-06-08T03:49:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbef401a400 con 0x7fbf040b3600 2023-06-08T03:49:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fbefb7fe700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbee406adb0 0x7fbee406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbef4089640 con 0x7fbf040b3600 2023-06-08T03:49:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fe7bfd53700 1 Processor -- start 2023-06-08T03:49:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f83ccd15700 1 -- start start 2023-06-08T03:49:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.675+0000 7f78035ec700 1 -- 172.21.15.43:0/2815712957 wait complete. 2023-06-08T03:49:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f79171a3700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f79100b07d0 0x7f791015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f79171a3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f791015aad0 0x7f791015c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f79171a3700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791006e350 con 0x7f7910157da0 2023-06-08T03:49:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f79171a3700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791015b230 con 0x7f79100b07d0 2023-06-08T03:49:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f79171a3700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791015b840 con 0x7f791015aad0 2023-06-08T03:49:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7914f3f700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7910157da0 0x7f79100b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:40504/0 (socket says 172.21.15.43:40504) 2023-06-08T03:49:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7914f3f700 1 -- 172.21.15.43:0/3650322459 learned_addr learned my addr 172.21.15.43:0/3650322459 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9980c4930 con 0x7fb9980b0700 2023-06-08T03:49:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9980c57e0 con 0x7fb9980b0700 2023-06-08T03:49:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7915740700 1 --2- 172.21.15.43:0/3650322459 >> v2:172.21.15.135:3300/0 conn(0x7f791015aad0 0x7f791015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9980cca90 con 0x7fb9980b0700 2023-06-08T03:49:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7fe7bfd53700 1 -- start start 2023-06-08T03:49:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f790f7fe700 1 -- 172.21.15.43:0/3650322459 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474010729 0 0) 0x7f791006e350 con 0x7f7910157da0 2023-06-08T03:49:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f790f7fe700 1 -- 172.21.15.43:0/3650322459 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f80035b0 con 0x7f7910157da0 2023-06-08T03:49:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7915740700 1 -- 172.21.15.43:0/3650322459 >> v2:172.21.15.43:3300/0 conn(0x7f79100b07d0 msgr2=0x7f791015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7915740700 1 --2- 172.21.15.43:0/3650322459 >> v2:172.21.15.43:3300/0 conn(0x7f79100b07d0 0x7f791015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7915740700 1 -- 172.21.15.43:0/3650322459 >> v1:172.21.15.135:6789/0 conn(0x7f7910157da0 legacy=0x7f79100b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f7915740700 1 -- 172.21.15.43:0/3650322459 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791015bb20 con 0x7f791015aad0 2023-06-08T03:49:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fd3f6b9c700 1 Processor -- start 2023-06-08T03:49:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f7915740700 1 --2- 172.21.15.43:0/3650322459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791015c320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79100cb010 tx=0x7f7904009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d139b1f980c385b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fe7bfd53700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 0x7fe7b81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fe7bfd53700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe7b80c8b80 0x7fe7b80b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fe7bfd53700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b806ffe0 con 0x7fe7b80b0600 2023-06-08T03:49:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fe7bfd53700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b8156140 con 0x7fe7b80c8b80 2023-06-08T03:49:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fe7bfd53700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80b0a80 con 0x7fe7b80cf0a0 2023-06-08T03:49:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fe7bdaef700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 0x7fe7b81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fe7bdaef700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 0x7fe7b81592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51850/0 (socket says 172.21.15.43:51850) 2023-06-08T03:49:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fe7bdaef700 1 -- 172.21.15.43:0/1250612217 learned_addr learned my addr 172.21.15.43:0/1250612217 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f790f7fe700 1 -- 172.21.15.43:0/3650322459 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904004230 con 0x7f791015aad0 2023-06-08T03:49:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb988012c20 con 0x7fb9980b0700 2023-06-08T03:49:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f790f7fe700 1 -- 172.21.15.43:0/3650322459 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7904004390 con 0x7f791015aad0 2023-06-08T03:49:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f790f7fe700 1 -- 172.21.15.43:0/3650322459 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040036a0 con 0x7f791015aad0 2023-06-08T03:49:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb98dffb700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb97c06ad30 0x7fb97c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb98808a120 con 0x7fb9980b0700 2023-06-08T03:49:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb99d4ca700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb97c06ad30 0x7fb97c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb98dffb700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] conn(0x7fb97c074a00 0x7fb97c076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 --> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb97c077500 con 0x7fb97c074a00 2023-06-08T03:49:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb98808a5c0 con 0x7fb9980b0700 2023-06-08T03:49:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f79171a3700 1 -- 172.21.15.43:0/3650322459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 msgr2=0x7f791015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f79171a3700 1 --2- 172.21.15.43:0/3650322459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791015c320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79100cb010 tx=0x7f7904009b20 comp rx=0 tx=0).stop 2023-06-08T03:49:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f78035ec700 1 Processor -- start 2023-06-08T03:49:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7fb99dccb700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] conn(0x7fb97c074a00 0x7fb97c076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f79171a3700 1 -- 172.21.15.43:0/3650322459 shutdown_connections 2023-06-08T03:49:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f79171a3700 1 --2- 172.21.15.43:0/3650322459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791015c320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f79171a3700 1 --2- 172.21.15.43:0/3650322459 >> v2:172.21.15.43:3300/0 conn(0x7f79100b07d0 0x7f791015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f79171a3700 1 -- 172.21.15.43:0/3650322459 >> 172.21.15.43:0/3650322459 conn(0x7f79100ce5c0 msgr2=0x7f79100ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7f78035ec700 1 -- start start 2023-06-08T03:49:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7fb99d4ca700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb97c06ad30 0x7fb97c06d1e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb9900012e0 tx=0x7fb990006340 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7fb99dccb700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] conn(0x7fb97c074a00 0x7fb97c076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f83ccd15700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 0x7f83c81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f83ccd15700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f83c80b0700 0x7f83c80cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f83ccd15700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c806ffe0 con 0x7f83c80cf0a0 2023-06-08T03:49:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f83ccd15700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c8156140 con 0x7f83c80b0700 2023-06-08T03:49:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7f83ccd15700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80c9670 con 0x7f83c80b0330 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f83c5d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f83c80cf0a0 0x7f83c80c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53286/0 (socket says 172.21.15.43:53286) 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7f83c5d9b700 1 -- 172.21.15.43:0/1603287691 learned_addr learned my addr 172.21.15.43:0/1603287691 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247065502 0 0) 0x7f83c806ffe0 con 0x7f83c80cf0a0 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b00035b0 con 0x7f83c80cf0a0 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c659c700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 0x7f83c81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/1603287691 >> v2:172.21.15.43:3300/0 conn(0x7f83c80b0700 0x7f83c80cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1093133578 0 0) 0x7f83b00035b0 con 0x7f83c80cf0a0 2023-06-08T03:49:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 msgr2=0x7f83c81592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 0x7f83c81592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 >> v2:172.21.15.43:3300/0 conn(0x7f83c80b0700 msgr2=0x7f83c80cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 --2- 172.21.15.43:0/1603287691 >> v2:172.21.15.43:3300/0 conn(0x7f83c80b0700 0x7f83c80cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80c9390 con 0x7f83c80cf0a0 2023-06-08T03:49:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f83bc001670 con 0x7f83c80cf0a0 2023-06-08T03:49:06.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fd3f6b9c700 1 -- start start 2023-06-08T03:49:06.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fd3f6b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b0330 0x7fd3f01592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fd3f6b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd3f00b0700 0x7fd3f00c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fd3f6b9c700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f006ffe0 con 0x7fd3f0069db0 2023-06-08T03:49:06.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fd3f6b9c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f0156140 con 0x7fd3f00b0700 2023-06-08T03:49:06.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fd3f6b9c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c9670 con 0x7fd3f00b0330 2023-06-08T03:49:06.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 >> v1:172.21.15.43:6789/0 conn(0x7f83c80cf0a0 legacy=0x7f83c80c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b0003a00 0x7f83b0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 0x7f83b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0004d90 0x7f83b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8156140 con 0x7f83b0004d90 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80c9670 con 0x7f83b0003a00 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b002da50 con 0x7f83c80b0330 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c659c700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b0003a00 0x7f83b0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0004d90 0x7f83b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c5d9b700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 0x7f83b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 -- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 msgr2=0x7f83b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83c80b0330 0x7f83b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 -- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b0003a00 msgr2=0x7f83b0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b0003a00 0x7f83b0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 -- 172.21.15.43:0/1603287691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b00035b0 con 0x7f83b0004d90 2023-06-08T03:49:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f83c659c700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b0003a00 0x7f83b0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fbf02d9d700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbee406adb0 0x7fbee406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fbf09124700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] conn(0x7fbee80015e0 0x7fbee8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.676+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 --> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbee8006bc0 con 0x7fbee80015e0 2023-06-08T03:49:06.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7fd3f5139700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd3f0069db0 0x7fd3f006a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:40532/0 (socket says 172.21.15.43:40532) 2023-06-08T03:49:06.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7fd3f5139700 1 -- 172.21.15.43:0/3774608414 learned_addr learned my addr 172.21.15.43:0/3774608414 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:06.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.677+0000 7fbf02d9d700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbee406adb0 0x7fbee406d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbeec004a60 tx=0x7fbeec006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.678+0000 7fbf0359e700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] conn(0x7fbee80015e0 0x7fbee8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7fbf0359e700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] conn(0x7fbee80015e0 0x7fbee8003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.680+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== osd.0 v2:172.21.15.43:6816/2337618237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbee8006bc0 con 0x7fbee80015e0 2023-06-08T03:49:06.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.679+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0004d90 0x7f83b0005200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83c00093c0 tx=0x7f83b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c946ed987a191688 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f78035ec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8003a30 0x7f77fc0b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f78035ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77fc0b0680 0x7f77fc0b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f78035ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc1528e0 0x7f77fc152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f78035ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc15a3f0 con 0x7f77fc0b0680 2023-06-08T03:49:06.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f78035ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc15a6d0 con 0x7f77fc1528e0 2023-06-08T03:49:06.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f78035ec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc15a9b0 con 0x7f77e8003a30 2023-06-08T03:49:06.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140793380 0 0) 0x7fd3f006ffe0 con 0x7fd3f0069db0 2023-06-08T03:49:06.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e00035b0 con 0x7fd3f0069db0 2023-06-08T03:49:06.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== osd.7 v2:172.21.15.135:6824/3149048166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb97c077500 con 0x7fb97c074a00 2023-06-08T03:49:06.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7fd3f4938700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b0330 0x7fd3f01592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f79171a3700 1 -- 172.21.15.43:0/3650322459 shutdown_connections 2023-06-08T03:49:06.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f79171a3700 1 -- 172.21.15.43:0/3650322459 wait complete. 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128920806 0 0) 0x7fd3e00035b0 con 0x7fd3f0069db0 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b0330 msgr2=0x7fd3f01592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b0330 0x7fd3f01592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 >> v2:172.21.15.135:3300/0 conn(0x7fd3f00b0700 msgr2=0x7fd3f00c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 --2- 172.21.15.43:0/3774608414 >> v2:172.21.15.135:3300/0 conn(0x7fd3f00b0700 0x7fd3f00c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00c90c0 con 0x7fd3f0069db0 2023-06-08T03:49:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7fd3e80019f0 con 0x7fd3f0069db0 2023-06-08T03:49:06.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 >> v1:172.21.15.135:6789/0 conn(0x7fd3f0069db0 legacy=0x7fd3f006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3e0003bd0 0x7fd3e0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3e00066c0 0x7fd3e0008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e00092f0 0x7fd3e0009760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0156140 con 0x7fd3e0003bd0 2023-06-08T03:49:06.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c9670 con 0x7fd3e00092f0 2023-06-08T03:49:06.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e000a0c0 con 0x7fd3e00066c0 2023-06-08T03:49:06.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0009e80 con 0x7f83b0004d90 2023-06-08T03:49:06.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000c410 con 0x7f83b0004d90 2023-06-08T03:49:06.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f83c559a700 1 -- 172.21.15.43:0/1603287691 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000c7c0 con 0x7f83b0004d90 2023-06-08T03:49:06.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f7800b87700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77fc0b0680 0x7f77fc0b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f7800b87700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77fc0b0680 0x7f77fc0b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58416/0 (socket says 172.21.15.43:58416) 2023-06-08T03:49:06.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.681+0000 7f7800b87700 1 -- 172.21.15.43:0/3803314219 learned_addr learned my addr 172.21.15.43:0/3803314219 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7801b89700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc1528e0 0x7f77fc152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7801388700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8003a30 0x7f77fc0b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7800b87700 1 -- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8003a30 msgr2=0x7f77fc0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7800b87700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77e8003a30 0x7f77fc0b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7800b87700 1 -- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc1528e0 msgr2=0x7f77fc152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7800b87700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc1528e0 0x7f77fc152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7800b87700 1 -- 172.21.15.43:0/3803314219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc15ac90 con 0x7f77fc0b0680 2023-06-08T03:49:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7f7801b89700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc1528e0 0x7f77fc152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:06.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.682+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e00092f0 0x7fd3e0009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3effff700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3e00066c0 0x7fd3e0008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3f5139700 1 -- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3e00066c0 msgr2=0x7fd3e0008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3e00066c0 0x7fd3e0008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3f5139700 1 -- 172.21.15.43:0/3774608414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3e0003bd0 msgr2=0x7fd3e0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3e0003bd0 0x7fd3e0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3f5139700 1 -- 172.21.15.43:0/3774608414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00c90c0 con 0x7fd3e00092f0 2023-06-08T03:49:06.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f83ccd15700 1 -- 172.21.15.43:0/1603287691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0004d90 msgr2=0x7f83b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f83ccd15700 1 --2- 172.21.15.43:0/1603287691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0004d90 0x7f83b0005200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83c00093c0 tx=0x7f83b0005880 comp rx=0 tx=0).stop 2023-06-08T03:49:06.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f83c6d9d700 1 -- 172.21.15.43:0/1603287691 reap_dead start 2023-06-08T03:49:06.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3effff700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3e00066c0 0x7fd3e0008b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:06.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f83ccd15700 1 -- 172.21.15.43:0/1603287691 shutdown_connections 2023-06-08T03:49:06.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f83ccd15700 1 -- 172.21.15.43:0/1603287691 >> 172.21.15.43:0/1603287691 conn(0x7f83c80ce5c0 msgr2=0x7f83c80ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7f83ccd15700 1 -- 172.21.15.43:0/1603287691 shutdown_connections 2023-06-08T03:49:06.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f7800b87700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77fc0b0680 0x7f77fc0b0af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77ec007290 tx=0x7f77ec0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e00092f0 0x7fd3e0009760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800a8a0 tx=0x7fd3e0003860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71e25bcdc0a6f40 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8012600 con 0x7fd3e00092f0 2023-06-08T03:49:06.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e8012780 con 0x7fd3e00092f0 2023-06-08T03:49:06.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.683+0000 7f79171a3700 1 Processor -- start 2023-06-08T03:49:06.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7f79171a3700 1 -- start start 2023-06-08T03:49:06.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7f83ccd15700 1 -- 172.21.15.43:0/1603287691 wait complete. 2023-06-08T03:49:06.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fd3ef7fe700 1 -- 172.21.15.43:0/3774608414 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8012b30 con 0x7fd3e00092f0 2023-06-08T03:49:06.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fe7bd2ee700 1 --2- 172.21.15.43:0/1250612217 >> v2:172.21.15.135:3300/0 conn(0x7fe7b80c8b80 0x7fe7b80b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fe7bdaef700 1 -- 172.21.15.43:0/1250612217 >> v2:172.21.15.135:3300/0 conn(0x7fe7b80c8b80 msgr2=0x7fe7b80b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fe7bdaef700 1 --2- 172.21.15.43:0/1250612217 >> v2:172.21.15.135:3300/0 conn(0x7fe7b80c8b80 0x7fe7b80b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fe7bdaef700 1 -- 172.21.15.43:0/1250612217 >> v1:172.21.15.135:6789/0 conn(0x7fe7b80b0600 legacy=0x7fe7b8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fe7bdaef700 1 -- 172.21.15.43:0/1250612217 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b815ec90 con 0x7fe7b80cf0a0 2023-06-08T03:49:06.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e00092f0 msgr2=0x7fd3e0009760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7fd3f6b9c700 1 --2- 172.21.15.43:0/3774608414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e00092f0 0x7fd3e0009760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800a8a0 tx=0x7fd3e0003860 comp rx=0 tx=0).stop 2023-06-08T03:49:06.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.684+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec007780 con 0x7f77fc0b0680 2023-06-08T03:49:06.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00f8d0 con 0x7f77fc0b0680 2023-06-08T03:49:06.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00fc80 con 0x7f77fc0b0680 2023-06-08T03:49:06.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fe7bdaef700 1 --2- 172.21.15.43:0/1250612217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 0x7fe7b81592c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40098f0 tx=0x7fe7b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30153f5cc5919c81 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fd3f5139700 1 -- 172.21.15.43:0/3774608414 reap_dead start 2023-06-08T03:49:06.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3774608414 shutdown_connections 2023-06-08T03:49:06.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3774608414 >> 172.21.15.43:0/3774608414 conn(0x7fd3f00ce5c0 msgr2=0x7fd3f00ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fe7bcaed700 1 -- 172.21.15.43:0/1250612217 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4004230 con 0x7fe7b80cf0a0 2023-06-08T03:49:06.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fe7bcaed700 1 -- 172.21.15.43:0/1250612217 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b4004390 con 0x7fe7b80cf0a0 2023-06-08T03:49:06.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fe7bcaed700 1 -- 172.21.15.43:0/1250612217 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40036a0 con 0x7fe7b80cf0a0 2023-06-08T03:49:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1250612217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 msgr2=0x7fe7b81592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 --2- 172.21.15.43:0/1250612217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 0x7fe7b81592c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40098f0 tx=0x7fe7b4009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1250612217 shutdown_connections 2023-06-08T03:49:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 --2- 172.21.15.43:0/1250612217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80cf0a0 0x7fe7b81592c0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40098f0 tx=0x7fe7b4009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 --2- 172.21.15.43:0/1250612217 >> v2:172.21.15.135:3300/0 conn(0x7fe7b80c8b80 0x7fe7b80b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1250612217 >> 172.21.15.43:0/1250612217 conn(0x7fe7b80ce5c0 msgr2=0x7fe7b80ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7f83ccd15700 1 Processor -- start 2023-06-08T03:49:06.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3774608414 shutdown_connections 2023-06-08T03:49:06.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3774608414 wait complete. 2023-06-08T03:49:06.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f79171a3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79100b07d0 0x7f7910155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f79171a3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7910157da0 0x7f79100c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f79171a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f79171a3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910156110 con 0x7f7910157da0 2023-06-08T03:49:06.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f79171a3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79100c4850 con 0x7f791015aad0 2023-06-08T03:49:06.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.685+0000 7f79171a3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79100c3270 con 0x7f79100b07d0 2023-06-08T03:49:06.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7f83ccd15700 1 -- start start 2023-06-08T03:49:06.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1250612217 shutdown_connections 2023-06-08T03:49:06.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7fd3f6b9c700 1 Processor -- start 2023-06-08T03:49:06.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7fd3f6b9c700 1 -- start start 2023-06-08T03:49:06.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.686+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1250612217 wait complete. 2023-06-08T03:49:06.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7fe7bfd53700 1 Processor -- start 2023-06-08T03:49:06.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83ccd15700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b0004d90 0x7f83c80b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83ccd15700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c80c7fa0 0x7f83c8151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83ccd15700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c80b2ab0 0x7f83c80c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83ccd15700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81520b0 con 0x7f83c80c7fa0 2023-06-08T03:49:06.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83ccd15700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8152b20 con 0x7f83c80b2ab0 2023-06-08T03:49:06.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83ccd15700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80c8410 con 0x7f83b0004d90 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83c6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c80b2ab0 0x7f83c80c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83c659c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b0004d90 0x7f83c80b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83c659c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b0004d90 0x7f83c80b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51882/0 (socket says 172.21.15.43:51882) 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.687+0000 7f83c659c700 1 -- 172.21.15.43:0/3760053533 learned_addr learned my addr 172.21.15.43:0/3760053533 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83c6d9d700 1 -- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b0004d90 msgr2=0x7f83c80b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b0004d90 0x7f83c80b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83c6d9d700 1 -- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c80c7fa0 msgr2=0x7f83c8151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c80c7fa0 0x7f83c8151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83c6d9d700 1 -- 172.21.15.43:0/3760053533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80b1a10 con 0x7f83c80b2ab0 2023-06-08T03:49:06.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83c6d9d700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c80b2ab0 0x7f83c80c3a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83c0014000 tx=0x7f83c001a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f6b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f014bc50 0x7fd3f00c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f6b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f014c020 0x7fd3f00c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f6b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b1430 0x7fd3f00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f6b9c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00b1dc0 con 0x7fd3f014c020 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f6b9c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c3960 con 0x7fd3f014bc50 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f6b9c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c2a70 con 0x7fd3f00b1430 2023-06-08T03:49:06.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b1430 0x7fd3f00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b1430 0x7fd3f00b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51888/0 (socket says 172.21.15.43:51888) 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 -- 172.21.15.43:0/3717011195 learned_addr learned my addr 172.21.15.43:0/3717011195 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 -- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f014bc50 msgr2=0x7fd3f00c4600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3f014bc50 0x7fd3f00c4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 -- 172.21.15.43:0/3717011195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f014c020 msgr2=0x7fd3f00c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3f014c020 0x7fd3f00c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fd3f5139700 1 -- 172.21.15.43:0/3717011195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00c2d50 con 0x7fd3f00b1430 2023-06-08T03:49:06.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7fe7bfd53700 1 -- start start 2023-06-08T03:49:06.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fe7bfd53700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7b80b0600 0x7fe7b8147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fe7bfd53700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80c8b80 0x7fe7b8147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fe7bfd53700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b8148280 0x7fe7b80c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fe7bfd53700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80ae700 con 0x7fe7b8148280 2023-06-08T03:49:06.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fe7bfd53700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80c49a0 con 0x7fe7b80b0600 2023-06-08T03:49:06.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.689+0000 7fe7bfd53700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80c4c80 con 0x7fe7b80c8b80 2023-06-08T03:49:06.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b8148280 0x7fe7b80c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b8148280 0x7fe7b80c2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58438/0 (socket says 172.21.15.43:58438) 2023-06-08T03:49:06.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 -- 172.21.15.43:0/1264557133 learned_addr learned my addr 172.21.15.43:0/1264557133 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c001f040 con 0x7f83c80b2ab0 2023-06-08T03:49:06.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0015610 con 0x7f83c80b2ab0 2023-06-08T03:49:06.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c80b1cf0 con 0x7f83c80b2ab0 2023-06-08T03:49:06.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c80b22b0 con 0x7f83c80b2ab0 2023-06-08T03:49:06.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.688+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0007000 con 0x7f83c80b2ab0 2023-06-08T03:49:06.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 -- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80c8b80 msgr2=0x7fe7b8147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7b80c8b80 0x7fe7b8147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 -- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7b80b0600 msgr2=0x7fe7b8147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7b80b0600 0x7fe7b8147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 -- 172.21.15.43:0/1264557133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4009550 con 0x7fe7b8148280 2023-06-08T03:49:06.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fd3f5139700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b1430 0x7fd3f00b1880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000a090 tx=0x7fd3e8001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fe7be2f0700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b8148280 0x7fe7b80c2060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c7a0 tx=0x7fe7b000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0003e10 con 0x7fe7b8148280 2023-06-08T03:49:06.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0005070 con 0x7fe7b8148280 2023-06-08T03:49:06.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b80ae390 con 0x7fe7b8148280 2023-06-08T03:49:06.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0005420 con 0x7fe7b8148280 2023-06-08T03:49:06.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b8143c70 con 0x7fe7b8148280 2023-06-08T03:49:06.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83c0015a00 con 0x7f83c80b2ab0 2023-06-08T03:49:06.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83c80cca90 con 0x7f83c80b2ab0 2023-06-08T03:49:06.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f83b6ffd700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f83a806adb0 0x7f83a806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83c008b150 con 0x7f83c80b2ab0 2023-06-08T03:49:06.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f83b6ffd700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] conn(0x7f83a8074a00 0x7f83a8076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 --> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83a8077500 con 0x7f83a8074a00 2023-06-08T03:49:06.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83c0055f80 con 0x7f83c80b2ab0 2023-06-08T03:49:06.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc15af70 con 0x7f77fc0b0680 2023-06-08T03:49:06.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc15a0a0 con 0x7f77fc0b0680 2023-06-08T03:49:06.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e801e600 con 0x7fd3f00b1430 2023-06-08T03:49:06.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e801e760 con 0x7fd3f00b1430 2023-06-08T03:49:06.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.690+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e801ead0 con 0x7fd3f00b1430 2023-06-08T03:49:06.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00c3030 con 0x7fd3f00b1430 2023-06-08T03:49:06.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f00c35f0 con 0x7fd3f00b1430 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f7915740700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f7915740700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791014bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40062/0 (socket says 172.21.15.43:40062) 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f7915740700 1 -- 172.21.15.43:0/3085509722 learned_addr learned my addr 172.21.15.43:0/3085509722 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7910157da0 0x7f79100c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 -- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79100b07d0 msgr2=0x7f7910155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79100b07d0 0x7f7910155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 -- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 msgr2=0x7f791014bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f791015aad0 0x7f791014bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 -- 172.21.15.43:0/3085509722 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040094a0 con 0x7f7910157da0 2023-06-08T03:49:06.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.691+0000 7f790ffff700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7910157da0 0x7f79100c4310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f790000b3e0 tx=0x7f790000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.692+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77ec01d460 con 0x7f77fc0b0680 2023-06-08T03:49:06.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f83c659c700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f83a806adb0 0x7f83a806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f83c5d9b700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] conn(0x7f83a8074a00 0x7f83a8076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011830 con 0x7f7910157da0 2023-06-08T03:49:06.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900011990 con 0x7f7910157da0 2023-06-08T03:49:06.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011d40 con 0x7f7910157da0 2023-06-08T03:49:06.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79100c3550 con 0x7f7910157da0 2023-06-08T03:49:06.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79100c3b10 con 0x7f7910157da0 2023-06-08T03:49:06.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f83c5d9b700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] conn(0x7f83a8074a00 0x7f83a8076e30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f77f1ffb700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f77e806cb30 0x7f77e806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f77ec0894d0 con 0x7f77fc0b0680 2023-06-08T03:49:06.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.693+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7b80cc7b0 con 0x7fe7b8148280 2023-06-08T03:49:06.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.694+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78fc000ff0 con 0x7f7910157da0 2023-06-08T03:49:06.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.694+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3e8019030 con 0x7fd3f00b1430 2023-06-08T03:49:06.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7f78035ec700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] conn(0x7f77fc0c6680 0x7f77fc0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 --> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77fc06f960 con 0x7f77fc0c6680 2023-06-08T03:49:06.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7fd3ed7fa700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd3d406adb0 0x7fd3d406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7f7801388700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f77e806cb30 0x7f77e806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7f7801b89700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] conn(0x7f77fc0c6680 0x7f77fc0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd3e808a690 con 0x7fd3f00b1430 2023-06-08T03:49:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.695+0000 7f7801b89700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] conn(0x7f77fc0c6680 0x7f77fc0c6a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.696+0000 7fd3f4938700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd3d406adb0 0x7fd3d406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.696+0000 7fd3f4938700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd3d406adb0 0x7fd3d406d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc004840 tx=0x7fd3dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.696+0000 7f83c659c700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f83a806adb0 0x7f83a806d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83c80b44a0 tx=0x7f83b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.696+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== osd.2 v2:172.21.15.43:6808/3406724052 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f83a8077500 con 0x7f83a8074a00 2023-06-08T03:49:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.696+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f790001a400 con 0x7f7910157da0 2023-06-08T03:49:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.696+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7b0005580 con 0x7fe7b8148280 2023-06-08T03:49:06.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f790d7fa700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f78f806b1b0 0x7f78f806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f7801388700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f77e806cb30 0x7f77e806efe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77f8008010 tx=0x7f77f800b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7900089ad0 con 0x7f7910157da0 2023-06-08T03:49:06.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f790d7fa700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] conn(0x7f78f8074e80 0x7f78f80772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f7914f3f700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f78f806b1b0 0x7f78f806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 --> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78f8077980 con 0x7f78f8074e80 2023-06-08T03:49:06.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7900089f70 con 0x7f7910157da0 2023-06-08T03:49:06.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== osd.3 v2:172.21.15.43:6820/1131528055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f77f4009ad0 con 0x7f77fc0c6680 2023-06-08T03:49:06.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7fe7ae7fc700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe79c06ad30 0x7fe79c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe7b0088d10 con 0x7fe7b8148280 2023-06-08T03:49:06.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7fe7bdaef700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe79c06ad30 0x7fe79c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7fe7ae7fc700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] conn(0x7fe79c074a00 0x7fe79c076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 --> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe79c077500 con 0x7fe79c074a00 2023-06-08T03:49:06.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.697+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b008b420 con 0x7fe7b8148280 2023-06-08T03:49:06.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.698+0000 7f7914f3f700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f78f806b1b0 0x7f78f806d660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7908000f80 tx=0x7f7908001720 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.698+0000 7fe7bdaef700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe79c06ad30 0x7fe79c06d1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7b806fee0 tx=0x7fe7b4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.698+0000 7fcb4c8d9700 1 Processor -- start 2023-06-08T03:49:06.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.698+0000 7fcb4c8d9700 1 -- start start 2023-06-08T03:49:06.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fe7bd2ee700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] conn(0x7fe79c074a00 0x7fe79c076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7f7915740700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] conn(0x7f78f8074e80 0x7f78f80772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb4c8d9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcb4815d290 0x7fcb4815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb4c8d9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d660 0x7fcb4806c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb4c8d9700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4815e030 con 0x7fcb4806d7d0 2023-06-08T03:49:06.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb4c8d9700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb48066120 con 0x7fcb4815d290 2023-06-08T03:49:06.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb4c8d9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4815ea00 con 0x7fcb4815d660 2023-06-08T03:49:06.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fe7bd2ee700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] conn(0x7fe79c074a00 0x7fe79c076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb46d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcb4815d290 0x7fcb4815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb46d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcb4815d290 0x7fcb4815e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58470/0 (socket says 172.21.15.43:58470) 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb46d9d700 1 -- 172.21.15.43:0/3166471498 learned_addr learned my addr 172.21.15.43:0/3166471498 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.699+0000 7fcb4759e700 1 --2- 172.21.15.43:0/3166471498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d660 0x7fcb4806c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb45d9b700 1 -- 172.21.15.43:0/3166471498 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860666029 0 0) 0x7fcb4815e030 con 0x7fcb4806d7d0 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb46d9d700 1 -- 172.21.15.43:0/3166471498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d660 msgr2=0x7fcb4806c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb46d9d700 1 --2- 172.21.15.43:0/3166471498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d660 0x7fcb4806c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb46d9d700 1 -- 172.21.15.43:0/3166471498 >> v1:172.21.15.135:6789/0 conn(0x7fcb4806d7d0 legacy=0x7fcb4806b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb46d9d700 1 -- 172.21.15.43:0/3166471498 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb48065b60 con 0x7fcb4815d290 2023-06-08T03:49:06.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb46d9d700 1 --2- 172.21.15.43:0/3166471498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d290 0x7fcb4815e4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb380098f0 tx=0x7fcb38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c414808b2e66e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb45d9b700 1 -- 172.21.15.43:0/3166471498 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38011830 con 0x7fcb4815d290 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb45d9b700 1 -- 172.21.15.43:0/3166471498 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38011990 con 0x7fcb4815d290 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.700+0000 7fcb45d9b700 1 -- 172.21.15.43:0/3166471498 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38011d20 con 0x7fcb4815d290 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/3166471498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d290 msgr2=0x7fcb4815e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 --2- 172.21.15.43:0/3166471498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d290 0x7fcb4815e4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb380098f0 tx=0x7fcb38009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/3166471498 shutdown_connections 2023-06-08T03:49:06.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 --2- 172.21.15.43:0/3166471498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d660 0x7fcb4806c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 --2- 172.21.15.43:0/3166471498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d290 0x7fcb4815e4c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/3166471498 >> 172.21.15.43:0/3166471498 conn(0x7fcb480cee40 msgr2=0x7fcb480cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/3166471498 shutdown_connections 2023-06-08T03:49:06.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/3166471498 wait complete. 2023-06-08T03:49:06.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fd3f6b9c700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] conn(0x7fd3f00b2b30 0x7fd3f00b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.701+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 --> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3f01e0170 con 0x7fd3f00b2b30 2023-06-08T03:49:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.702+0000 7fd3effff700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] conn(0x7fd3f00b2b30 0x7fd3f00b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.702+0000 7fd3effff700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] conn(0x7fd3f00b2b30 0x7fd3f00b2f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 Processor -- start 2023-06-08T03:49:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 -- start start 2023-06-08T03:49:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== osd.4 v2:172.21.15.135:6800/613956937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd3f01e0170 con 0x7fd3f00b2b30 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4806d7d0 0x7fcb480c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d290 0x7fcb480c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d660 0x7fcb48158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480c67a0 con 0x7fcb4815d660 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480c5480 con 0x7fcb4806d7d0 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.703+0000 7fcb4c8d9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480c4ec0 con 0x7fcb4815d290 2023-06-08T03:49:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4806d7d0 0x7fcb480c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb4759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d660 0x7fcb48158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4806d7d0 0x7fcb480c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40092/0 (socket says 172.21.15.43:40092) 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 -- 172.21.15.43:0/383201840 learned_addr learned my addr 172.21.15.43:0/383201840 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb4659c700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d290 0x7fcb480c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 -- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d290 msgr2=0x7fcb480c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4815d290 0x7fcb480c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 -- 172.21.15.43:0/383201840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d660 msgr2=0x7fcb48158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb4815d660 0x7fcb48158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 -- 172.21.15.43:0/383201840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009550 con 0x7fcb4806d7d0 2023-06-08T03:49:06.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb46d9d700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4806d7d0 0x7fcb480c8b90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009c40 tx=0x7fcb38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.704+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb38004450 con 0x7fcb4806d7d0 2023-06-08T03:49:06.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.705+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38024070 con 0x7fcb4806d7d0 2023-06-08T03:49:06.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.705+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380038e0 con 0x7fcb4806d7d0 2023-06-08T03:49:06.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.705+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== osd.1 v2:172.21.15.43:6800/3633177327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe79c077500 con 0x7fe79c074a00 2023-06-08T03:49:06.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.705+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480c51a0 con 0x7fcb4806d7d0 2023-06-08T03:49:06.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.707+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb481ef430 con 0x7fcb4806d7d0 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.708+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb4815dcc0 con 0x7fcb4806d7d0 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.709+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb38003a40 con 0x7fcb4806d7d0 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.709+0000 7fcb2f7fe700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcb3406ace0 0x7fcb3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.709+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcb38026070 con 0x7fcb4806d7d0 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.710+0000 7fcb2f7fe700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] conn(0x7fcb340749b0 0x7fcb34076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.710+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 --> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb340774b0 con 0x7fcb340749b0 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.710+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb3808ebc0 con 0x7fcb4806d7d0 2023-06-08T03:49:06.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.710+0000 7fcb4759e700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] conn(0x7fcb340749b0 0x7fcb34076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.710+0000 7fcb4659c700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcb3406ace0 0x7fcb3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:06.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.711+0000 7fcb4759e700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] conn(0x7fcb340749b0 0x7fcb34076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.711+0000 7fcb4659c700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcb3406ace0 0x7fcb3406d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb48159e50 tx=0x7fcb3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.712+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== osd.5 v2:172.21.15.135:6808/1494712462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcb340774b0 con 0x7fcb340749b0 2023-06-08T03:49:06.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.712+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 --> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9980cc7b0 con 0x7fb97c074a00 2023-06-08T03:49:06.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.713+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 --> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbee8005c40 con 0x7fbee80015e0 2023-06-08T03:49:06.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.713+0000 7f7915740700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] conn(0x7f78f8074e80 0x7f78f80772b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:06.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.713+0000 7fb98dffb700 1 -- 172.21.15.43:0/3650037110 <== osd.7 v2:172.21.15.135:6824/3149048166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb99401d040 con 0x7fb97c074a00 2023-06-08T03:49:06.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.713+0000 7fbefb7fe700 1 -- 172.21.15.43:0/2144592687 <== osd.0 v2:172.21.15.43:6816/2337618237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbee8005c40 con 0x7fbee80015e0 2023-06-08T03:49:06.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== osd.6 v2:172.21.15.135:6816/3533930797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f78f8077980 con 0x7f78f8074e80 2023-06-08T03:49:06.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] conn(0x7fbee80015e0 msgr2=0x7fbee8003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf09124700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.43:6816/2337618237,v1:172.21.15.43:6817/2337618237] conn(0x7fbee80015e0 0x7fbee8003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] conn(0x7fb97c074a00 msgr2=0x7fb97c076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6824/3149048166,v1:172.21.15.135:6825/3149048166] conn(0x7fb97c074a00 0x7fb97c076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbee406adb0 msgr2=0x7fbee406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf09124700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbee406adb0 0x7fbee406d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbeec004a60 tx=0x7fbeec006000 comp rx=0 tx=0).stop 2023-06-08T03:49:06.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf040b3600 msgr2=0x7fbf0415aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf09124700 1 --2- 172.21.15.43:0/2144592687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf040b3600 0x7fbf0415aff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbef400b550 tx=0x7fbef400b860 comp rx=0 tx=0).stop 2023-06-08T03:49:06.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fbf0359e700 1 -- 172.21.15.43:0/2144592687 reap_dead start 2023-06-08T03:49:06.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb97c06ad30 msgr2=0x7fb97c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb97c06ad30 0x7fb97c06d1e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb9900012e0 tx=0x7fb990006340 comp rx=0 tx=0).stop 2023-06-08T03:49:06.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9980b0700 msgr2=0x7fb9980c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 --2- 172.21.15.43:0/3650037110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9980b0700 0x7fb9980c3f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb98800d5c0 tx=0x7fb98800d8d0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99dccb700 1 -- 172.21.15.43:0/3650037110 reap_dead start 2023-06-08T03:49:06.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 shutdown_connections 2023-06-08T03:49:06.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 >> 172.21.15.43:0/3650037110 conn(0x7fb9980ce5c0 msgr2=0x7fb9980ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 shutdown_connections 2023-06-08T03:49:06.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.714+0000 7fb99f72e700 1 -- 172.21.15.43:0/3650037110 wait complete. 2023-06-08T03:49:06.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.722+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 --> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83c80cc7b0 con 0x7f83a8074a00 2023-06-08T03:49:06.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.723+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 shutdown_connections 2023-06-08T03:49:06.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.723+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 >> 172.21.15.43:0/2144592687 conn(0x7fbf04069db0 msgr2=0x7fbf040ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.723+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 --> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77fc06f680 con 0x7f77fc0c6680 2023-06-08T03:49:06.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.724+0000 7f77f1ffb700 1 -- 172.21.15.43:0/3803314219 <== osd.3 v2:172.21.15.43:6820/1131528055 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77f4009ed0 con 0x7f77fc0c6680 2023-06-08T03:49:06.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] conn(0x7f77fc0c6680 msgr2=0x7f77fc0c6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:6820/1131528055,v1:172.21.15.43:6822/1131528055] conn(0x7f77fc0c6680 0x7f77fc0c6a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f77e806cb30 msgr2=0x7f77e806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f77e806cb30 0x7f77e806efe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77f8008010 tx=0x7f77f800b000 comp rx=0 tx=0).stop 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77fc0b0680 msgr2=0x7f77fc0b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 --2- 172.21.15.43:0/3803314219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77fc0b0680 0x7f77fc0b0af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77ec007290 tx=0x7f77ec0075a0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f7801b89700 1 -- 172.21.15.43:0/3803314219 reap_dead start 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 shutdown_connections 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 >> 172.21.15.43:0/3803314219 conn(0x7f77fc06aec0 msgr2=0x7f77fc0cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 shutdown_connections 2023-06-08T03:49:06.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.726+0000 7f78035ec700 1 -- 172.21.15.43:0/3803314219 wait complete. 2023-06-08T03:49:06.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.727+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 shutdown_connections 2023-06-08T03:49:06.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.727+0000 7fbf09124700 1 -- 172.21.15.43:0/2144592687 wait complete. 2023-06-08T03:49:06.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.727+0000 7f83b6ffd700 1 -- 172.21.15.43:0/3760053533 <== osd.2 v2:172.21.15.43:6808/3406724052 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83bc001cc0 con 0x7f83a8074a00 2023-06-08T03:49:06.798 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:06.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-08T03:49:06.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] conn(0x7f83a8074a00 msgr2=0x7f83a8076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.43:6808/3406724052,v1:172.21.15.43:6809/3406724052] conn(0x7f83a8074a00 0x7f83a8076e30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f83a806adb0 msgr2=0x7f83a806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f83a806adb0 0x7f83a806d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83c80b44a0 tx=0x7f83b8008040 comp rx=0 tx=0).stop 2023-06-08T03:49:06.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c80b2ab0 msgr2=0x7f83c80c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 --2- 172.21.15.43:0/3760053533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c80b2ab0 0x7f83c80c3a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83c0014000 tx=0x7f83c001a760 comp rx=0 tx=0).stop 2023-06-08T03:49:06.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83c6d9d700 1 -- 172.21.15.43:0/3760053533 reap_dead start 2023-06-08T03:49:06.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 shutdown_connections 2023-06-08T03:49:06.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.732+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 >> 172.21.15.43:0/3760053533 conn(0x7f83c80ce5c0 msgr2=0x7f83c8070050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.733+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 --> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3f00c9390 con 0x7fd3f00b2b30 2023-06-08T03:49:06.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.733+0000 7fd3ed7fa700 1 -- 172.21.15.43:0/3717011195 <== osd.4 v2:172.21.15.135:6800/613956937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3e4009680 con 0x7fd3f00b2b30 2023-06-08T03:49:06.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.733+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 --> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7b80c9390 con 0x7fe79c074a00 2023-06-08T03:49:06.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.734+0000 7fe7ae7fc700 1 -- 172.21.15.43:0/1264557133 <== osd.1 v2:172.21.15.43:6800/3633177327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7a8009440 con 0x7fe79c074a00 2023-06-08T03:49:06.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] conn(0x7fe79c074a00 msgr2=0x7fe79c076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:6800/3633177327,v1:172.21.15.43:6801/3633177327] conn(0x7fe79c074a00 0x7fe79c076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] conn(0x7fd3f00b2b30 msgr2=0x7fd3f00b2f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6800/613956937,v1:172.21.15.135:6801/613956937] conn(0x7fd3f00b2b30 0x7fd3f00b2f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd3d406adb0 msgr2=0x7fd3d406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd3d406adb0 0x7fd3d406d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc004840 tx=0x7fd3dc008040 comp rx=0 tx=0).stop 2023-06-08T03:49:06.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b1430 msgr2=0x7fd3f00b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 --2- 172.21.15.43:0/3717011195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3f00b1430 0x7fd3f00b1880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000a090 tx=0x7fd3e8001cb0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe79c06ad30 msgr2=0x7fe79c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe79c06ad30 0x7fe79c06d1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7b806fee0 tx=0x7fe7b4010000 comp rx=0 tx=0).stop 2023-06-08T03:49:06.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b8148280 msgr2=0x7fe7b80c2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 --2- 172.21.15.43:0/1264557133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b8148280 0x7fe7b80c2060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c7a0 tx=0x7fe7b000cb60 comp rx=0 tx=0).stop 2023-06-08T03:49:06.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7be2f0700 1 -- 172.21.15.43:0/1264557133 reap_dead start 2023-06-08T03:49:06.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 shutdown_connections 2023-06-08T03:49:06.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 shutdown_connections 2023-06-08T03:49:06.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 >> 172.21.15.43:0/1264557133 conn(0x7fe7b80ce5c0 msgr2=0x7fe7b81566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7f83ccd15700 1 -- 172.21.15.43:0/3760053533 wait complete. 2023-06-08T03:49:06.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f5139700 1 -- 172.21.15.43:0/3717011195 reap_dead start 2023-06-08T03:49:06.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 shutdown_connections 2023-06-08T03:49:06.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.735+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 >> 172.21.15.43:0/3717011195 conn(0x7fd3f00ce5c0 msgr2=0x7fd3f00ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.737+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 shutdown_connections 2023-06-08T03:49:06.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.737+0000 7fd3f6b9c700 1 -- 172.21.15.43:0/3717011195 wait complete. 2023-06-08T03:49:06.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.737+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 shutdown_connections 2023-06-08T03:49:06.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.737+0000 7fe7bfd53700 1 -- 172.21.15.43:0/1264557133 wait complete. 2023-06-08T03:49:06.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.743+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 --> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb48065e40 con 0x7fcb340749b0 2023-06-08T03:49:06.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.744+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/383201840 <== osd.5 v2:172.21.15.135:6808/1494712462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb4000f040 con 0x7fcb340749b0 2023-06-08T03:49:06.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] conn(0x7fcb340749b0 msgr2=0x7fcb34076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6808/1494712462,v1:172.21.15.135:6809/1494712462] conn(0x7fcb340749b0 0x7fcb34076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcb3406ace0 msgr2=0x7fcb3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcb3406ace0 0x7fcb3406d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb48159e50 tx=0x7fcb3c009040 comp rx=0 tx=0).stop 2023-06-08T03:49:06.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4806d7d0 msgr2=0x7fcb480c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 --2- 172.21.15.43:0/383201840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4806d7d0 0x7fcb480c8b90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009c40 tx=0x7fcb38004750 comp rx=0 tx=0).stop 2023-06-08T03:49:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4759e700 1 -- 172.21.15.43:0/383201840 reap_dead start 2023-06-08T03:49:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 shutdown_connections 2023-06-08T03:49:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 >> 172.21.15.43:0/383201840 conn(0x7fcb480cee40 msgr2=0x7fcb480b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 shutdown_connections 2023-06-08T03:49:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.745+0000 7fcb4c8d9700 1 -- 172.21.15.43:0/383201840 wait complete. 2023-06-08T03:49:06.811 INFO:teuthology.orchestra.run.smithi043.stdout:55834574857 2023-06-08T03:49:06.811 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-08T03:49:06.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.751+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 --> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78fc002d70 con 0x7f78f8074e80 2023-06-08T03:49:06.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.752+0000 7f790d7fa700 1 -- 172.21.15.43:0/3085509722 <== osd.6 v2:172.21.15.135:6816/3533930797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f78fc002d70 con 0x7f78f8074e80 2023-06-08T03:49:06.813 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:06.813 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-08T03:49:06.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] conn(0x7f78f8074e80 msgr2=0x7f78f80772b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6816/3533930797,v1:172.21.15.135:6817/3533930797] conn(0x7f78f8074e80 0x7f78f80772b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f78f806b1b0 msgr2=0x7f78f806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f78f806b1b0 0x7f78f806d660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7908000f80 tx=0x7f7908001720 comp rx=0 tx=0).stop 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7910157da0 msgr2=0x7f79100c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 --2- 172.21.15.43:0/3085509722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7910157da0 0x7f79100c4310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f790000b3e0 tx=0x7f790000b6f0 comp rx=0 tx=0).stop 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f7915740700 1 -- 172.21.15.43:0/3085509722 reap_dead start 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 shutdown_connections 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.753+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 >> 172.21.15.43:0/3085509722 conn(0x7f79100ce5c0 msgr2=0x7f791015cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.755+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 shutdown_connections 2023-06-08T03:49:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:06.755+0000 7f79171a3700 1 -- 172.21.15.43:0/3085509722 wait complete. 2023-06-08T03:49:06.816 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:06.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-08T03:49:06.817 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:06.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-08T03:49:06.818 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:06.818 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-08T03:49:06.819 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:06.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-08T03:49:06.820 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:06.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-08T03:49:07.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.058+0000 7ff926927700 1 Processor -- start 2023-06-08T03:49:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.058+0000 7ff926927700 1 -- start start 2023-06-08T03:49:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.059+0000 7ff926927700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff9200b0330 0x7ff9201592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff926927700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 0x7ff9200cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff926927700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92006ffe0 con 0x7ff9200b0700 2023-06-08T03:49:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff926927700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff920156140 con 0x7ff9200b0330 2023-06-08T03:49:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff926927700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200c9670 con 0x7ff9200cd290 2023-06-08T03:49:07.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff924ec4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 0x7ff9200cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff924ec4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 0x7ff9200cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51946/0 (socket says 172.21.15.43:51946) 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff924ec4700 1 -- 172.21.15.43:0/234864741 learned_addr learned my addr 172.21.15.43:0/234864741 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff91ffff700 1 --2- 172.21.15.43:0/234864741 >> v2:172.21.15.135:3300/0 conn(0x7ff9200b0330 0x7ff9201592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.060+0000 7ff924ec4700 1 -- 172.21.15.43:0/234864741 >> v2:172.21.15.135:3300/0 conn(0x7ff9200b0330 msgr2=0x7ff9201592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff924ec4700 1 --2- 172.21.15.43:0/234864741 >> v2:172.21.15.135:3300/0 conn(0x7ff9200b0330 0x7ff9201592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff924ec4700 1 -- 172.21.15.43:0/234864741 >> v1:172.21.15.43:6789/0 conn(0x7ff9200b0700 legacy=0x7ff9200c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff924ec4700 1 -- 172.21.15.43:0/234864741 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9200c9390 con 0x7ff9200cd290 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff924ec4700 1 --2- 172.21.15.43:0/234864741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 0x7ff9200cd710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c770 tx=0x7ff91800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523cb3455549bd8b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff91effd700 1 -- 172.21.15.43:0/234864741 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918003c20 con 0x7ff9200cd290 2023-06-08T03:49:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff91effd700 1 -- 172.21.15.43:0/234864741 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918003d80 con 0x7ff9200cd290 2023-06-08T03:49:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.061+0000 7ff91effd700 1 -- 172.21.15.43:0/234864741 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918004270 con 0x7ff9200cd290 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 -- 172.21.15.43:0/234864741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 msgr2=0x7ff9200cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 --2- 172.21.15.43:0/234864741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 0x7ff9200cd710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c770 tx=0x7ff91800c7a0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 -- 172.21.15.43:0/234864741 shutdown_connections 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 --2- 172.21.15.43:0/234864741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200cd290 0x7ff9200cd710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 --2- 172.21.15.43:0/234864741 >> v2:172.21.15.135:3300/0 conn(0x7ff9200b0330 0x7ff9201592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 -- 172.21.15.43:0/234864741 >> 172.21.15.43:0/234864741 conn(0x7ff9200ce5c0 msgr2=0x7ff9200ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 -- 172.21.15.43:0/234864741 shutdown_connections 2023-06-08T03:49:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.062+0000 7ff926927700 1 -- 172.21.15.43:0/234864741 wait complete. 2023-06-08T03:49:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.064+0000 7ff926927700 1 Processor -- start 2023-06-08T03:49:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.064+0000 7ff926927700 1 -- start start 2023-06-08T03:49:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.065+0000 7f3b686d1700 1 Processor -- start 2023-06-08T03:49:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.065+0000 7ff926927700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9200b0330 0x7ff9201f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.065+0000 7ff926927700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 0x7ff9200711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff926927700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9200cd290 0x7ff920071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff926927700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920158620 con 0x7ff9200b0330 2023-06-08T03:49:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff926927700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201f7300 con 0x7ff9200cd290 2023-06-08T03:49:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff926927700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff920156700 con 0x7ff9200b0700 2023-06-08T03:49:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.065+0000 7f3b686d1700 1 -- start start 2023-06-08T03:49:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 0x7ff9200711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 0x7ff9200711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51950/0 (socket says 172.21.15.43:51950) 2023-06-08T03:49:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 -- 172.21.15.43:0/1588074485 learned_addr learned my addr 172.21.15.43:0/1588074485 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91ffff700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9200b0330 0x7ff9201f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff924ec4700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9200cd290 0x7ff920071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7fee0465a700 1 Processor -- start 2023-06-08T03:49:07.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7f24df6bc700 1 Processor -- start 2023-06-08T03:49:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7f3b686d1700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3b600cf0a0 0x7f3b601592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7f3b686d1700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b600b0670 0x7f3b600cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7f3b686d1700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6006ffe0 con 0x7f3b600b02a0 2023-06-08T03:49:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7f3b686d1700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b60156140 con 0x7f3b600cf0a0 2023-06-08T03:49:07.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7f3b686d1700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b600c9670 con 0x7f3b600b0670 2023-06-08T03:49:07.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b600b0670 0x7f3b600cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b600b0670 0x7f3b600cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40114/0 (socket says 172.21.15.43:40114) 2023-06-08T03:49:07.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 -- 172.21.15.43:0/130055629 learned_addr learned my addr 172.21.15.43:0/130055629 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 -- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9200cd290 msgr2=0x7ff920071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9200cd290 0x7ff920071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 -- 172.21.15.43:0/1588074485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9200b0330 msgr2=0x7ff9201f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9200b0330 0x7ff9201f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91f7fe700 1 -- 172.21.15.43:0/1588074485 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91800c3d0 con 0x7ff9200b0700 2023-06-08T03:49:07.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff91ffff700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9200b0330 0x7ff9201f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:07.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7ff924ec4700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9200cd290 0x7ff920071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:07.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7ff91f7fe700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 0x7ff9200711c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff91400b470 tx=0x7ff91400b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 -- 172.21.15.43:0/130055629 >> v2:172.21.15.43:3300/0 conn(0x7f3b600cf0a0 msgr2=0x7f3b601592c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T03:49:07.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 --2- 172.21.15.43:0/130055629 >> v2:172.21.15.43:3300/0 conn(0x7f3b600cf0a0 0x7f3b601592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 -- 172.21.15.43:0/130055629 >> v1:172.21.15.43:6789/0 conn(0x7f3b600b02a0 legacy=0x7f3b600c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f3b66c6e700 1 -- 172.21.15.43:0/130055629 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b600c9390 con 0x7f3b600b0670 2023-06-08T03:49:07.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f3b66c6e700 1 --2- 172.21.15.43:0/130055629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b0670 0x7f3b600cd290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b6006fe90 tx=0x7f3b5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4e65d802c75619 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.066+0000 7fee0465a700 1 -- start start 2023-06-08T03:49:07.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f3b6546b700 1 -- 172.21.15.43:0/130055629 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800e070 con 0x7f3b600b0670 2023-06-08T03:49:07.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f3b6546b700 1 -- 172.21.15.43:0/130055629 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800b9c0 con 0x7f3b600b0670 2023-06-08T03:49:07.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f3b6546b700 1 -- 172.21.15.43:0/130055629 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800bd70 con 0x7f3b600b0670 2023-06-08T03:49:07.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7f24df6bc700 1 -- start start 2023-06-08T03:49:07.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24df6bc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24d80b43f0 0x7f24d80b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24df6bc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80cd430 0x7f24d80d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24df6bc700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d80cf690 con 0x7f24d80ccfc0 2023-06-08T03:49:07.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24df6bc700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d80d0180 con 0x7f24d80b43f0 2023-06-08T03:49:07.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24df6bc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80d0770 con 0x7f24d80cd430 2023-06-08T03:49:07.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee0465a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 0x7fedfc0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee0465a700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0cf690 con 0x7fedfc0ccfc0 2023-06-08T03:49:07.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee0465a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0d0770 con 0x7fedfc0cd430 2023-06-08T03:49:07.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee0465a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0d0180 con 0x7fedfc0b43f0 2023-06-08T03:49:07.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee023f6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 0x7fedfc0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee023f6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 0x7fedfc0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51958/0 (socket says 172.21.15.43:51958) 2023-06-08T03:49:07.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7fee023f6700 1 -- 172.21.15.43:0/3145216155 learned_addr learned my addr 172.21.15.43:0/3145216155 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24dcc57700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f24d80ccfc0 0x7f24d80d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53412/0 (socket says 172.21.15.43:53412) 2023-06-08T03:49:07.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.068+0000 7f24dcc57700 1 -- 172.21.15.43:0/4151040228 learned_addr learned my addr 172.21.15.43:0/4151040228 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:07.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7fee023f6700 1 -- 172.21.15.43:0/3145216155 >> v1:172.21.15.135:6789/0 conn(0x7fedfc0cd430 legacy=0x7fedfc0d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7fee023f6700 1 -- 172.21.15.43:0/3145216155 >> v1:172.21.15.43:6789/0 conn(0x7fedfc0ccfc0 legacy=0x7fedfc0d0c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T03:49:07.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7fee023f6700 1 -- 172.21.15.43:0/3145216155 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0b4d00 con 0x7fedfc0b43f0 2023-06-08T03:49:07.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f24dd458700 1 --2- 172.21.15.43:0/4151040228 >> v2:172.21.15.43:3300/0 conn(0x7f24d80b43f0 0x7f24d80b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f24ddc59700 1 --2- 172.21.15.43:0/4151040228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80cd430 0x7f24d80d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7fee023f6700 1 --2- 172.21.15.43:0/3145216155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 0x7fedfc0b47c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedec0098f0 tx=0x7fedec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17bfd9e40a22e90 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f3b686d1700 1 -- 172.21.15.43:0/130055629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b0670 msgr2=0x7f3b600cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f3b686d1700 1 --2- 172.21.15.43:0/130055629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b0670 0x7f3b600cd290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b6006fe90 tx=0x7f3b5800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:07.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f1a3c5d1700 1 Processor -- start 2023-06-08T03:49:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f24ddc59700 1 -- 172.21.15.43:0/4151040228 >> v2:172.21.15.43:3300/0 conn(0x7f24d80b43f0 msgr2=0x7f24d80b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f24ddc59700 1 --2- 172.21.15.43:0/4151040228 >> v2:172.21.15.43:3300/0 conn(0x7f24d80b43f0 0x7f24d80b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f24ddc59700 1 -- 172.21.15.43:0/4151040228 >> v1:172.21.15.43:6789/0 conn(0x7f24d80ccfc0 legacy=0x7f24d80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.069+0000 7f24ddc59700 1 -- 172.21.15.43:0/4151040228 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80b4d00 con 0x7f24d80cd430 2023-06-08T03:49:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011830 con 0x7ff9200b0700 2023-06-08T03:49:07.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914011990 con 0x7ff9200b0700 2023-06-08T03:49:07.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011d40 con 0x7ff9200b0700 2023-06-08T03:49:07.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9201569e0 con 0x7ff9200b0700 2023-06-08T03:49:07.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.067+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920156fa0 con 0x7ff9200b0700 2023-06-08T03:49:07.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f24ddc59700 1 --2- 172.21.15.43:0/4151040228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80cd430 0x7f24d80d1310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009d90 tx=0x7f24d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4cb375a001478c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f3b686d1700 1 -- 172.21.15.43:0/130055629 shutdown_connections 2023-06-08T03:49:07.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f3b686d1700 1 --2- 172.21.15.43:0/130055629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b0670 0x7f3b600cd290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f3b686d1700 1 --2- 172.21.15.43:0/130055629 >> v2:172.21.15.43:3300/0 conn(0x7f3b600cf0a0 0x7f3b601592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f3b686d1700 1 -- 172.21.15.43:0/130055629 >> 172.21.15.43:0/130055629 conn(0x7f3b600ce5c0 msgr2=0x7f3b600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7fee013f4700 1 -- 172.21.15.43:0/3145216155 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec005e30 con 0x7fedfc0b43f0 2023-06-08T03:49:07.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7fee013f4700 1 -- 172.21.15.43:0/3145216155 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec006030 con 0x7fedfc0b43f0 2023-06-08T03:49:07.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7fee013f4700 1 -- 172.21.15.43:0/3145216155 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec0063c0 con 0x7fedfc0b43f0 2023-06-08T03:49:07.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f3b686d1700 1 -- 172.21.15.43:0/130055629 shutdown_connections 2023-06-08T03:49:07.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9000052f0 con 0x7ff9200b0700 2023-06-08T03:49:07.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f3b686d1700 1 -- 172.21.15.43:0/130055629 wait complete. 2023-06-08T03:49:07.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f24cffff700 1 -- 172.21.15.43:0/4151040228 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d000e070 con 0x7f24d80cd430 2023-06-08T03:49:07.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f24cffff700 1 -- 172.21.15.43:0/4151040228 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d000bb20 con 0x7f24d80cd430 2023-06-08T03:49:07.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.070+0000 7f24cffff700 1 -- 172.21.15.43:0/4151040228 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0012430 con 0x7f24d80cd430 2023-06-08T03:49:07.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7fee0465a700 1 -- 172.21.15.43:0/3145216155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 msgr2=0x7fedfc0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7fee0465a700 1 --2- 172.21.15.43:0/3145216155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 0x7fedfc0b47c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedec0098f0 tx=0x7fedec009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:07.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f24df6bc700 1 -- 172.21.15.43:0/4151040228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80cd430 msgr2=0x7f24d80d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f24df6bc700 1 --2- 172.21.15.43:0/4151040228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80cd430 0x7f24d80d1310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009d90 tx=0x7f24d000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:07.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff91401a400 con 0x7ff9200b0700 2023-06-08T03:49:07.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f24df6bc700 1 -- 172.21.15.43:0/4151040228 shutdown_connections 2023-06-08T03:49:07.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f24df6bc700 1 --2- 172.21.15.43:0/4151040228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80cd430 0x7f24d80d1310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f24df6bc700 1 --2- 172.21.15.43:0/4151040228 >> v2:172.21.15.43:3300/0 conn(0x7f24d80b43f0 0x7f24d80b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f24df6bc700 1 -- 172.21.15.43:0/4151040228 >> 172.21.15.43:0/4151040228 conn(0x7f24d806afb0 msgr2=0x7f24d806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.071+0000 7f1a3c5d1700 1 -- start start 2023-06-08T03:49:07.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7f3b686d1700 1 Processor -- start 2023-06-08T03:49:07.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7f3b686d1700 1 -- start start 2023-06-08T03:49:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7ff91cff9700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff90c06adb0 0x7ff90c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff914089d60 con 0x7ff9200b0700 2023-06-08T03:49:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7f1a3c5d1700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b02a0 0x7f1a341592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7f1a3c5d1700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a340cf0a0 0x7f1a340b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3c5d1700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3406ffe0 con 0x7f1a340c8b80 2023-06-08T03:49:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3c5d1700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a34156140 con 0x7f1a340cf0a0 2023-06-08T03:49:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3c5d1700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340c9670 con 0x7f1a340b02a0 2023-06-08T03:49:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3ab6e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1a340c8b80 0x7f1a34069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53420/0 (socket says 172.21.15.43:53420) 2023-06-08T03:49:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3ab6e700 1 -- 172.21.15.43:0/3503574985 learned_addr learned my addr 172.21.15.43:0/3503574985 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7fee0465a700 1 -- 172.21.15.43:0/3145216155 shutdown_connections 2023-06-08T03:49:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7fee0465a700 1 --2- 172.21.15.43:0/3145216155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0b43f0 0x7fedfc0b47c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7fee0465a700 1 -- 172.21.15.43:0/3145216155 >> 172.21.15.43:0/3145216155 conn(0x7fedfc06afb0 msgr2=0x7fedfc06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7fee0465a700 1 -- 172.21.15.43:0/3145216155 shutdown_connections 2023-06-08T03:49:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7fee0465a700 1 -- 172.21.15.43:0/3145216155 wait complete. 2023-06-08T03:49:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7f24df6bc700 1 -- 172.21.15.43:0/4151040228 shutdown_connections 2023-06-08T03:49:07.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7f24df6bc700 1 -- 172.21.15.43:0/4151040228 wait complete. 2023-06-08T03:49:07.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b686d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b02a0 0x7f3b600c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b686d1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 0x7f3b600c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b686d1700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b600cf0a0 0x7f3b600c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b686d1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600c8230 con 0x7f3b600b0670 2023-06-08T03:49:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b686d1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6014ff70 con 0x7f3b600b02a0 2023-06-08T03:49:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b686d1700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60150250 con 0x7f3b600cf0a0 2023-06-08T03:49:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.072+0000 7ff91ffff700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff90c06adb0 0x7ff90c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7ff91ffff700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff90c06adb0 0x7ff90c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff910009b90 tx=0x7ff910008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597237669 0 0) 0x7f1a3406ffe0 con 0x7f1a340c8b80 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a200035b0 con 0x7f1a340c8b80 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b02a0 0x7f1a341592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111077951 0 0) 0x7f1a200035b0 con 0x7f1a340c8b80 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b02a0 msgr2=0x7f1a341592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b02a0 0x7f1a341592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 >> v2:172.21.15.135:3300/0 conn(0x7f1a340cf0a0 msgr2=0x7f1a340b0670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T03:49:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 --2- 172.21.15.43:0/3503574985 >> v2:172.21.15.135:3300/0 conn(0x7f1a340cf0a0 0x7f1a340b0670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b65c6c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 0x7f3b600c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b65c6c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 0x7f3b600c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58518/0 (socket says 172.21.15.43:58518) 2023-06-08T03:49:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.073+0000 7f3b65c6c700 1 -- 172.21.15.43:0/3646894075 learned_addr learned my addr 172.21.15.43:0/3646894075 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340c9390 con 0x7f1a340c8b80 2023-06-08T03:49:07.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f1a2c0019f0 con 0x7f1a340c8b80 2023-06-08T03:49:07.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 >> v1:172.21.15.43:6789/0 conn(0x7f1a340c8b80 legacy=0x7f1a34069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20003a00 0x7f1a20003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20004850 0x7f1a20004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a20005200 0x7f1a2000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34156140 con 0x7f1a20004850 2023-06-08T03:49:07.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340c9670 con 0x7f1a20005200 2023-06-08T03:49:07.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2000c0e0 con 0x7f1a20003a00 2023-06-08T03:49:07.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f3b65c6c700 1 -- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b600cf0a0 msgr2=0x7f3b600c5600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T03:49:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f3b65c6c700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b600cf0a0 0x7f3b600c5600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f3b65c6c700 1 -- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b02a0 msgr2=0x7f3b600c33c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T03:49:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f3b65c6c700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b02a0 0x7f3b600c33c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f3b65c6c700 1 -- 172.21.15.43:0/3646894075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58009b30 con 0x7f3b600b0670 2023-06-08T03:49:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20003a00 0x7f1a20003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f1a3ab6e700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a20005200 0x7f1a2000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f24df6bc700 1 Processor -- start 2023-06-08T03:49:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f3b65c6c700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 0x7f3b600c79e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b550 tx=0x7f3b5c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.074+0000 7f24df6bc700 1 -- start start 2023-06-08T03:49:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f1a3a36d700 1 -- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a20005200 msgr2=0x7f1a2000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a20005200 0x7f1a2000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f1a3a36d700 1 -- 172.21.15.43:0/3503574985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20004850 msgr2=0x7f1a20004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20004850 0x7f1a20004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f1a3a36d700 1 -- 172.21.15.43:0/3503574985 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340c9390 con 0x7f1a20003a00 2023-06-08T03:49:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7fee0465a700 1 Processor -- start 2023-06-08T03:49:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20003a00 0x7f1a20003e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a3406d530 tx=0x7f1a20005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e870600331a10a6d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c011830 con 0x7f3b600b0670 2023-06-08T03:49:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c011990 con 0x7f3b600b0670 2023-06-08T03:49:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c011d20 con 0x7f3b600b0670 2023-06-08T03:49:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b60150530 con 0x7f3b600b0670 2023-06-08T03:49:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b600c5b40 con 0x7f3b600b0670 2023-06-08T03:49:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7fee0465a700 1 -- start start 2023-06-08T03:49:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f24df6bc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b43f0 0x7f24d81fe790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.075+0000 7f24df6bc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80ccfc0 0x7f24d806da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24df6bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 0x7f24d806df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24df6bc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80ca850 con 0x7f24d80ccfc0 2023-06-08T03:49:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24df6bc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d806d060 con 0x7f24d80cd430 2023-06-08T03:49:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24df6bc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d806d340 con 0x7f24d80b43f0 2023-06-08T03:49:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400c070 con 0x7f1a20003a00 2023-06-08T03:49:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a24013630 con 0x7f1a20003a00 2023-06-08T03:49:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f1a3936b700 1 -- 172.21.15.43:0/3503574985 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240139c0 con 0x7f1a20003a00 2023-06-08T03:49:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7fee0465a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 0x7fedfc159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7fee0465a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedfc0ccfc0 0x7fedfc0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7fee0465a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0cd430 0x7fedfc0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7fee0465a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1e71b0 con 0x7fedfc0b43f0 2023-06-08T03:49:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7fee0465a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1e65a0 con 0x7fedfc0ccfc0 2023-06-08T03:49:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7fee0465a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1e6880 con 0x7fedfc0cd430 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 0x7f24d806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 0x7f24d806df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40144/0 (socket says 172.21.15.43:40144) 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 -- 172.21.15.43:0/3935905966 learned_addr learned my addr 172.21.15.43:0/3935905966 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24dcc57700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80ccfc0 0x7f24d806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 -- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b43f0 msgr2=0x7f24d81fe790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b43f0 0x7f24d81fe790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 -- 172.21.15.43:0/3935905966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80ccfc0 msgr2=0x7f24d806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80ccfc0 0x7f24d806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f24ddc59700 1 -- 172.21.15.43:0/3935905966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0009a70 con 0x7f24d80cd430 2023-06-08T03:49:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.076+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b480052f0 con 0x7f3b600b0670 2023-06-08T03:49:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f24ddc59700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 0x7f24d806df40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24d80d08b0 tx=0x7f24d0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20003a00 msgr2=0x7f1a20003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/3503574985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20003a00 0x7f1a20003e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a3406d530 tx=0x7f1a20005880 comp rx=0 tx=0).stop 2023-06-08T03:49:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f1a3ab6e700 1 -- 172.21.15.43:0/3503574985 reap_dead start 2023-06-08T03:49:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/3503574985 shutdown_connections 2023-06-08T03:49:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/3503574985 >> 172.21.15.43:0/3503574985 conn(0x7f1a340ce5c0 msgr2=0x7f1a340ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7fee023f6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 0x7fedfc159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7fee023f6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 0x7fedfc159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58530/0 (socket says 172.21.15.43:58530) 2023-06-08T03:49:07.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7fee023f6700 1 -- 172.21.15.43:0/1895285994 learned_addr learned my addr 172.21.15.43:0/1895285994 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0012430 con 0x7f24d80cd430 2023-06-08T03:49:07.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0020070 con 0x7f24d80cd430 2023-06-08T03:49:07.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0004280 con 0x7f24d80cd430 2023-06-08T03:49:07.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d806e5a0 con 0x7f24d80cd430 2023-06-08T03:49:07.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.077+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d81fecd0 con 0x7f24d80cd430 2023-06-08T03:49:07.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7fee023f6700 1 -- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0cd430 msgr2=0x7fedfc0c8b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7fee023f6700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0cd430 0x7fedfc0c8b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7fee023f6700 1 -- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedfc0ccfc0 msgr2=0x7fedfc0c8630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7fee023f6700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedfc0ccfc0 0x7fedfc0c8630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7fee023f6700 1 -- 172.21.15.43:0/1895285994 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec009500 con 0x7fedfc0b43f0 2023-06-08T03:49:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7fee023f6700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 0x7fedfc159ed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedec009c40 tx=0x7fedec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.078+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b5c01a400 con 0x7f3b600b0670 2023-06-08T03:49:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.079+0000 7f3b56ffd700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3b4406ad80 0x7f3b4406d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.079+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b5c089d20 con 0x7f3b600b0670 2023-06-08T03:49:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.079+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b80052f0 con 0x7f24d80cd430 2023-06-08T03:49:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.079+0000 7f3b6646d700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3b4406ad80 0x7f3b4406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.080+0000 7f3b6646d700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3b4406ad80 0x7f3b4406d230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b50000f60 tx=0x7f3b50007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.079+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff914054b00 con 0x7ff9200b0700 2023-06-08T03:49:07.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.080+0000 7f2c0b6ba700 1 Processor -- start 2023-06-08T03:49:07.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.080+0000 7f2c0b6ba700 1 -- start start 2023-06-08T03:49:07.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.080+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24d00043e0 con 0x7f24d80cd430 2023-06-08T03:49:07.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.080+0000 7f24cdffb700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ace0 0x7f24bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.080+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24d0022070 con 0x7f24d80cd430 2023-06-08T03:49:07.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c0b6ba700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 0x7f2c041592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c0b6ba700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c040b0700 0x7f2c040c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c0b6ba700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0406ffe0 con 0x7f2c04069db0 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c0b6ba700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c04156140 con 0x7f2c040b0700 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c0b6ba700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040c9670 con 0x7f2c040b0330 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c09456700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 0x7f2c041592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c09456700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 0x7f2c041592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:51998/0 (socket says 172.21.15.43:51998) 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c09c57700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2c04069db0 0x7f2c0406a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53448/0 (socket says 172.21.15.43:53448) 2023-06-08T03:49:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.081+0000 7f2c09456700 1 -- 172.21.15.43:0/238470515 learned_addr learned my addr 172.21.15.43:0/238470515 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f24dd458700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ace0 0x7f24bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2c08c55700 1 --2- 172.21.15.43:0/238470515 >> v2:172.21.15.135:3300/0 conn(0x7f2c040b0700 0x7f2c040c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2c09456700 1 -- 172.21.15.43:0/238470515 >> v2:172.21.15.135:3300/0 conn(0x7f2c040b0700 msgr2=0x7f2c040c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2c09456700 1 --2- 172.21.15.43:0/238470515 >> v2:172.21.15.135:3300/0 conn(0x7f2c040b0700 0x7f2c040c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2c09456700 1 -- 172.21.15.43:0/238470515 >> v1:172.21.15.43:6789/0 conn(0x7f2c04069db0 legacy=0x7f2c0406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2c09456700 1 -- 172.21.15.43:0/238470515 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040c90c0 con 0x7f2c040b0330 2023-06-08T03:49:07.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2c09456700 1 --2- 172.21.15.43:0/238470515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 0x7f2c041592c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c000088f0 tx=0x7f2c0000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b15899d89a59052f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f24dd458700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ace0 0x7f24bc06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f24d40099b0 tx=0x7f24d40091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2bfbfff700 1 -- 172.21.15.43:0/238470515 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00010070 con 0x7f2c040b0330 2023-06-08T03:49:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2bfbfff700 1 -- 172.21.15.43:0/238470515 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000da80 con 0x7f2c040b0330 2023-06-08T03:49:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.082+0000 7f2bfbfff700 1 -- 172.21.15.43:0/238470515 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000de10 con 0x7f2c040b0330 2023-06-08T03:49:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/3503574985 shutdown_connections 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/238470515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 msgr2=0x7f2c041592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/238470515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 0x7f2c041592c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c000088f0 tx=0x7f2c0000d330 comp rx=0 tx=0).stop 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/238470515 shutdown_connections 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/238470515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c040b0330 0x7f2c041592c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/238470515 >> v2:172.21.15.135:3300/0 conn(0x7f2c040b0700 0x7f2c040c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/238470515 >> 172.21.15.43:0/238470515 conn(0x7f2c040ce5c0 msgr2=0x7f2c040ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/238470515 shutdown_connections 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.083+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/238470515 wait complete. 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.084+0000 7f2c0b6ba700 1 Processor -- start 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 -- start start 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c04069db0 0x7f2c041f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c040b0330 0x7f2c041478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 0x7f2c041f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041f61a0 con 0x7f2c040b0700 2023-06-08T03:49:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041f6480 con 0x7f2c040b0330 2023-06-08T03:49:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f2c0b6ba700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041f6760 con 0x7f2c04069db0 2023-06-08T03:49:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.085+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24d0056560 con 0x7f24d80cd430 2023-06-08T03:49:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 0x7f2c041f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c08c55700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c040b0330 0x7f2c041478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c08c55700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c040b0330 0x7f2c041478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40166/0 (socket says 172.21.15.43:40166) 2023-06-08T03:49:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 0x7f2c041f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58552/0 (socket says 172.21.15.43:58552) 2023-06-08T03:49:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c08c55700 1 -- 172.21.15.43:0/1637577891 learned_addr learned my addr 172.21.15.43:0/1637577891 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 -- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c04069db0 msgr2=0x7f2c041f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09456700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c04069db0 0x7f2c041f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec006950 con 0x7fedfc0b43f0 2023-06-08T03:49:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec011420 con 0x7fedfc0b43f0 2023-06-08T03:49:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec011790 con 0x7fedfc0b43f0 2023-06-08T03:49:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c04069db0 0x7f2c041f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 -- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c040b0330 msgr2=0x7f2c041478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c040b0330 0x7f2c041478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 -- 172.21.15.43:0/1637577891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c000085d0 con 0x7f2c040b0700 2023-06-08T03:49:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b5c054b50 con 0x7f3b600b0670 2023-06-08T03:49:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc1e6b60 con 0x7fedfc0b43f0 2023-06-08T03:49:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc15a410 con 0x7fedfc0b43f0 2023-06-08T03:49:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.086+0000 7f2c09c57700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 0x7f2c041f2be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00ca70 tx=0x7f2bfc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.087+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00a9e0 con 0x7f2c040b0700 2023-06-08T03:49:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.087+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc00ab40 con 0x7f2c040b0700 2023-06-08T03:49:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.087+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc007070 con 0x7f2c040b0700 2023-06-08T03:49:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.088+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/3503574985 wait complete. 2023-06-08T03:49:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.088+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c041f23e0 con 0x7f2c040b0700 2023-06-08T03:49:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.088+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c041f5e00 con 0x7f2c040b0700 2023-06-08T03:49:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.089+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedec0118f0 con 0x7fedfc0b43f0 2023-06-08T03:49:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.089+0000 7fedfaffd700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fede806acb0 0x7fede806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.089+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fedec08a800 con 0x7fedfc0b43f0 2023-06-08T03:49:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.089+0000 7fee01bf5700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fede806acb0 0x7fede806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.090+0000 7f1a3c5d1700 1 Processor -- start 2023-06-08T03:49:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.090+0000 7f1a3c5d1700 1 -- start start 2023-06-08T03:49:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3c5d1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20003a00 0x7f1a34150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3c5d1700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b1430 0x7f1a3414f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3c5d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a340b18a0 0x7f1a3414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3c5d1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340b3f50 con 0x7f1a20003a00 2023-06-08T03:49:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3c5d1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340b30a0 con 0x7f1a340b18a0 2023-06-08T03:49:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3c5d1700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340b3340 con 0x7f1a340b1430 2023-06-08T03:49:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3a36d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20003a00 0x7f1a34150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3a36d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20003a00 0x7f1a34150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58556/0 (socket says 172.21.15.43:58556) 2023-06-08T03:49:07.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3a36d700 1 -- 172.21.15.43:0/2761016623 learned_addr learned my addr 172.21.15.43:0/2761016623 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3ab6e700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a340b18a0 0x7f1a3414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3ab6e700 1 -- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b1430 msgr2=0x7f1a3414f010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T03:49:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3ab6e700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b1430 0x7f1a3414f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3ab6e700 1 -- 172.21.15.43:0/2761016623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20003a00 msgr2=0x7f1a34150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3ab6e700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20003a00 0x7f1a34150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.091+0000 7f1a3ab6e700 1 -- 172.21.15.43:0/2761016623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340b3620 con 0x7f1a340b18a0 2023-06-08T03:49:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f1a3ab6e700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a340b18a0 0x7f1a3414f550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a340c8f50 tx=0x7f1a2c007340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007ac0 con 0x7f1a340b18a0 2023-06-08T03:49:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0133f0 con 0x7f1a340b18a0 2023-06-08T03:49:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c013760 con 0x7f1a340b18a0 2023-06-08T03:49:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0052f0 con 0x7fedfc0b43f0 2023-06-08T03:49:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a340b3900 con 0x7f1a340b18a0 2023-06-08T03:49:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a34151160 con 0x7f1a340b18a0 2023-06-08T03:49:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bfc0071d0 con 0x7f2c040b0700 2023-06-08T03:49:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f2bf9ffb700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.092+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2bfc089250 con 0x7f2c040b0700 2023-06-08T03:49:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.093+0000 7f2c09456700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.093+0000 7fa99494f700 1 Processor -- start 2023-06-08T03:49:07.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.093+0000 7f2c09456700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2be806ace0 0x7f2be806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c5560 tx=0x7f2c00012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.093+0000 7fa99494f700 1 -- start start 2023-06-08T03:49:07.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fee01bf5700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fede806acb0 0x7fede806d160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0d2230 tx=0x7fedf4009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c04066860 con 0x7f2c040b0700 2023-06-08T03:49:07.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa99494f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b43f0 0x7fa9900b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa99494f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa9900ccfc0 0x7fa9900d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa99494f700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9900cf690 con 0x7fa9900cd430 2023-06-08T03:49:07.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa99494f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9900d0180 con 0x7fa9900ccfc0 2023-06-08T03:49:07.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa99494f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900d0770 con 0x7fa9900b43f0 2023-06-08T03:49:07.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa98dd9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa9900ccfc0 0x7fa9900d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.094+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a2c0138c0 con 0x7f1a340b18a0 2023-06-08T03:49:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7f1a2affd700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a1806ad30 0x7f1a1806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a2c08a2f0 con 0x7f1a340b18a0 2023-06-08T03:49:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a1806ad30 0x7f1a1806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa98e59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b43f0 0x7fa9900b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa98ed9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa9900cd430 0x7fa9900d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53472/0 (socket says 172.21.15.43:53472) 2023-06-08T03:49:07.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa98e59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b43f0 0x7fa9900b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52018/0 (socket says 172.21.15.43:52018) 2023-06-08T03:49:07.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.095+0000 7fa98ed9d700 1 -- 172.21.15.43:0/3080832109 learned_addr learned my addr 172.21.15.43:0/3080832109 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:07.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7f1a3a36d700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a1806ad30 0x7f1a1806d1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a24015040 tx=0x7f1a2400c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98dd9b700 1 -- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b43f0 msgr2=0x7fa9900b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98dd9b700 1 --2- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b43f0 0x7fa9900b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98dd9b700 1 -- 172.21.15.43:0/3080832109 >> v1:172.21.15.43:6789/0 conn(0x7fa9900cd430 legacy=0x7fa9900d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98dd9b700 1 -- 172.21.15.43:0/3080832109 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900b4d00 con 0x7fa9900ccfc0 2023-06-08T03:49:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98dd9b700 1 --2- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900ccfc0 0x7fa9900d0c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa984009840 tx=0x7fa984009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2486cabd8a4e3b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98d59a700 1 -- 172.21.15.43:0/3080832109 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984011830 con 0x7fa9900ccfc0 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98d59a700 1 -- 172.21.15.43:0/3080832109 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984011990 con 0x7fa9900ccfc0 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.096+0000 7fa98d59a700 1 -- 172.21.15.43:0/3080832109 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984011d20 con 0x7fa9900ccfc0 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 -- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900ccfc0 msgr2=0x7fa9900d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 --2- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900ccfc0 0x7fa9900d0c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa984009840 tx=0x7fa984009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 -- 172.21.15.43:0/3080832109 shutdown_connections 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 --2- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b43f0 0x7fa9900b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 --2- 172.21.15.43:0/3080832109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900ccfc0 0x7fa9900d0c00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 -- 172.21.15.43:0/3080832109 >> 172.21.15.43:0/3080832109 conn(0x7fa99006afb0 msgr2=0x7fa99006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 -- 172.21.15.43:0/3080832109 shutdown_connections 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.097+0000 7fa99494f700 1 -- 172.21.15.43:0/3080832109 wait complete. 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.099+0000 7fa99494f700 1 Processor -- start 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.099+0000 7fa99494f700 1 -- start start 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa99494f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900b43f0 0x7fa99015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa99494f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900ccfc0 0x7fa9901e2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa99494f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9900cd430 0x7fa9901e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa99494f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901e5360 con 0x7fa9900cd430 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa99494f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901e3ca0 con 0x7fa9900b43f0 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa99494f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901e3f80 con 0x7fa9900ccfc0 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa98e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900b43f0 0x7fa99015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa98e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900b43f0 0x7fa99015b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40186/0 (socket says 172.21.15.43:40186) 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa98e59c700 1 -- 172.21.15.43:0/2229281694 learned_addr learned my addr 172.21.15.43:0/2229281694 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.100+0000 7fa98dd9b700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900ccfc0 0x7fa9901e2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98ed9d700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9900cd430 0x7fa9901e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98dd9b700 1 -- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900b43f0 msgr2=0x7fa99015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98dd9b700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900b43f0 0x7fa99015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98dd9b700 1 -- 172.21.15.43:0/2229281694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9900cd430 msgr2=0x7fa9901e3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98dd9b700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9900cd430 0x7fa9901e3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98dd9b700 1 -- 172.21.15.43:0/2229281694 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094a0 con 0x7fa9900ccfc0 2023-06-08T03:49:07.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98ed9d700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9900cd430 0x7fa9901e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa98dd9b700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900ccfc0 0x7fa9901e2f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa984016000 tx=0x7fa984004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840038a0 con 0x7fa9900ccfc0 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984027070 con 0x7fa9900ccfc0 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984003c80 con 0x7fa9900ccfc0 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9901e4260 con 0x7fa9900ccfc0 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9901e3980 con 0x7fa9900ccfc0 2023-06-08T03:49:07.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.101+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c0052f0 con 0x7f1a340b18a0 2023-06-08T03:49:07.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.102+0000 7fc16e1bb700 1 Processor -- start 2023-06-08T03:49:07.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.102+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fedec055820 con 0x7fedfc0b43f0 2023-06-08T03:49:07.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.102+0000 7fc16e1bb700 1 -- start start 2023-06-08T03:49:07.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc16e1bb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 0x7fc168071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc16e1bb700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc1680ca5f0 0x7fc1680716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc16e1bb700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1680ceb10 con 0x7fc1680cc020 2023-06-08T03:49:07.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc16e1bb700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1680aeee0 con 0x7fc1680ca5f0 2023-06-08T03:49:07.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc16e1bb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc168159630 con 0x7fc168159260 2023-06-08T03:49:07.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 0x7fc168071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 0x7fc168071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52032/0 (socket says 172.21.15.43:52032) 2023-06-08T03:49:07.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 -- 172.21.15.43:0/3961031386 learned_addr learned my addr 172.21.15.43:0/3961031386 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc166ffd700 1 --2- 172.21.15.43:0/3961031386 >> v2:172.21.15.43:3300/0 conn(0x7fc1680ca5f0 0x7fc1680716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.104+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa98402e480 con 0x7fa9900ccfc0 2023-06-08T03:49:07.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.104+0000 7fa97effd700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa97006ace0 0x7fa97006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.104+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa984029070 con 0x7fa9900ccfc0 2023-06-08T03:49:07.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.104+0000 7fa98e59c700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa97006ace0 0x7fa97006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 -- 172.21.15.43:0/3961031386 >> v2:172.21.15.43:3300/0 conn(0x7fc1680ca5f0 msgr2=0x7fc1680716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:07.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 --2- 172.21.15.43:0/3961031386 >> v2:172.21.15.43:3300/0 conn(0x7fc1680ca5f0 0x7fc1680716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 -- 172.21.15.43:0/3961031386 >> v1:172.21.15.135:6789/0 conn(0x7fc1680cc020 legacy=0x7fc1680b10d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-08T03:49:07.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.103+0000 7fc1677fe700 1 -- 172.21.15.43:0/3961031386 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680ce680 con 0x7fc168159260 2023-06-08T03:49:07.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.104+0000 7fc1677fe700 1 --2- 172.21.15.43:0/3961031386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 0x7fc168071ce0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00b9a0 tx=0x7fc15c00bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d7eded412b3973f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.105+0000 7fa98e59c700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa97006ace0 0x7fa97006d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa980006eb0 tx=0x7fa980008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.106+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9901e54a0 con 0x7fa9900ccfc0 2023-06-08T03:49:07.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.108+0000 7fc1667fc700 1 -- 172.21.15.43:0/3961031386 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004230 con 0x7fc168159260 2023-06-08T03:49:07.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.108+0000 7fc1667fc700 1 -- 172.21.15.43:0/3961031386 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c004390 con 0x7fc168159260 2023-06-08T03:49:07.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.108+0000 7fc1667fc700 1 -- 172.21.15.43:0/3961031386 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00c860 con 0x7fc168159260 2023-06-08T03:49:07.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.108+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a2c017080 con 0x7f1a340b18a0 2023-06-08T03:49:07.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.110+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bfc054150 con 0x7f2c040b0700 2023-06-08T03:49:07.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9901e54a0 con 0x7fa9900ccfc0 2023-06-08T03:49:07.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 -- 172.21.15.43:0/3961031386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 msgr2=0x7fc168071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/3961031386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 0x7fc168071ce0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00b9a0 tx=0x7fc15c00bcb0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 -- 172.21.15.43:0/3961031386 shutdown_connections 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/3961031386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168159260 0x7fc168071ce0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/3961031386 >> v2:172.21.15.43:3300/0 conn(0x7fc1680ca5f0 0x7fc1680716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 -- 172.21.15.43:0/3961031386 >> 172.21.15.43:0/3961031386 conn(0x7fc16806aec0 msgr2=0x7fc16806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.111+0000 7fc16e1bb700 1 -- 172.21.15.43:0/3961031386 shutdown_connections 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.112+0000 7fc16e1bb700 1 -- 172.21.15.43:0/3961031386 wait complete. 2023-06-08T03:49:07.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.113+0000 7fc16e1bb700 1 Processor -- start 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.114+0000 7fc16e1bb700 1 -- start start 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.115+0000 7fc16e1bb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1680ca5f0 0x7fc168158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.115+0000 7fc16e1bb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1680cc020 0x7fc1681f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.115+0000 7fc16e1bb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 0x7fc1680b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.115+0000 7fc16e1bb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1681f6af0 con 0x7fc1680cc020 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.115+0000 7fc16e1bb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680b4a60 con 0x7fc168159260 2023-06-08T03:49:07.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.115+0000 7fc16e1bb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680b4ef0 con 0x7fc1680ca5f0 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 0x7fc1680b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 0x7fc1680b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40202/0 (socket says 172.21.15.43:40202) 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 -- 172.21.15.43:0/1236746916 learned_addr learned my addr 172.21.15.43:0/1236746916 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc1677fe700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1680ca5f0 0x7fc168158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 -- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1680ca5f0 msgr2=0x7fc168158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1680ca5f0 0x7fc168158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 -- 172.21.15.43:0/1236746916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1680cc020 msgr2=0x7fc1681f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1680cc020 0x7fc1681f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.116+0000 7fc167fff700 1 -- 172.21.15.43:0/1236746916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c00b600 con 0x7fc168159260 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.118+0000 7fc167fff700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 0x7fc1680b3600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc16000b780 tx=0x7fc16000bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.119+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000f840 con 0x7fc168159260 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.119+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16000f9a0 con 0x7fc168159260 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.119+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000fd50 con 0x7fc168159260 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.119+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1680b3e50 con 0x7fc168159260 2023-06-08T03:49:07.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.119+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1680b4410 con 0x7fc168159260 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.122+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1600203f0 con 0x7fc168159260 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.122+0000 7fc14ffff700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc15406adb0 0x7fc15406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.122+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc160089b80 con 0x7fc168159260 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.123+0000 7fc1677fe700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc15406adb0 0x7fc15406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.123+0000 7fc1677fe700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc15406adb0 0x7fc15406d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0090b0 tx=0x7fc15c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.129+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1480052f0 con 0x7fc168159260 2023-06-08T03:49:07.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.134+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1600583b0 con 0x7fc168159260 2023-06-08T03:49:07.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.490+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff900005870 con 0x7ff9200b0700 2023-06-08T03:49:07.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.490+0000 7ff91cff9700 1 -- 172.21.15.43:0/1588074485 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff914058120 con 0x7ff9200b0700 2023-06-08T03:49:07.497 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-06-08T03:49:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.494+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff90c06adb0 msgr2=0x7ff90c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.494+0000 7ff926927700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff90c06adb0 0x7ff90c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff910009b90 tx=0x7ff910008040 comp rx=0 tx=0).stop 2023-06-08T03:49:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.494+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 msgr2=0x7ff9200711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.494+0000 7ff926927700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 0x7ff9200711c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff91400b470 tx=0x7ff91400b830 comp rx=0 tx=0).stop 2023-06-08T03:49:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 shutdown_connections 2023-06-08T03:49:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff90c06adb0 0x7ff90c06d260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9200b0330 0x7ff9201f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9200cd290 0x7ff920071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 --2- 172.21.15.43:0/1588074485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9200b0700 0x7ff9200711c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 >> 172.21.15.43:0/1588074485 conn(0x7ff9200ce5c0 msgr2=0x7ff920069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 shutdown_connections 2023-06-08T03:49:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.495+0000 7ff926927700 1 -- 172.21.15.43:0/1588074485 wait complete. 2023-06-08T03:49:07.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.501+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feddc005870 con 0x7fedfc0b43f0 2023-06-08T03:49:07.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.502+0000 7fedfaffd700 1 -- 172.21.15.43:0/1895285994 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedec028070 con 0x7fedfc0b43f0 2023-06-08T03:49:07.509 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fede806acb0 msgr2=0x7fede806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fede806acb0 0x7fede806d160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0d2230 tx=0x7fedf4009230 comp rx=0 tx=0).stop 2023-06-08T03:49:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 msgr2=0x7fedfc159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 0x7fedfc159ed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedec009c40 tx=0x7fedec004750 comp rx=0 tx=0).stop 2023-06-08T03:49:07.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 shutdown_connections 2023-06-08T03:49:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fede806acb0 0x7fede806d160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc0b43f0 0x7fedfc159ed0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedfc0cd430 0x7fedfc0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 --2- 172.21.15.43:0/1895285994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedfc0ccfc0 0x7fedfc0c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.505+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 >> 172.21.15.43:0/1895285994 conn(0x7fedfc06afb0 msgr2=0x7fedfc0d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.508+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 shutdown_connections 2023-06-08T03:49:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.508+0000 7fee0465a700 1 -- 172.21.15.43:0/1895285994 wait complete. 2023-06-08T03:49:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.508+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24b8005870 con 0x7f24d80cd430 2023-06-08T03:49:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.510+0000 7f24cdffb700 1 -- 172.21.15.43:0/3935905966 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24d0059b80 con 0x7f24d80cd430 2023-06-08T03:49:07.517 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-06-08T03:49:07.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-06-08T03:49:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ace0 msgr2=0x7f24bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ace0 0x7f24bc06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f24d40099b0 tx=0x7f24d40091c0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 msgr2=0x7f24d806df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 0x7f24d806df40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24d80d08b0 tx=0x7f24d0004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 shutdown_connections 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ace0 0x7f24bc06d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d80cd430 0x7f24d806df40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b43f0 0x7f24d81fe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 --2- 172.21.15.43:0/3935905966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80ccfc0 0x7f24d806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.515+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 >> 172.21.15.43:0/3935905966 conn(0x7f24d806afb0 msgr2=0x7f24d80b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.516+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 shutdown_connections 2023-06-08T03:49:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.516+0000 7f24df6bc700 1 -- 172.21.15.43:0/3935905966 wait complete. 2023-06-08T03:49:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.524+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c04073fa0 con 0x7f2c040b0700 2023-06-08T03:49:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.524+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9901e54a0 con 0x7fa9900ccfc0 2023-06-08T03:49:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.525+0000 7fa97effd700 1 -- 172.21.15.43:0/2229281694 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9901e54a0 con 0x7fa9900ccfc0 2023-06-08T03:49:07.529 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.525+0000 7f2bf9ffb700 1 -- 172.21.15.43:0/1637577891 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bfc017070 con 0x7f2c040b0700 2023-06-08T03:49:07.529 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:07.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.526+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b48005870 con 0x7f3b600b0670 2023-06-08T03:49:07.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.527+0000 7f3b56ffd700 1 -- 172.21.15.43:0/3646894075 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b5c058170 con 0x7f3b600b0670 2023-06-08T03:49:07.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-06-08T03:49:07.532 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa97006ace0 msgr2=0x7fa97006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa97006ace0 0x7fa97006d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa980006eb0 tx=0x7fa980008040 comp rx=0 tx=0).stop 2023-06-08T03:49:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900ccfc0 msgr2=0x7fa9901e2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900ccfc0 0x7fa9901e2f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa984016000 tx=0x7fa984004750 comp rx=0 tx=0).stop 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 shutdown_connections 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa97006ace0 0x7fa97006d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9900cd430 0x7fa9901e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9900b43f0 0x7fa99015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 --2- 172.21.15.43:0/2229281694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900ccfc0 0x7fa9901e2f00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 >> 172.21.15.43:0/2229281694 conn(0x7fa99006afb0 msgr2=0x7fa9900b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 shutdown_connections 2023-06-08T03:49:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.528+0000 7fa99494f700 1 -- 172.21.15.43:0/2229281694 wait complete. 2023-06-08T03:49:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2be806ace0 msgr2=0x7f2be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2be806ace0 0x7f2be806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c5560 tx=0x7f2c00012000 comp rx=0 tx=0).stop 2023-06-08T03:49:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 msgr2=0x7f2c041f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 0x7f2c041f2be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00ca70 tx=0x7f2bfc00cd80 comp rx=0 tx=0).stop 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 shutdown_connections 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c040b0700 0x7f2c041f2be0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c04069db0 0x7f2c041f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 --2- 172.21.15.43:0/1637577891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c040b0330 0x7f2c041478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 >> 172.21.15.43:0/1637577891 conn(0x7f2c040ce5c0 msgr2=0x7f2c040713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 shutdown_connections 2023-06-08T03:49:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.529+0000 7f2c0b6ba700 1 -- 172.21.15.43:0/1637577891 wait complete. 2023-06-08T03:49:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.531+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3b4406ad80 msgr2=0x7f3b4406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.531+0000 7f3b686d1700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3b4406ad80 0x7f3b4406d230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b50000f60 tx=0x7f3b50007a40 comp rx=0 tx=0).stop 2023-06-08T03:49:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.531+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 msgr2=0x7f3b600c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.531+0000 7f3b686d1700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 0x7f3b600c79e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b550 tx=0x7f3b5c00b910 comp rx=0 tx=0).stop 2023-06-08T03:49:07.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-06-08T03:49:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 shutdown_connections 2023-06-08T03:49:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3b4406ad80 0x7f3b4406d230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b600cf0a0 0x7f3b600c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b600b02a0 0x7f3b600c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 --2- 172.21.15.43:0/3646894075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b600b0670 0x7f3b600c79e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 >> 172.21.15.43:0/3646894075 conn(0x7f3b600ce5c0 msgr2=0x7f3b60070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 shutdown_connections 2023-06-08T03:49:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.540+0000 7f3b686d1700 1 -- 172.21.15.43:0/3646894075 wait complete. 2023-06-08T03:49:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.541+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc1480055a0 con 0x7fc168159260 2023-06-08T03:49:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.541+0000 7fc14ffff700 1 -- 172.21.15.43:0/1236746916 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc160057f40 con 0x7fc168159260 2023-06-08T03:49:07.546 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-06-08T03:49:07.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-06-08T03:49:07.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc15406adb0 msgr2=0x7fc15406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc15406adb0 0x7fc15406d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0090b0 tx=0x7fc15c008030 comp rx=0 tx=0).stop 2023-06-08T03:49:07.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 msgr2=0x7fc1680b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 0x7fc1680b3600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc16000b780 tx=0x7fc16000bb40 comp rx=0 tx=0).stop 2023-06-08T03:49:07.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 shutdown_connections 2023-06-08T03:49:07.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc15406adb0 0x7fc15406d260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168159260 0x7fc1680b3600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1680ca5f0 0x7fc168158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 --2- 172.21.15.43:0/1236746916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1680cc020 0x7fc1681f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.545+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 >> 172.21.15.43:0/1236746916 conn(0x7fc16806aec0 msgr2=0x7fc168069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.546+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 shutdown_connections 2023-06-08T03:49:07.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.546+0000 7fc16e1bb700 1 -- 172.21.15.43:0/1236746916 wait complete. 2023-06-08T03:49:07.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-06-08T03:49:07.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.549+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a1c005870 con 0x7f1a340b18a0 2023-06-08T03:49:07.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.550+0000 7f1a2affd700 1 -- 172.21.15.43:0/2761016623 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a2c055190 con 0x7f1a340b18a0 2023-06-08T03:49:07.555 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:07.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a1806ad30 msgr2=0x7f1a1806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a1806ad30 0x7f1a1806d1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a24015040 tx=0x7f1a2400c000 comp rx=0 tx=0).stop 2023-06-08T03:49:07.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a340b18a0 msgr2=0x7f1a3414f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:07.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a340b18a0 0x7f1a3414f550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a340c8f50 tx=0x7f1a2c007340 comp rx=0 tx=0).stop 2023-06-08T03:49:07.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 shutdown_connections 2023-06-08T03:49:07.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a1806ad30 0x7f1a1806d1e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20003a00 0x7f1a34150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a340b18a0 0x7f1a3414f550 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.553+0000 7f1a3c5d1700 1 --2- 172.21.15.43:0/2761016623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a340b1430 0x7f1a3414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:07.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.554+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 >> 172.21.15.43:0/2761016623 conn(0x7f1a340ce5c0 msgr2=0x7f1a34158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:07.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.554+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 shutdown_connections 2023-06-08T03:49:07.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:07.554+0000 7f1a3c5d1700 1 -- 172.21.15.43:0/2761016623 wait complete. 2023-06-08T03:49:07.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-06-08T03:49:07.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-06-08T03:49:07.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-06-08T03:49:08.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-08T03:49:08.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-08T03:49:08.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-08T03:49:08.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-08T03:49:08.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-08T03:49:08.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-08T03:49:08.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-08T03:49:08.573 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-08T03:49:08.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.723+0000 7ffa9311b700 1 Processor -- start 2023-06-08T03:49:08.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.723+0000 7ffa9311b700 1 -- start start 2023-06-08T03:49:08.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa9311b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffa8c0b0330 0x7ffa8c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa9311b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa9311b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c06ffe0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa9311b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c156140 con 0x7ffa8c0b0330 2023-06-08T03:49:08.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa9311b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c9670 con 0x7ffa8c0cd290 2023-06-08T03:49:08.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa8bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffa8c0b0700 0x7ffa8c0c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53498/0 (socket says 172.21.15.43:53498) 2023-06-08T03:49:08.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.724+0000 7ffa8bfff700 1 -- 172.21.15.43:0/3521845223 learned_addr learned my addr 172.21.15.43:0/3521845223 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:08.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.725+0000 7ffa90eb7700 1 --2- 172.21.15.43:0/3521845223 >> v2:172.21.15.135:3300/0 conn(0x7ffa8c0b0330 0x7ffa8c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.725+0000 7ffa90eb7700 1 -- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 msgr2=0x7ffa8c0cd710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-08T03:49:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.725+0000 7ffa90eb7700 1 --2- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0cd710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.725+0000 7ffa90eb7700 1 -- 172.21.15.43:0/3521845223 >> v1:172.21.15.43:6789/0 conn(0x7ffa8c0b0700 legacy=0x7ffa8c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.725+0000 7ffa90eb7700 1 -- 172.21.15.43:0/3521845223 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0c9390 con 0x7ffa8c0b0330 2023-06-08T03:49:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.726+0000 7ffa90eb7700 1 --2- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c1592c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00a9e0 tx=0x7ffa7c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300ab1835bee4f17 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.729+0000 7ffa8b7fe700 1 -- 172.21.15.43:0/3521845223 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c004230 con 0x7ffa8c0b0330 2023-06-08T03:49:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.729+0000 7ffa8b7fe700 1 -- 172.21.15.43:0/3521845223 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c004390 con 0x7ffa8c0b0330 2023-06-08T03:49:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.729+0000 7ffa8b7fe700 1 -- 172.21.15.43:0/3521845223 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00c870 con 0x7ffa8c0b0330 2023-06-08T03:49:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.730+0000 7ffa9311b700 1 -- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 msgr2=0x7ffa8c1592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.730+0000 7ffa9311b700 1 --2- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c1592c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00a9e0 tx=0x7ffa7c00acf0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.730+0000 7ffa9311b700 1 -- 172.21.15.43:0/3521845223 shutdown_connections 2023-06-08T03:49:08.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.730+0000 7ffa9311b700 1 --2- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.730+0000 7ffa9311b700 1 --2- 172.21.15.43:0/3521845223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c1592c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.730+0000 7ffa9311b700 1 -- 172.21.15.43:0/3521845223 >> 172.21.15.43:0/3521845223 conn(0x7ffa8c0ce5c0 msgr2=0x7ffa8c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.733+0000 7ffa9311b700 1 -- 172.21.15.43:0/3521845223 shutdown_connections 2023-06-08T03:49:08.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.733+0000 7ffa9311b700 1 -- 172.21.15.43:0/3521845223 wait complete. 2023-06-08T03:49:08.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.735+0000 7ffa9311b700 1 Processor -- start 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.735+0000 7ffa9311b700 1 -- start start 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa9311b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa9311b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 0x7ffa8c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa9311b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa9311b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c61f0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa9311b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0b1970 con 0x7ffa8c0b0330 2023-06-08T03:49:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa9311b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0b1c10 con 0x7ffa8c0cd290 2023-06-08T03:49:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa8bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 0x7ffa8c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa8bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 0x7ffa8c0c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58600/0 (socket says 172.21.15.43:58600) 2023-06-08T03:49:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.737+0000 7ffa8bfff700 1 -- 172.21.15.43:0/2435880197 learned_addr learned my addr 172.21.15.43:0/2435880197 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa90eb7700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa916b8700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa8bfff700 1 -- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 msgr2=0x7ffa8c0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa8bfff700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa8bfff700 1 -- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 msgr2=0x7ffa8c152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa8bfff700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.738+0000 7ffa8bfff700 1 -- 172.21.15.43:0/2435880197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c00a640 con 0x7ffa8c0b0700 2023-06-08T03:49:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.739+0000 7ffa8bfff700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 0x7ffa8c0c3fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ba20 tx=0x7ffa8400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.740+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400cba0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.740+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400cd00 con 0x7ffa8c0b0700 2023-06-08T03:49:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.740+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa840156b0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.740+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c0b1ef0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.740+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c0b21d0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.744+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c0c5ce0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.751+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa84012070 con 0x7ffa8c0b0700 2023-06-08T03:49:08.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.752+0000 7ffa897fa700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffa7806ade0 0x7ffa7806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.752+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa84089420 con 0x7ffa8c0b0700 2023-06-08T03:49:08.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.752+0000 7ffa90eb7700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffa7806ade0 0x7ffa7806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.755+0000 7ffa90eb7700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffa7806ade0 0x7ffa7806d290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c000c00 tx=0x7ffa7c012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.755+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa8c0c5ce0 con 0x7ffa8c0b0700 2023-06-08T03:49:08.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.762+0000 7f02738de700 1 Processor -- start 2023-06-08T03:49:08.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.762+0000 7f02738de700 1 -- start start 2023-06-08T03:49:08.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.764+0000 7f02738de700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f026c06a250 0x7f026c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.764+0000 7f02738de700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c165200 con 0x7f026c1607a0 2023-06-08T03:49:08.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.764+0000 7f02738de700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c160b70 con 0x7f026c069db0 2023-06-08T03:49:08.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.764+0000 7f02738de700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c164680 con 0x7f026c06a250 2023-06-08T03:49:08.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.764+0000 7f027167a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f026c1607a0 0x7f026c0cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53514/0 (socket says 172.21.15.43:53514) 2023-06-08T03:49:08.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.764+0000 7f027167a700 1 -- 172.21.15.43:0/3718174236 learned_addr learned my addr 172.21.15.43:0/3718174236 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:08.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.765+0000 7f0271e7b700 1 --2- 172.21.15.43:0/3718174236 >> v2:172.21.15.135:3300/0 conn(0x7f026c06a250 0x7f026c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.765+0000 7f0271e7b700 1 -- 172.21.15.43:0/3718174236 >> v1:172.21.15.135:6789/0 conn(0x7f026c069db0 legacy=0x7f026c0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.765+0000 7f0271e7b700 1 -- 172.21.15.43:0/3718174236 >> v1:172.21.15.43:6789/0 conn(0x7f026c1607a0 legacy=0x7f026c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.765+0000 7f0271e7b700 1 -- 172.21.15.43:0/3718174236 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c164960 con 0x7f026c06a250 2023-06-08T03:49:08.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.766+0000 7f9652537700 1 Processor -- start 2023-06-08T03:49:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.766+0000 7f9652537700 1 -- start start 2023-06-08T03:49:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.766+0000 7f0271e7b700 1 --2- 172.21.15.43:0/3718174236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c06a250 0x7f026c0c9810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0260009840 tx=0x7f0260009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdf94033f5eb01ae server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.766+0000 7f026bfff700 1 -- 172.21.15.43:0/3718174236 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011830 con 0x7f026c06a250 2023-06-08T03:49:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.766+0000 7f026bfff700 1 -- 172.21.15.43:0/3718174236 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0260011990 con 0x7f026c06a250 2023-06-08T03:49:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.766+0000 7f026bfff700 1 -- 172.21.15.43:0/3718174236 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011d20 con 0x7f026c06a250 2023-06-08T03:49:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f02738de700 1 -- 172.21.15.43:0/3718174236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c06a250 msgr2=0x7f026c0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f02738de700 1 --2- 172.21.15.43:0/3718174236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c06a250 0x7f026c0c9810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0260009840 tx=0x7f0260009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:08.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f9652537700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f964c071870 0x7f964c0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f9652537700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f964c0b07d0 0x7f964c15fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f9652537700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c06abf0 con 0x7f964c0cde50 2023-06-08T03:49:08.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f9652537700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c15c5f0 con 0x7f964c0b07d0 2023-06-08T03:49:08.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f9652537700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c071c40 con 0x7f964c071870 2023-06-08T03:49:08.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f964bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f964c071870 0x7f964c0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f964bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f964c071870 0x7f964c0c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40228/0 (socket says 172.21.15.43:40228) 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.767+0000 7f964bfff700 1 -- 172.21.15.43:0/2876536731 learned_addr learned my addr 172.21.15.43:0/2876536731 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f9650ad4700 1 --2- 172.21.15.43:0/2876536731 >> v2:172.21.15.43:3300/0 conn(0x7f964c0b07d0 0x7f964c15fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964bfff700 1 -- 172.21.15.43:0/2876536731 >> v2:172.21.15.43:3300/0 conn(0x7f964c0b07d0 msgr2=0x7f964c15fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964bfff700 1 --2- 172.21.15.43:0/2876536731 >> v2:172.21.15.43:3300/0 conn(0x7f964c0b07d0 0x7f964c15fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964bfff700 1 -- 172.21.15.43:0/2876536731 >> v1:172.21.15.43:6789/0 conn(0x7f964c0cde50 legacy=0x7f964c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964bfff700 1 -- 172.21.15.43:0/2876536731 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c06ffe0 con 0x7f964c071870 2023-06-08T03:49:08.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f9650ad4700 1 --2- 172.21.15.43:0/2876536731 >> v2:172.21.15.43:3300/0 conn(0x7f964c0b07d0 0x7f964c15fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:08.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f02738de700 1 -- 172.21.15.43:0/3718174236 shutdown_connections 2023-06-08T03:49:08.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f02738de700 1 --2- 172.21.15.43:0/3718174236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c06a250 0x7f026c0c9810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f02738de700 1 -- 172.21.15.43:0/3718174236 >> 172.21.15.43:0/3718174236 conn(0x7f026c0cf250 msgr2=0x7f026c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964bfff700 1 --2- 172.21.15.43:0/2876536731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c071870 0x7f964c0c8b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f964c06f250 tx=0x7f963c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a1161c78e1529a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f02738de700 1 -- 172.21.15.43:0/3718174236 shutdown_connections 2023-06-08T03:49:08.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f02738de700 1 -- 172.21.15.43:0/3718174236 wait complete. 2023-06-08T03:49:08.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7fb8570ac700 1 Processor -- start 2023-06-08T03:49:08.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964affd700 1 -- 172.21.15.43:0/2876536731 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00b870 con 0x7f964c071870 2023-06-08T03:49:08.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964affd700 1 -- 172.21.15.43:0/2876536731 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c00b9d0 con 0x7f964c071870 2023-06-08T03:49:08.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.768+0000 7f964affd700 1 -- 172.21.15.43:0/2876536731 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00bd60 con 0x7f964c071870 2023-06-08T03:49:08.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.769+0000 7f9652537700 1 -- 172.21.15.43:0/2876536731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c071870 msgr2=0x7f964c0c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.769+0000 7f9652537700 1 --2- 172.21.15.43:0/2876536731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c071870 0x7f964c0c8b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f964c06f250 tx=0x7f963c009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.770+0000 7f02738de700 1 Processor -- start 2023-06-08T03:49:08.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.770+0000 7fb8570ac700 1 -- start start 2023-06-08T03:49:08.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb8570ac700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0330 0x7fb8501592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb8570ac700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8500cd290 0x7fb8500cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb8570ac700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85006ffe0 con 0x7fb8500b0700 2023-06-08T03:49:08.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb8570ac700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb850156140 con 0x7fb8500cd290 2023-06-08T03:49:08.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb8570ac700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c9670 con 0x7fb8500b0330 2023-06-08T03:49:08.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb855649700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8500cd290 0x7fb8500cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb855649700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8500cd290 0x7fb8500cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40234/0 (socket says 172.21.15.43:40234) 2023-06-08T03:49:08.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7fb855649700 1 -- 172.21.15.43:0/2639987458 learned_addr learned my addr 172.21.15.43:0/2639987458 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.770+0000 7f02738de700 1 -- start start 2023-06-08T03:49:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7f02738de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c069db0 0x7f026c155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7f02738de700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f026c06a250 0x7f026c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7f02738de700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 0x7f026c0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7f02738de700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c155d80 con 0x7f026c1607a0 2023-06-08T03:49:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7f02738de700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c7c00 con 0x7f026c069db0 2023-06-08T03:49:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.771+0000 7f02738de700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0721f0 con 0x7f026c06a250 2023-06-08T03:49:08.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb855649700 1 -- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0330 msgr2=0x7fb8501592c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T03:49:08.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb855649700 1 --2- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0330 0x7fb8501592c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb855649700 1 -- 172.21.15.43:0/2639987458 >> v1:172.21.15.135:6789/0 conn(0x7fb8500b0700 legacy=0x7fb8500c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:08.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb855649700 1 -- 172.21.15.43:0/2639987458 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500c9390 con 0x7fb8500cd290 2023-06-08T03:49:08.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 0x7f026c0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 0x7f026c0c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58626/0 (socket says 172.21.15.43:58626) 2023-06-08T03:49:08.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 -- 172.21.15.43:0/1031578898 learned_addr learned my addr 172.21.15.43:0/1031578898 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb855649700 1 --2- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500cd290 0x7fb8500cd710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb84800d370 tx=0x7fb84800d680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528c0bd8868c915a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb84f7fe700 1 -- 172.21.15.43:0/2639987458 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848010070 con 0x7fb8500cd290 2023-06-08T03:49:08.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb84f7fe700 1 -- 172.21.15.43:0/2639987458 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800dcd0 con 0x7fb8500cd290 2023-06-08T03:49:08.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7fb84f7fe700 1 -- 172.21.15.43:0/2639987458 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848007d70 con 0x7fb8500cd290 2023-06-08T03:49:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 -- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f026c06a250 msgr2=0x7f026c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f026c06a250 0x7f026c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 -- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c069db0 msgr2=0x7f026c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c069db0 0x7f026c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f0271e7b700 1 -- 172.21.15.43:0/1031578898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600094a0 con 0x7f026c1607a0 2023-06-08T03:49:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.772+0000 7f9cd38b3700 1 Processor -- start 2023-06-08T03:49:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7f0271e7b700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 0x7f026c0c6880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0260009b90 tx=0x7f0260004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02600036a0 con 0x7f026c1607a0 2023-06-08T03:49:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026001f070 con 0x7f026c1607a0 2023-06-08T03:49:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260003a40 con 0x7f026c1607a0 2023-06-08T03:49:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c0c7920 con 0x7f026c1607a0 2023-06-08T03:49:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c0adf50 con 0x7f026c1607a0 2023-06-08T03:49:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7fb8570ac700 1 -- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500cd290 msgr2=0x7fb8500cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.773+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500cd290 0x7fb8500cd710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb84800d370 tx=0x7fb84800d680 comp rx=0 tx=0).stop 2023-06-08T03:49:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.774+0000 7f9cd38b3700 1 -- start start 2023-06-08T03:49:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.774+0000 7f9cd38b3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.774+0000 7f9cd38b3700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ccc06ffe0 con 0x7f9ccc0b0330 2023-06-08T03:49:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.774+0000 7f9cd38b3700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ccc0c9670 con 0x7f9ccc0b0700 2023-06-08T03:49:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd38b3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc156140 con 0x7f9ccc1592c0 2023-06-08T03:49:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd164f700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9ccc0b0330 0x7f9ccc0c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53532/0 (socket says 172.21.15.43:53532) 2023-06-08T03:49:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd164f700 1 -- 172.21.15.43:0/2784567839 learned_addr learned my addr 172.21.15.43:0/2784567839 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd1e50700 1 --2- 172.21.15.43:0/2784567839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c073fa0 con 0x7f026c1607a0 2023-06-08T03:49:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd1e50700 1 -- 172.21.15.43:0/2784567839 >> v1:172.21.15.135:6789/0 conn(0x7f9ccc0b0700 legacy=0x7f9ccc0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd1e50700 1 -- 172.21.15.43:0/2784567839 >> v1:172.21.15.43:6789/0 conn(0x7f9ccc0b0330 legacy=0x7f9ccc0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.775+0000 7f9cd1e50700 1 -- 172.21.15.43:0/2784567839 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc0c9390 con 0x7f9ccc1592c0 2023-06-08T03:49:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7f9652537700 1 -- 172.21.15.43:0/2876536731 shutdown_connections 2023-06-08T03:49:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7f9652537700 1 --2- 172.21.15.43:0/2876536731 >> v2:172.21.15.43:3300/0 conn(0x7f964c0b07d0 0x7f964c15fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7f9652537700 1 --2- 172.21.15.43:0/2876536731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c071870 0x7f964c0c8b80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7f9652537700 1 -- 172.21.15.43:0/2876536731 >> 172.21.15.43:0/2876536731 conn(0x7f964c0ce5c0 msgr2=0x7f964c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7fb8570ac700 1 -- 172.21.15.43:0/2639987458 shutdown_connections 2023-06-08T03:49:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0330 0x7fb8501592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2639987458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500cd290 0x7fb8500cd710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7fb8570ac700 1 -- 172.21.15.43:0/2639987458 >> 172.21.15.43:0/2639987458 conn(0x7fb8500ce5c0 msgr2=0x7fb8500ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7f9652537700 1 -- 172.21.15.43:0/2876536731 shutdown_connections 2023-06-08T03:49:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7f9652537700 1 -- 172.21.15.43:0/2876536731 wait complete. 2023-06-08T03:49:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.778+0000 7f9652537700 1 Processor -- start 2023-06-08T03:49:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7fb8570ac700 1 -- 172.21.15.43:0/2639987458 shutdown_connections 2023-06-08T03:49:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.776+0000 7fb8570ac700 1 -- 172.21.15.43:0/2639987458 wait complete. 2023-06-08T03:49:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.778+0000 7fb8570ac700 1 Processor -- start 2023-06-08T03:49:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.778+0000 7f9652537700 1 -- start start 2023-06-08T03:49:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.779+0000 7f9652537700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f964c071870 0x7f964c0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.779+0000 7f9652537700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 0x7f964c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.779+0000 7f9652537700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964c0cde50 0x7f964c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.779+0000 7f9652537700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0c8690 con 0x7f964c0cde50 2023-06-08T03:49:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.779+0000 7f9652537700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0b27f0 con 0x7f964c0b07d0 2023-06-08T03:49:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.779+0000 7f9652537700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0b2ad0 con 0x7f964c071870 2023-06-08T03:49:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 0x7f964c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 0x7f964c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40252/0 (socket says 172.21.15.43:40252) 2023-06-08T03:49:08.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 -- 172.21.15.43:0/357097878 learned_addr learned my addr 172.21.15.43:0/357097878 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.778+0000 7fb8570ac700 1 -- start start 2023-06-08T03:49:08.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb8570ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500b0330 0x7fb8500c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb8570ac700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0700 0x7fb8500712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb8570ac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8500cd290 0x7fb850071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb8570ac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c5970 con 0x7fb8500cd290 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb8570ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c25c0 con 0x7fb8500b0330 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb8570ac700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c4e70 con 0x7fb8500b0700 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb854e48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500b0330 0x7fb8500c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb854e48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500b0330 0x7fb8500c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40256/0 (socket says 172.21.15.43:40256) 2023-06-08T03:49:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb854e48700 1 -- 172.21.15.43:0/2752485862 learned_addr learned my addr 172.21.15.43:0/2752485862 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 -- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f964c071870 msgr2=0x7f964c0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f964c071870 0x7f964c0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 -- 172.21.15.43:0/357097878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964c0cde50 msgr2=0x7f964c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964c0cde50 0x7f964c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7f964b7fe700 1 -- 172.21.15.43:0/357097878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c009550 con 0x7f964c0b07d0 2023-06-08T03:49:08.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb84ffff700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0700 0x7fb8500712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb855649700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8500cd290 0x7fb850071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.781+0000 7f964b7fe700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 0x7f964c157fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f964000c450 tx=0x7f964000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb84ffff700 1 -- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500b0330 msgr2=0x7fb8500c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.780+0000 7fb84ffff700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500b0330 0x7fb8500c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.781+0000 7fb84ffff700 1 -- 172.21.15.43:0/2752485862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8500cd290 msgr2=0x7fb850071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.781+0000 7fb84ffff700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8500cd290 0x7fb850071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.781+0000 7fb84ffff700 1 -- 172.21.15.43:0/2752485862 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84800d050 con 0x7fb8500b0700 2023-06-08T03:49:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.781+0000 7fb84ffff700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0700 0x7fb8500712f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b3c0 tx=0x7fb84000b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.782+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011830 con 0x7fb8500b0700 2023-06-08T03:49:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.782+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840011990 con 0x7fb8500b0700 2023-06-08T03:49:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.782+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011d40 con 0x7fb8500b0700 2023-06-08T03:49:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.782+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500c7ee0 con 0x7fb8500b0700 2023-06-08T03:49:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.782+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500c84a0 con 0x7fb8500b0700 2023-06-08T03:49:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.783+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0260003ba0 con 0x7f026c1607a0 2023-06-08T03:49:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.784+0000 7f0269ffb700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f025406aec0 0x7f025406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.784+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0260021070 con 0x7f026c1607a0 2023-06-08T03:49:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.784+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb84001a400 con 0x7fb8500b0700 2023-06-08T03:49:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.784+0000 7f027167a700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f025406aec0 0x7f025406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.785+0000 7fb84d7fa700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb83806ae90 0x7fb83806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.785+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb840089570 con 0x7fb8500b0700 2023-06-08T03:49:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.785+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0260055e80 con 0x7f026c1607a0 2023-06-08T03:49:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9cd1e50700 1 --2- 172.21.15.43:0/2784567839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0cd9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc008870 tx=0x7f9cbc00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e33f3c5c8c2e8379 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f027167a700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f025406aec0 0x7f025406d370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02640015d0 tx=0x7f0264007ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.785+0000 7fb854e48700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb83806ae90 0x7fb83806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9cc3fff700 1 -- 172.21.15.43:0/2784567839 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc010070 con 0x7f9ccc1592c0 2023-06-08T03:49:08.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9cc3fff700 1 -- 172.21.15.43:0/2784567839 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc004030 con 0x7f9ccc1592c0 2023-06-08T03:49:08.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9cc3fff700 1 -- 172.21.15.43:0/2784567839 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0043c0 con 0x7f9ccc1592c0 2023-06-08T03:49:08.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.787+0000 7f9cd38b3700 1 -- 172.21.15.43:0/2784567839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 msgr2=0x7f9ccc0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.787+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/2784567839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0cd9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc008870 tx=0x7f9cbc00d330 comp rx=0 tx=0).stop 2023-06-08T03:49:08.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.787+0000 7f9cd38b3700 1 -- 172.21.15.43:0/2784567839 shutdown_connections 2023-06-08T03:49:08.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.787+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/2784567839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0cd9a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.787+0000 7f9cd38b3700 1 -- 172.21.15.43:0/2784567839 >> 172.21.15.43:0/2784567839 conn(0x7f9ccc0ce5c0 msgr2=0x7f9ccc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400052d0 con 0x7f964c0b07d0 2023-06-08T03:49:08.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640005430 con 0x7f964c0b07d0 2023-06-08T03:49:08.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.786+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400038c0 con 0x7f964c0b07d0 2023-06-08T03:49:08.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.788+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c0b3c30 con 0x7f964c0b07d0 2023-06-08T03:49:08.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.788+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c158510 con 0x7f964c0b07d0 2023-06-08T03:49:08.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.789+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c073fa0 con 0x7f964c0b07d0 2023-06-08T03:49:08.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.791+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9640003a20 con 0x7f964c0b07d0 2023-06-08T03:49:08.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.791+0000 7f9648ff9700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f963006ad00 0x7f963006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.791+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9640088b30 con 0x7f964c0b07d0 2023-06-08T03:49:08.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.792+0000 7f964bfff700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f963006ad00 0x7f963006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.792+0000 7f964bfff700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f963006ad00 0x7f963006d1b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f964c15f5c0 tx=0x7f963c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.795+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9640053950 con 0x7f964c0b07d0 2023-06-08T03:49:08.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.787+0000 7fb854e48700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb83806ae90 0x7fb83806d340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb844009930 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.788+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c0052f0 con 0x7fb8500b0700 2023-06-08T03:49:08.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.793+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb840054410 con 0x7fb8500b0700 2023-06-08T03:49:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.798+0000 7f9cd38b3700 1 -- 172.21.15.43:0/2784567839 shutdown_connections 2023-06-08T03:49:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.800+0000 7f9cd38b3700 1 -- 172.21.15.43:0/2784567839 wait complete. 2023-06-08T03:49:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.804+0000 7f9cd38b3700 1 Processor -- start 2023-06-08T03:49:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.805+0000 7f9cd38b3700 1 -- start start 2023-06-08T03:49:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.806+0000 7f9cd38b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc0b0330 0x7f9ccc14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.806+0000 7f9cd38b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 0x7f9ccc0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.806+0000 7f9cd38b3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.806+0000 7f9cd38b3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc150b10 con 0x7f9ccc0b0700 2023-06-08T03:49:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.806+0000 7f9cd38b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc150db0 con 0x7f9ccc0b0330 2023-06-08T03:49:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.806+0000 7f9cd38b3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc151090 con 0x7f9ccc1592c0 2023-06-08T03:49:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.808+0000 7f9cd1e50700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.810+0000 7f9cd0e4e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 0x7f9ccc0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.810+0000 7f9cd0e4e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 0x7f9ccc0c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58654/0 (socket says 172.21.15.43:58654) 2023-06-08T03:49:08.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.810+0000 7f9cd0e4e700 1 -- 172.21.15.43:0/3528598305 learned_addr learned my addr 172.21.15.43:0/3528598305 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cd0e4e700 1 -- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 msgr2=0x7f9ccc0c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cd0e4e700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cd0e4e700 1 -- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc0b0330 msgr2=0x7f9ccc14ccd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cd0e4e700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc0b0330 0x7f9ccc14ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cd0e4e700 1 -- 172.21.15.43:0/3528598305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc008520 con 0x7f9ccc0b0700 2023-06-08T03:49:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cd0e4e700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 0x7f9ccc0c3860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c7c0 tx=0x7f9cc400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.811+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4003e30 con 0x7f9ccc0b0700 2023-06-08T03:49:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.812+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc4005070 con 0x7f9ccc0b0700 2023-06-08T03:49:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.812+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4005420 con 0x7f9ccc0b0700 2023-06-08T03:49:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.812+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc151370 con 0x7f9ccc0b0700 2023-06-08T03:49:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.812+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc14d210 con 0x7f9ccc0b0700 2023-06-08T03:49:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.816+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9cc4005580 con 0x7f9ccc0b0700 2023-06-08T03:49:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.817+0000 7f9cc1ffb700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9cb006adb0 0x7f9cb006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.817+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9cc4089000 con 0x7f9ccc0b0700 2023-06-08T03:49:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.823+0000 7f9cd164f700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9cb006adb0 0x7f9cb006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.823+0000 7f9cd164f700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9cb006adb0 0x7f9cb006d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80016c0 tx=0x7f9cc8007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.828+0000 7ffaed979700 1 Processor -- start 2023-06-08T03:49:08.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.828+0000 7ffaed979700 1 -- start start 2023-06-08T03:49:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffaed979700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffae80b0330 0x7ffae81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffaed979700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffae80b0700 0x7ffae80c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffaed979700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae806ffe0 con 0x7ffae8069db0 2023-06-08T03:49:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffaed979700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae8156140 con 0x7ffae80b0330 2023-06-08T03:49:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffaed979700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae80c9670 con 0x7ffae80b0700 2023-06-08T03:49:08.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffae6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffae80b0330 0x7ffae81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffae6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffae80b0330 0x7ffae81592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58658/0 (socket says 172.21.15.43:58658) 2023-06-08T03:49:08.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.830+0000 7ffae6ffd700 1 -- 172.21.15.43:0/2554761224 learned_addr learned my addr 172.21.15.43:0/2554761224 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae67fc700 1 --2- 172.21.15.43:0/2554761224 >> v2:172.21.15.135:3300/0 conn(0x7ffae80b0700 0x7ffae80c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae6ffd700 1 -- 172.21.15.43:0/2554761224 >> v2:172.21.15.135:3300/0 conn(0x7ffae80b0700 msgr2=0x7ffae80c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae6ffd700 1 --2- 172.21.15.43:0/2554761224 >> v2:172.21.15.135:3300/0 conn(0x7ffae80b0700 0x7ffae80c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae6ffd700 1 -- 172.21.15.43:0/2554761224 >> v1:172.21.15.135:6789/0 conn(0x7ffae8069db0 legacy=0x7ffae806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae6ffd700 1 -- 172.21.15.43:0/2554761224 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80c90c0 con 0x7ffae80b0330 2023-06-08T03:49:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae6ffd700 1 --2- 172.21.15.43:0/2554761224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0330 0x7ffae81592c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffae80cb010 tx=0x7ffae000d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4944da09e97b76a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae5ffb700 1 -- 172.21.15.43:0/2554761224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0010070 con 0x7ffae80b0330 2023-06-08T03:49:08.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae5ffb700 1 -- 172.21.15.43:0/2554761224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae000dbf0 con 0x7ffae80b0330 2023-06-08T03:49:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.831+0000 7ffae5ffb700 1 -- 172.21.15.43:0/2554761224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0007b30 con 0x7ffae80b0330 2023-06-08T03:49:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.832+0000 7ffaed979700 1 -- 172.21.15.43:0/2554761224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0330 msgr2=0x7ffae81592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.832+0000 7ffaed979700 1 --2- 172.21.15.43:0/2554761224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0330 0x7ffae81592c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffae80cb010 tx=0x7ffae000d650 comp rx=0 tx=0).stop 2023-06-08T03:49:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.834+0000 7ffaed979700 1 -- 172.21.15.43:0/2554761224 shutdown_connections 2023-06-08T03:49:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.834+0000 7ffaed979700 1 --2- 172.21.15.43:0/2554761224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0330 0x7ffae81592c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.834+0000 7ffaed979700 1 --2- 172.21.15.43:0/2554761224 >> v2:172.21.15.135:3300/0 conn(0x7ffae80b0700 0x7ffae80c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.834+0000 7ffaed979700 1 -- 172.21.15.43:0/2554761224 >> 172.21.15.43:0/2554761224 conn(0x7ffae80ce5c0 msgr2=0x7ffae80ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.834+0000 7ffaed979700 1 -- 172.21.15.43:0/2554761224 shutdown_connections 2023-06-08T03:49:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.836+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac0052f0 con 0x7f9ccc0b0700 2023-06-08T03:49:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.834+0000 7ffaed979700 1 -- 172.21.15.43:0/2554761224 wait complete. 2023-06-08T03:49:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.836+0000 7ffaed979700 1 Processor -- start 2023-06-08T03:49:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.837+0000 7ffaed979700 1 -- start start 2023-06-08T03:49:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.838+0000 7ffaed979700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 0x7ffae81e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.838+0000 7ffaed979700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffae80b0330 0x7ffae80c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.838+0000 7ffaed979700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0700 0x7ffae81547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.838+0000 7ffaed979700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80c8460 con 0x7ffae80b0700 2023-06-08T03:49:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.838+0000 7ffaed979700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80c7ea0 con 0x7ffae8069db0 2023-06-08T03:49:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.838+0000 7ffaed979700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80c8180 con 0x7ffae80b0330 2023-06-08T03:49:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 0x7ffae81e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 0x7ffae81e7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40280/0 (socket says 172.21.15.43:40280) 2023-06-08T03:49:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 -- 172.21.15.43:0/983155858 learned_addr learned my addr 172.21.15.43:0/983155858 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 -- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffae80b0330 msgr2=0x7ffae80c74c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T03:49:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffae80b0330 0x7ffae80c74c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 -- 172.21.15.43:0/983155858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0700 msgr2=0x7ffae81547f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T03:49:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0700 0x7ffae81547f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.839+0000 7ffae6ffd700 1 -- 172.21.15.43:0/983155858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae000d050 con 0x7ffae8069db0 2023-06-08T03:49:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7ffae6ffd700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 0x7ffae81e7cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffae0018040 tx=0x7ffae0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0004450 con 0x7ffae8069db0 2023-06-08T03:49:08.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae00045b0 con 0x7ffae8069db0 2023-06-08T03:49:08.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0004940 con 0x7ffae8069db0 2023-06-08T03:49:08.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae80c2200 con 0x7ffae8069db0 2023-06-08T03:49:08.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9cc4053dc0 con 0x7f9ccc0b0700 2023-06-08T03:49:08.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.845+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81e81f0 con 0x7ffae8069db0 2023-06-08T03:49:08.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.848+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffae0008030 con 0x7ffae8069db0 2023-06-08T03:49:08.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.849+0000 7ffacffff700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffad406ace0 0x7ffad406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.849+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffae008b490 con 0x7ffae8069db0 2023-06-08T03:49:08.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.850+0000 7ffae67fc700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffad406ace0 0x7ffad406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.850+0000 7ffae67fc700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffad406ace0 0x7ffad406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffae80ad390 tx=0x7ffad8009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.854+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac80052f0 con 0x7ffae8069db0 2023-06-08T03:49:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.858+0000 7f4de0e50700 1 Processor -- start 2023-06-08T03:49:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.858+0000 7f4de0e50700 1 -- start start 2023-06-08T03:49:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4de0e50700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4ddc0b0330 0x7f4ddc1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4de0e50700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4ddc0cd290 0x7f4ddc0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4de0e50700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc06ffe0 con 0x7f4ddc0b0700 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4de0e50700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc156140 con 0x7f4ddc0cd290 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4de0e50700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c9670 con 0x7f4ddc0b0330 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4dda59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4ddc0b0330 0x7f4ddc1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4dda59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4ddc0b0330 0x7f4ddc1592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40284/0 (socket says 172.21.15.43:40284) 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.860+0000 7f4dda59c700 1 -- 172.21.15.43:0/145204202 learned_addr learned my addr 172.21.15.43:0/145204202 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.861+0000 7f4ddad9d700 1 --2- 172.21.15.43:0/145204202 >> v2:172.21.15.43:3300/0 conn(0x7f4ddc0cd290 0x7f4ddc0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.861+0000 7f4ddad9d700 1 -- 172.21.15.43:0/145204202 >> v2:172.21.15.135:3300/0 conn(0x7f4ddc0b0330 msgr2=0x7f4ddc1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.861+0000 7f4ddad9d700 1 --2- 172.21.15.43:0/145204202 >> v2:172.21.15.135:3300/0 conn(0x7f4ddc0b0330 0x7f4ddc1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.861+0000 7f4ddad9d700 1 -- 172.21.15.43:0/145204202 >> v1:172.21.15.43:6789/0 conn(0x7f4ddc0b0700 legacy=0x7f4ddc0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.861+0000 7f4ddad9d700 1 -- 172.21.15.43:0/145204202 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0c9390 con 0x7f4ddc0cd290 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.861+0000 7f4ddad9d700 1 --2- 172.21.15.43:0/145204202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0cd290 0x7f4ddc0cd710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc06d530 tx=0x7f4dd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ba365a07a7d2e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.862+0000 7f4dd959a700 1 -- 172.21.15.43:0/145204202 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400e070 con 0x7f4ddc0cd290 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.862+0000 7f4dd959a700 1 -- 172.21.15.43:0/145204202 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd400bae0 con 0x7f4ddc0cd290 2023-06-08T03:49:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.862+0000 7f4dd959a700 1 -- 172.21.15.43:0/145204202 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400be70 con 0x7f4ddc0cd290 2023-06-08T03:49:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.862+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffae0056240 con 0x7ffae8069db0 2023-06-08T03:49:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 -- 172.21.15.43:0/145204202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0cd290 msgr2=0x7f4ddc0cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 --2- 172.21.15.43:0/145204202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0cd290 0x7f4ddc0cd710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc06d530 tx=0x7f4dd400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 -- 172.21.15.43:0/145204202 shutdown_connections 2023-06-08T03:49:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 --2- 172.21.15.43:0/145204202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0cd290 0x7f4ddc0cd710 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 --2- 172.21.15.43:0/145204202 >> v2:172.21.15.135:3300/0 conn(0x7f4ddc0b0330 0x7f4ddc1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 -- 172.21.15.43:0/145204202 >> 172.21.15.43:0/145204202 conn(0x7f4ddc0ce5c0 msgr2=0x7f4ddc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 -- 172.21.15.43:0/145204202 shutdown_connections 2023-06-08T03:49:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.863+0000 7f4de0e50700 1 -- 172.21.15.43:0/145204202 wait complete. 2023-06-08T03:49:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.865+0000 7f4de0e50700 1 Processor -- start 2023-06-08T03:49:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.865+0000 7f4de0e50700 1 -- start start 2023-06-08T03:49:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4de0e50700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 0x7f4ddc156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4de0e50700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ddc0b0700 0x7f4ddc1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4de0e50700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ddc0cd290 0x7f4ddc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4de0e50700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc158270 con 0x7f4ddc0b0330 2023-06-08T03:49:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4de0e50700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc152f50 con 0x7f4ddc0cd290 2023-06-08T03:49:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4de0e50700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1575f0 con 0x7f4ddc0b0700 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 0x7f4ddc156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 0x7f4ddc156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58674/0 (socket says 172.21.15.43:58674) 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 -- 172.21.15.43:0/2845570552 learned_addr learned my addr 172.21.15.43:0/2845570552 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 -- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ddc0b0700 msgr2=0x7f4ddc1f6840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ddc0b0700 0x7f4ddc1f6840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 -- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ddc0cd290 msgr2=0x7f4ddc152a10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T03:49:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ddc0cd290 0x7f4ddc152a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.867+0000 7f4dda59c700 1 -- 172.21.15.43:0/2845570552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4009a70 con 0x7f4ddc0b0330 2023-06-08T03:49:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.868+0000 7f4dda59c700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 0x7f4ddc156f60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000b690 tx=0x7f4dd000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.872+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0010040 con 0x7f4ddc0b0330 2023-06-08T03:49:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.872+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000e610 con 0x7f4ddc0b0330 2023-06-08T03:49:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.872+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000e9c0 con 0x7f4ddc0b0330 2023-06-08T03:49:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.872+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc1578d0 con 0x7f4ddc0b0330 2023-06-08T03:49:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.872+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc157e90 con 0x7f4ddc0b0330 2023-06-08T03:49:08.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.874+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4dd000eb20 con 0x7f4ddc0b0330 2023-06-08T03:49:08.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.875+0000 7f4dcaffd700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4dc406ae90 0x7f4dc406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.875+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4dd0089600 con 0x7f4ddc0b0330 2023-06-08T03:49:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.879+0000 7f4dd9d9b700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4dc406ae90 0x7f4dc406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.879+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00052f0 con 0x7f4ddc0b0330 2023-06-08T03:49:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.889+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4dd0054430 con 0x7f4ddc0b0330 2023-06-08T03:49:08.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.901+0000 7f4dd9d9b700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4dc406ae90 0x7f4dc406d340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc1593a0 tx=0x7f4dcc006be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.906+0000 7fce16d25700 1 Processor -- start 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.907+0000 7fce16d25700 1 -- start start 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.908+0000 7fce16d25700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce100cf0a0 0x7fce101592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.908+0000 7fce16d25700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1006ffe0 con 0x7fce100b02a0 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.908+0000 7fce16d25700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce100c9670 con 0x7fce100b0670 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.908+0000 7fce16d25700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce10156140 con 0x7fce100cf0a0 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.909+0000 7fce14ac1700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fce100b02a0 0x7fce100c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53586/0 (socket says 172.21.15.43:53586) 2023-06-08T03:49:08.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.909+0000 7fce14ac1700 1 -- 172.21.15.43:0/2725979983 learned_addr learned my addr 172.21.15.43:0/2725979983 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:08.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.910+0000 7fce0ffff700 1 --2- 172.21.15.43:0/2725979983 >> v2:172.21.15.135:3300/0 conn(0x7fce100cf0a0 0x7fce101592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.910+0000 7fce0ffff700 1 -- 172.21.15.43:0/2725979983 >> v1:172.21.15.135:6789/0 conn(0x7fce100b0670 legacy=0x7fce100cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.910+0000 7fce0ffff700 1 -- 172.21.15.43:0/2725979983 >> v1:172.21.15.43:6789/0 conn(0x7fce100b02a0 legacy=0x7fce100c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.910+0000 7fce0ffff700 1 -- 172.21.15.43:0/2725979983 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100c9390 con 0x7fce100cf0a0 2023-06-08T03:49:08.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.911+0000 7fce0ffff700 1 --2- 172.21.15.43:0/2725979983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce101592c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce00009840 tx=0x7fce00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b9b80660da8b40c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.911+0000 7fce0f7fe700 1 -- 172.21.15.43:0/2725979983 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00004230 con 0x7fce100cf0a0 2023-06-08T03:49:08.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.911+0000 7fce0f7fe700 1 -- 172.21.15.43:0/2725979983 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce00004390 con 0x7fce100cf0a0 2023-06-08T03:49:08.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.911+0000 7fce0f7fe700 1 -- 172.21.15.43:0/2725979983 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce000036a0 con 0x7fce100cf0a0 2023-06-08T03:49:08.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.912+0000 7fce16d25700 1 -- 172.21.15.43:0/2725979983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 msgr2=0x7fce101592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.912+0000 7fce16d25700 1 --2- 172.21.15.43:0/2725979983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce101592c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce00009840 tx=0x7fce00009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:08.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.913+0000 7fce16d25700 1 -- 172.21.15.43:0/2725979983 shutdown_connections 2023-06-08T03:49:08.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.913+0000 7fce16d25700 1 --2- 172.21.15.43:0/2725979983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce101592c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.913+0000 7fce16d25700 1 -- 172.21.15.43:0/2725979983 >> 172.21.15.43:0/2725979983 conn(0x7fce100ce5c0 msgr2=0x7fce100ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:08.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.913+0000 7fce16d25700 1 -- 172.21.15.43:0/2725979983 shutdown_connections 2023-06-08T03:49:08.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.913+0000 7fce16d25700 1 -- 172.21.15.43:0/2725979983 wait complete. 2023-06-08T03:49:08.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.915+0000 7fce16d25700 1 Processor -- start 2023-06-08T03:49:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.915+0000 7fce16d25700 1 -- start start 2023-06-08T03:49:08.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce16d25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 0x7fce10140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce16d25700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce100b0670 0x7fce101525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce16d25700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce10152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce16d25700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce10148db0 con 0x7fce100b02a0 2023-06-08T03:49:08.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce16d25700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1014ace0 con 0x7fce100cf0a0 2023-06-08T03:49:08.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce16d25700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1014afc0 con 0x7fce100b0670 2023-06-08T03:49:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce14ac1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 0x7fce10140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce14ac1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 0x7fce10140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58688/0 (socket says 172.21.15.43:58688) 2023-06-08T03:49:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.917+0000 7fce14ac1700 1 -- 172.21.15.43:0/2185808430 learned_addr learned my addr 172.21.15.43:0/2185808430 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce0ffff700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce100b0670 0x7fce101525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce152c2700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce10152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:08.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce14ac1700 1 -- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce100b0670 msgr2=0x7fce101525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce14ac1700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce100b0670 0x7fce101525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce14ac1700 1 -- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 msgr2=0x7fce10152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:08.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce14ac1700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce10152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:08.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.918+0000 7fce14ac1700 1 -- 172.21.15.43:0/2185808430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000094a0 con 0x7fce100b02a0 2023-06-08T03:49:08.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.919+0000 7fce14ac1700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 0x7fce10140a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce08001fa0 tx=0x7fce0800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.930+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800ad80 con 0x7fce100b02a0 2023-06-08T03:49:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.930+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce080020f0 con 0x7fce100b02a0 2023-06-08T03:49:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.930+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08007310 con 0x7fce100b02a0 2023-06-08T03:49:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.930+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce10148760 con 0x7fce100b02a0 2023-06-08T03:49:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.930+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce10153510 con 0x7fce100b02a0 2023-06-08T03:49:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.931+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce10073fa0 con 0x7fce100b02a0 2023-06-08T03:49:08.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.943+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce08007470 con 0x7fce100b02a0 2023-06-08T03:49:08.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.944+0000 7fce0d7fa700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdfc06adb0 0x7fcdfc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:08.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.944+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce080897b0 con 0x7fce100b02a0 2023-06-08T03:49:08.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.944+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce0808bd40 con 0x7fce100b02a0 2023-06-08T03:49:08.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.955+0000 7fce0ffff700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdfc06adb0 0x7fcdfc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:08.996+0000 7fce0ffff700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdfc06adb0 0x7fcdfc06d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce100cf4c0 tx=0x7fce00008000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.145+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffa8c0c5ce0 con 0x7ffa8c0b0700 2023-06-08T03:49:09.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.146+0000 7ffa897fa700 1 -- 172.21.15.43:0/2435880197 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa8c0c5ce0 con 0x7ffa8c0b0700 2023-06-08T03:49:09.153 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:09.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.149+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffa7806ade0 msgr2=0x7ffa7806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.149+0000 7ffa9311b700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffa7806ade0 0x7ffa7806d290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c000c00 tx=0x7ffa7c012000 comp rx=0 tx=0).stop 2023-06-08T03:49:09.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.149+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 msgr2=0x7ffa8c0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.149+0000 7ffa9311b700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 0x7ffa8c0c3fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ba20 tx=0x7ffa8400bd30 comp rx=0 tx=0).stop 2023-06-08T03:49:09.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 shutdown_connections 2023-06-08T03:49:09.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffa7806ade0 0x7ffa7806d290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa8c0cd290 0x7ffa8c0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa8c0b0330 0x7ffa8c152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 --2- 172.21.15.43:0/2435880197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8c0b0700 0x7ffa8c0c3fe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 >> 172.21.15.43:0/2435880197 conn(0x7ffa8c0ce5c0 msgr2=0x7ffa8c0ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 shutdown_connections 2023-06-08T03:49:09.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.150+0000 7ffa9311b700 1 -- 172.21.15.43:0/2435880197 wait complete. 2023-06-08T03:49:09.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.167+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f026c0cb9d0 con 0x7f026c1607a0 2023-06-08T03:49:09.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.168+0000 7f0269ffb700 1 -- 172.21.15.43:0/1031578898 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0260015090 con 0x7f026c1607a0 2023-06-08T03:49:09.175 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:09.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-06-08T03:49:09.176 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f025406aec0 msgr2=0x7f025406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f025406aec0 0x7f025406d370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02640015d0 tx=0x7f0264007ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 msgr2=0x7f026c0c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 0x7f026c0c6880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0260009b90 tx=0x7f0260004750 comp rx=0 tx=0).stop 2023-06-08T03:49:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 shutdown_connections 2023-06-08T03:49:09.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f025406aec0 0x7f025406d370 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02640015d0 tx=0x7f0264007ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c1607a0 0x7f026c0c6880 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f026c069db0 0x7f026c155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 --2- 172.21.15.43:0/1031578898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f026c06a250 0x7f026c071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.172+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 >> 172.21.15.43:0/1031578898 conn(0x7f026c0cf250 msgr2=0x7f026c15e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.174+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 shutdown_connections 2023-06-08T03:49:09.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.177+0000 7f02738de700 1 -- 172.21.15.43:0/1031578898 wait complete. 2023-06-08T03:49:09.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-06-08T03:49:09.198 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.195+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb82c005870 con 0x7fb8500b0700 2023-06-08T03:49:09.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.195+0000 7fb84d7fa700 1 -- 172.21.15.43:0/2752485862 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb840015070 con 0x7fb8500b0700 2023-06-08T03:49:09.200 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:09.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.199+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb83806ae90 msgr2=0x7fb83806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.199+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb83806ae90 0x7fb83806d340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb844009930 tx=0x7fb844008040 comp rx=0 tx=0).stop 2023-06-08T03:49:09.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.199+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0700 msgr2=0x7fb8500712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.199+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0700 0x7fb8500712f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b3c0 tx=0x7fb84000b6d0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.200+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 shutdown_connections 2023-06-08T03:49:09.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.200+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb83806ae90 0x7fb83806d340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.200+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8500cd290 0x7fb850071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.200+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8500b0330 0x7fb8500c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.200+0000 7fb8570ac700 1 --2- 172.21.15.43:0/2752485862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8500b0700 0x7fb8500712f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.200+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 >> 172.21.15.43:0/2752485862 conn(0x7fb8500ce5c0 msgr2=0x7fb8500ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.203+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 shutdown_connections 2023-06-08T03:49:09.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.203+0000 7fb8570ac700 1 -- 172.21.15.43:0/2752485862 wait complete. 2023-06-08T03:49:09.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.205+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f964c06abf0 con 0x7f964c0b07d0 2023-06-08T03:49:09.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.206+0000 7f9648ff9700 1 -- 172.21.15.43:0/357097878 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f964c06abf0 con 0x7f964c0b07d0 2023-06-08T03:49:09.210 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:09.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.210+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f963006ad00 msgr2=0x7f963006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.210+0000 7f9652537700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f963006ad00 0x7f963006d1b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f964c15f5c0 tx=0x7f963c010000 comp rx=0 tx=0).stop 2023-06-08T03:49:09.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.210+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 msgr2=0x7f964c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.210+0000 7f9652537700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 0x7f964c157fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f964000c450 tx=0x7f964000c810 comp rx=0 tx=0).stop 2023-06-08T03:49:09.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 shutdown_connections 2023-06-08T03:49:09.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f963006ad00 0x7f963006d1b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964c0cde50 0x7f964c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f964c071870 0x7f964c0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 --2- 172.21.15.43:0/357097878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f964c0b07d0 0x7f964c157fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 >> 172.21.15.43:0/357097878 conn(0x7f964c0ce5c0 msgr2=0x7f964c1594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 shutdown_connections 2023-06-08T03:49:09.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.211+0000 7f9652537700 1 -- 172.21.15.43:0/357097878 wait complete. 2023-06-08T03:49:09.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-06-08T03:49:09.227 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-06-08T03:49:09.228 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.239+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffac80055a0 con 0x7ffae8069db0 2023-06-08T03:49:09.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.240+0000 7ffacffff700 1 -- 172.21.15.43:0/983155858 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffae000be60 con 0x7ffae8069db0 2023-06-08T03:49:09.244 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-06-08T03:49:09.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.241+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4dc00055a0 con 0x7f4ddc0b0330 2023-06-08T03:49:09.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7f4dcaffd700 1 -- 172.21.15.43:0/2845570552 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4dd001a070 con 0x7f4ddc0b0330 2023-06-08T03:49:09.246 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:09.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffad406ace0 msgr2=0x7ffad406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffad406ace0 0x7ffad406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffae80ad390 tx=0x7ffad8009210 comp rx=0 tx=0).stop 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 msgr2=0x7ffae81e7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 0x7ffae81e7cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffae0018040 tx=0x7ffae0004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 shutdown_connections 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ffad406ace0 0x7ffad406d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffae80b0700 0x7ffae81547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffae8069db0 0x7ffae81e7cb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 --2- 172.21.15.43:0/983155858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffae80b0330 0x7ffae80c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 >> 172.21.15.43:0/983155858 conn(0x7ffae80ce5c0 msgr2=0x7ffae80ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 shutdown_connections 2023-06-08T03:49:09.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.242+0000 7ffaed979700 1 -- 172.21.15.43:0/983155858 wait complete. 2023-06-08T03:49:09.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.244+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4dc406ae90 msgr2=0x7f4dc406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.244+0000 7f4de0e50700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4dc406ae90 0x7f4dc406d340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc1593a0 tx=0x7f4dcc006be0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.244+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 msgr2=0x7f4ddc156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.244+0000 7f4de0e50700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 0x7f4ddc156f60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000b690 tx=0x7f4dd000ba50 comp rx=0 tx=0).stop 2023-06-08T03:49:09.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 shutdown_connections 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4dc406ae90 0x7f4dc406d340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc0b0330 0x7f4ddc156f60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ddc0cd290 0x7f4ddc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 --2- 172.21.15.43:0/2845570552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ddc0b0700 0x7f4ddc1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 >> 172.21.15.43:0/2845570552 conn(0x7f4ddc0ce5c0 msgr2=0x7f4ddc155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 shutdown_connections 2023-06-08T03:49:09.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.245+0000 7f4de0e50700 1 -- 172.21.15.43:0/2845570552 wait complete. 2023-06-08T03:49:09.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-06-08T03:49:09.261 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.257+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9cac0055a0 con 0x7f9ccc0b0700 2023-06-08T03:49:09.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.258+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/3528598305 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9cc4017070 con 0x7f9ccc0b0700 2023-06-08T03:49:09.263 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2023-06-08T03:49:09.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-06-08T03:49:09.265 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9cb006adb0 msgr2=0x7f9cb006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9cb006adb0 0x7f9cb006d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80016c0 tx=0x7f9cc8007a30 comp rx=0 tx=0).stop 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 msgr2=0x7f9ccc0c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 0x7f9ccc0c3860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c7c0 tx=0x7f9cc400cb80 comp rx=0 tx=0).stop 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 shutdown_connections 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f9cb006adb0 0x7f9cb006d260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc1592c0 0x7f9ccc0c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc0b0330 0x7f9ccc14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 --2- 172.21.15.43:0/3528598305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0b0700 0x7f9ccc0c3860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 >> 172.21.15.43:0/3528598305 conn(0x7f9ccc0ce5c0 msgr2=0x7f9ccc06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 shutdown_connections 2023-06-08T03:49:09.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.260+0000 7f9cd38b3700 1 -- 172.21.15.43:0/3528598305 wait complete. 2023-06-08T03:49:09.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-06-08T03:49:09.276 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.306+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce10149140 con 0x7fce100b02a0 2023-06-08T03:49:09.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.306+0000 7fce0d7fa700 1 -- 172.21.15.43:0/2185808430 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce08018020 con 0x7fce100b02a0 2023-06-08T03:49:09.311 INFO:teuthology.orchestra.run.smithi043.stdout:55834574857 2023-06-08T03:49:09.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdfc06adb0 msgr2=0x7fcdfc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdfc06adb0 0x7fcdfc06d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce100cf4c0 tx=0x7fce00008000 comp rx=0 tx=0).stop 2023-06-08T03:49:09.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 msgr2=0x7fce10140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 0x7fce10140a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce08001fa0 tx=0x7fce0800a340 comp rx=0 tx=0).stop 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 shutdown_connections 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdfc06adb0 0x7fcdfc06d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce100b02a0 0x7fce10140a30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce100cf0a0 0x7fce10152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 --2- 172.21.15.43:0/2185808430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce100b0670 0x7fce101525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 >> 172.21.15.43:0/2185808430 conn(0x7fce100ce5c0 msgr2=0x7fce100cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 shutdown_connections 2023-06-08T03:49:09.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.309+0000 7fce16d25700 1 -- 172.21.15.43:0/2185808430 wait complete. 2023-06-08T03:49:09.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-06-08T03:49:09.325 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:09.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-08T03:49:09.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:49:09.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.485+0000 7fc36c7bc700 1 Processor -- start 2023-06-08T03:49:09.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.485+0000 7fc36c7bc700 1 -- start start 2023-06-08T03:49:09.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.485+0000 7fc36c7bc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc3641589c0 0x7fc36415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36c7bc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 0x7fc36406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36c7bc700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36415d2a0 con 0x7fc364159650 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36c7bc700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640cce80 con 0x7fc3641589c0 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36c7bc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640cd160 con 0x7fc3640710b0 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36a558700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc3641589c0 0x7fc36415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 0x7fc36406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 0x7fc36406cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52154/0 (socket says 172.21.15.43:52154) 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 -- 172.21.15.43:0/2986595634 learned_addr learned my addr 172.21.15.43:0/2986595634 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:09.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36a558700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc3641589c0 0x7fc36415cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40312/0 (socket says 172.21.15.43:40312) 2023-06-08T03:49:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 -- 172.21.15.43:0/2986595634 >> v2:172.21.15.135:3300/0 conn(0x7fc3641589c0 msgr2=0x7fc36415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 --2- 172.21.15.43:0/2986595634 >> v2:172.21.15.135:3300/0 conn(0x7fc3641589c0 0x7fc36415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 -- 172.21.15.43:0/2986595634 >> v1:172.21.15.135:6789/0 conn(0x7fc364159650 legacy=0x7fc3640709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 -- 172.21.15.43:0/2986595634 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640cd440 con 0x7fc3640710b0 2023-06-08T03:49:09.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.486+0000 7fc36ad59700 1 --2- 172.21.15.43:0/2986595634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 0x7fc36406cc30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00d150 tx=0x7fc35c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30cd1a3e0fb80547 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc369556700 1 -- 172.21.15.43:0/2986595634 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c010070 con 0x7fc3640710b0 2023-06-08T03:49:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc369556700 1 -- 172.21.15.43:0/2986595634 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c00db00 con 0x7fc3640710b0 2023-06-08T03:49:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc369556700 1 -- 172.21.15.43:0/2986595634 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00de90 con 0x7fc3640710b0 2023-06-08T03:49:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 -- 172.21.15.43:0/2986595634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 msgr2=0x7fc36406cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/2986595634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 0x7fc36406cc30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00d150 tx=0x7fc35c00d460 comp rx=0 tx=0).stop 2023-06-08T03:49:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 -- 172.21.15.43:0/2986595634 shutdown_connections 2023-06-08T03:49:09.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/2986595634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3640710b0 0x7fc36406cc30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/2986595634 >> v2:172.21.15.135:3300/0 conn(0x7fc3641589c0 0x7fc36415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 -- 172.21.15.43:0/2986595634 >> 172.21.15.43:0/2986595634 conn(0x7fc3640ceed0 msgr2=0x7fc3640cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 -- 172.21.15.43:0/2986595634 shutdown_connections 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.487+0000 7fc36c7bc700 1 -- 172.21.15.43:0/2986595634 wait complete. 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 Processor -- start 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 -- start start 2023-06-08T03:49:09.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3640710b0 0x7fc364149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 0x7fc3640c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc364159650 0x7fc3640af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415aba0 con 0x7fc3641589c0 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364159f90 con 0x7fc3640710b0 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc36c7bc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415a270 con 0x7fc364159650 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc369d57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 0x7fc3640c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc369d57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 0x7fc3640c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58700/0 (socket says 172.21.15.43:58700) 2023-06-08T03:49:09.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.489+0000 7fc369d57700 1 -- 172.21.15.43:0/3144035025 learned_addr learned my addr 172.21.15.43:0/3144035025 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc36ad59700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc364159650 0x7fc3640af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc36a558700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3640710b0 0x7fc364149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc369d57700 1 -- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc364159650 msgr2=0x7fc3640af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc369d57700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc364159650 0x7fc3640af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc369d57700 1 -- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3640710b0 msgr2=0x7fc364149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc369d57700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3640710b0 0x7fc364149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc369d57700 1 -- 172.21.15.43:0/3144035025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c00bd40 con 0x7fc3641589c0 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc36ad59700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc364159650 0x7fc3640af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc36a558700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3640710b0 0x7fc364149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc369d57700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 0x7fc3640c3360 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c450 tx=0x7fc36000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600052d0 con 0x7fc3641589c0 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36415a550 con 0x7fc3641589c0 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360005430 con 0x7fc3641589c0 2023-06-08T03:49:09.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600038c0 con 0x7fc3641589c0 2023-06-08T03:49:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.490+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364149850 con 0x7fc3641589c0 2023-06-08T03:49:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.491+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36415ace0 con 0x7fc3641589c0 2023-06-08T03:49:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.492+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc360003a20 con 0x7fc3641589c0 2023-06-08T03:49:09.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.492+0000 7fc356ffd700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc34806ace0 0x7fc34806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.492+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3600889e0 con 0x7fc3641589c0 2023-06-08T03:49:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.492+0000 7fc36a558700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc34806ace0 0x7fc34806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.493+0000 7fc36a558700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc34806ace0 0x7fc34806d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc358009c30 tx=0x7fc358008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.496+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc36415ace0 con 0x7fc3641589c0 2023-06-08T03:49:09.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.688+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3640ae650 con 0x7fc34806ace0 2023-06-08T03:49:09.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.698+0000 7fc356ffd700 1 -- 172.21.15.43:0/3144035025 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367532 (secure 0 0 0) 0x7fc358004030 con 0x7fc34806ace0 2023-06-08T03:49:09.706 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:09.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc34806ace0 msgr2=0x7fc34806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc34806ace0 0x7fc34806d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc358009c30 tx=0x7fc358008040 comp rx=0 tx=0).stop 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 msgr2=0x7fc3640c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 0x7fc3640c3360 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c450 tx=0x7fc36000c810 comp rx=0 tx=0).stop 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 shutdown_connections 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc34806ace0 0x7fc34806d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc364159650 0x7fc3640af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3640710b0 0x7fc364149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 --2- 172.21.15.43:0/3144035025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3641589c0 0x7fc3640c3360 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 >> 172.21.15.43:0/3144035025 conn(0x7fc3640ceed0 msgr2=0x7fc364154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 shutdown_connections 2023-06-08T03:49:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.702+0000 7fc36c7bc700 1 -- 172.21.15.43:0/3144035025 wait complete. 2023-06-08T03:49:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:49:09.718 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-06-08T03:49:09.568187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":3383296,"data_stored":2065128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004002"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535614+0000","last_change":"2023-06-08T03:48:46.695933+0000","last_active":"2023-06-08T03:48:51.535614+0000","last_peered":"2023-06-08T03:48:51.535614+0000","last_clean":"2023-06-08T03:48:51.535614+0000","last_became_active":"2023-06-08T03:48:46.695656+0000","last_became_peered":"2023-06-08T03:48:46.695656+0000","last_unstale":"2023-06-08T03:48:51.535614+0000","last_undegraded":"2023-06-08T03:48:51.535614+0000","last_fullsized":"2023-06-08T03:48:51.535614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:30:50.250635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537474+0000","last_change":"2023-06-08T03:48:46.714866+0000","last_active":"2023-06-08T03:48:51.537474+0000","last_peered":"2023-06-08T03:48:51.537474+0000","last_clean":"2023-06-08T03:48:51.537474+0000","last_became_active":"2023-06-08T03:48:46.714589+0000","last_became_peered":"2023-06-08T03:48:46.714589+0000","last_unstale":"2023-06-08T03:48:51.537474+0000","last_undegraded":"2023-06-08T03:48:51.537474+0000","last_fullsized":"2023-06-08T03:48:51.537474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152613+0000","last_change":"2023-06-08T03:48:46.706256+0000","last_active":"2023-06-08T03:48:51.152613+0000","last_peered":"2023-06-08T03:48:51.152613+0000","last_clean":"2023-06-08T03:48:51.152613+0000","last_became_active":"2023-06-08T03:48:46.705978+0000","last_became_peered":"2023-06-08T03:48:46.705978+0000","last_unstale":"2023-06-08T03:48:51.152613+0000","last_undegraded":"2023-06-08T03:48:51.152613+0000","last_fullsized":"2023-06-08T03:48:51.152613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:22:14.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151950+0000","last_change":"2023-06-08T03:48:46.707135+0000","last_active":"2023-06-08T03:48:51.151950+0000","last_peered":"2023-06-08T03:48:51.151950+0000","last_clean":"2023-06-08T03:48:51.151950+0000","last_became_active":"2023-06-08T03:48:46.706761+0000","last_became_peered":"2023-06-08T03:48:46.706761+0000","last_unstale":"2023-06-08T03:48:51.151950+0000","last_undegraded":"2023-06-08T03:48:51.151950+0000","last_fullsized":"2023-06-08T03:48:51.151950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:56.493538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294344+0000","last_change":"2023-06-08T03:48:46.699911+0000","last_active":"2023-06-08T03:48:51.294344+0000","last_peered":"2023-06-08T03:48:51.294344+0000","last_clean":"2023-06-08T03:48:51.294344+0000","last_became_active":"2023-06-08T03:48:46.699664+0000","last_became_peered":"2023-06-08T03:48:46.699664+0000","last_unstale":"2023-06-08T03:48:51.294344+0000","last_undegraded":"2023-06-08T03:48:51.294344+0000","last_fullsized":"2023-06-08T03:48:51.294344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152397+0000","last_change":"2023-06-08T03:48:46.705516+0000","last_active":"2023-06-08T03:48:51.152397+0000","last_peered":"2023-06-08T03:48:51.152397+0000","last_clean":"2023-06-08T03:48:51.152397+0000","last_became_active":"2023-06-08T03:48:46.705065+0000","last_became_peered":"2023-06-08T03:48:46.705065+0000","last_unstale":"2023-06-08T03:48:51.152397+0000","last_undegraded":"2023-06-08T03:48:51.152397+0000","last_fullsized":"2023-06-08T03:48:51.152397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:14:12.765404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536130+0000","last_change":"2023-06-08T03:48:46.715167+0000","last_active":"2023-06-08T03:48:51.536130+0000","last_peered":"2023-06-08T03:48:51.536130+0000","last_clean":"2023-06-08T03:48:51.536130+0000","last_became_active":"2023-06-08T03:48:46.714516+0000","last_became_peered":"2023-06-08T03:48:46.714516+0000","last_unstale":"2023-06-08T03:48:51.536130+0000","last_undegraded":"2023-06-08T03:48:51.536130+0000","last_fullsized":"2023-06-08T03:48:51.536130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535554+0000","last_change":"2023-06-08T03:48:46.711469+0000","last_active":"2023-06-08T03:48:51.535554+0000","last_peered":"2023-06-08T03:48:51.535554+0000","last_clean":"2023-06-08T03:48:51.535554+0000","last_became_active":"2023-06-08T03:48:46.711192+0000","last_became_peered":"2023-06-08T03:48:46.711192+0000","last_unstale":"2023-06-08T03:48:51.535554+0000","last_undegraded":"2023-06-08T03:48:51.535554+0000","last_fullsized":"2023-06-08T03:48:51.535554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294108+0000","last_change":"2023-06-08T03:48:46.699402+0000","last_active":"2023-06-08T03:48:51.294108+0000","last_peered":"2023-06-08T03:48:51.294108+0000","last_clean":"2023-06-08T03:48:51.294108+0000","last_became_active":"2023-06-08T03:48:46.699147+0000","last_became_peered":"2023-06-08T03:48:46.699147+0000","last_unstale":"2023-06-08T03:48:51.294108+0000","last_undegraded":"2023-06-08T03:48:51.294108+0000","last_fullsized":"2023-06-08T03:48:51.294108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537669+0000","last_change":"2023-06-08T03:48:46.704142+0000","last_active":"2023-06-08T03:48:51.537669+0000","last_peered":"2023-06-08T03:48:51.537669+0000","last_clean":"2023-06-08T03:48:51.537669+0000","last_became_active":"2023-06-08T03:48:46.703834+0000","last_became_peered":"2023-06-08T03:48:46.703834+0000","last_unstale":"2023-06-08T03:48:51.537669+0000","last_undegraded":"2023-06-08T03:48:51.537669+0000","last_fullsized":"2023-06-08T03:48:51.537669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152529+0000","last_change":"2023-06-08T03:48:46.714056+0000","last_active":"2023-06-08T03:48:51.152529+0000","last_peered":"2023-06-08T03:48:51.152529+0000","last_clean":"2023-06-08T03:48:51.152529+0000","last_became_active":"2023-06-08T03:48:46.713591+0000","last_became_peered":"2023-06-08T03:48:46.713591+0000","last_unstale":"2023-06-08T03:48:51.152529+0000","last_undegraded":"2023-06-08T03:48:51.152529+0000","last_fullsized":"2023-06-08T03:48:51.152529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:27:27.515952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535329+0000","last_change":"2023-06-08T03:48:46.709172+0000","last_active":"2023-06-08T03:48:51.535329+0000","last_peered":"2023-06-08T03:48:51.535329+0000","last_clean":"2023-06-08T03:48:51.535329+0000","last_became_active":"2023-06-08T03:48:46.708965+0000","last_became_peered":"2023-06-08T03:48:46.708965+0000","last_unstale":"2023-06-08T03:48:51.535329+0000","last_undegraded":"2023-06-08T03:48:51.535329+0000","last_fullsized":"2023-06-08T03:48:51.535329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:08:38.733800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535191+0000","last_change":"2023-06-08T03:48:46.700006+0000","last_active":"2023-06-08T03:48:51.535191+0000","last_peered":"2023-06-08T03:48:51.535191+0000","last_clean":"2023-06-08T03:48:51.535191+0000","last_became_active":"2023-06-08T03:48:46.699757+0000","last_became_peered":"2023-06-08T03:48:46.699757+0000","last_unstale":"2023-06-08T03:48:51.535191+0000","last_undegraded":"2023-06-08T03:48:51.535191+0000","last_fullsized":"2023-06-08T03:48:51.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:03:26.492541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536448+0000","last_change":"2023-06-08T03:48:46.704941+0000","last_active":"2023-06-08T03:48:51.536448+0000","last_peered":"2023-06-08T03:48:51.536448+0000","last_clean":"2023-06-08T03:48:51.536448+0000","last_became_active":"2023-06-08T03:48:46.704597+0000","last_became_peered":"2023-06-08T03:48:46.704597+0000","last_unstale":"2023-06-08T03:48:51.536448+0000","last_undegraded":"2023-06-08T03:48:51.536448+0000","last_fullsized":"2023-06-08T03:48:51.536448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536330+0000","last_change":"2023-06-08T03:48:46.715344+0000","last_active":"2023-06-08T03:48:51.536330+0000","last_peered":"2023-06-08T03:48:51.536330+0000","last_clean":"2023-06-08T03:48:51.536330+0000","last_became_active":"2023-06-08T03:48:46.714900+0000","last_became_peered":"2023-06-08T03:48:46.714900+0000","last_unstale":"2023-06-08T03:48:51.536330+0000","last_undegraded":"2023-06-08T03:48:51.536330+0000","last_fullsized":"2023-06-08T03:48:51.536330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.706828+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.706509+0000","last_became_peered":"2023-06-08T03:48:46.706509+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:46.242079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294194+0000","last_change":"2023-06-08T03:48:46.695842+0000","last_active":"2023-06-08T03:48:51.294194+0000","last_peered":"2023-06-08T03:48:51.294194+0000","last_clean":"2023-06-08T03:48:51.294194+0000","last_became_active":"2023-06-08T03:48:46.695612+0000","last_became_peered":"2023-06-08T03:48:46.695612+0000","last_unstale":"2023-06-08T03:48:51.294194+0000","last_undegraded":"2023-06-08T03:48:51.294194+0000","last_fullsized":"2023-06-08T03:48:51.294194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:20:54.828539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152362+0000","last_change":"2023-06-08T03:48:46.697084+0000","last_active":"2023-06-08T03:48:51.152362+0000","last_peered":"2023-06-08T03:48:51.152362+0000","last_clean":"2023-06-08T03:48:51.152362+0000","last_became_active":"2023-06-08T03:48:46.696841+0000","last_became_peered":"2023-06-08T03:48:46.696841+0000","last_unstale":"2023-06-08T03:48:51.152362+0000","last_undegraded":"2023-06-08T03:48:51.152362+0000","last_fullsized":"2023-06-08T03:48:51.152362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:47.104870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535352+0000","last_change":"2023-06-08T03:48:46.707641+0000","last_active":"2023-06-08T03:48:51.535352+0000","last_peered":"2023-06-08T03:48:51.535352+0000","last_clean":"2023-06-08T03:48:51.535352+0000","last_became_active":"2023-06-08T03:48:46.707211+0000","last_became_peered":"2023-06-08T03:48:46.707211+0000","last_unstale":"2023-06-08T03:48:51.535352+0000","last_undegraded":"2023-06-08T03:48:51.535352+0000","last_fullsized":"2023-06-08T03:48:51.535352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:39.020693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151721+0000","last_change":"2023-06-08T03:48:46.709738+0000","last_active":"2023-06-08T03:48:51.151721+0000","last_peered":"2023-06-08T03:48:51.151721+0000","last_clean":"2023-06-08T03:48:51.151721+0000","last_became_active":"2023-06-08T03:48:46.709340+0000","last_became_peered":"2023-06-08T03:48:46.709340+0000","last_unstale":"2023-06-08T03:48:51.151721+0000","last_undegraded":"2023-06-08T03:48:51.151721+0000","last_fullsized":"2023-06-08T03:48:51.151721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:23.681916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536282+0000","last_change":"2023-06-08T03:48:46.709790+0000","last_active":"2023-06-08T03:48:51.536282+0000","last_peered":"2023-06-08T03:48:51.536282+0000","last_clean":"2023-06-08T03:48:51.536282+0000","last_became_active":"2023-06-08T03:48:46.709528+0000","last_became_peered":"2023-06-08T03:48:46.709528+0000","last_unstale":"2023-06-08T03:48:51.536282+0000","last_undegraded":"2023-06-08T03:48:51.536282+0000","last_fullsized":"2023-06-08T03:48:51.536282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:53.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293720+0000","last_change":"2023-06-08T03:48:46.712267+0000","last_active":"2023-06-08T03:48:51.293720+0000","last_peered":"2023-06-08T03:48:51.293720+0000","last_clean":"2023-06-08T03:48:51.293720+0000","last_became_active":"2023-06-08T03:48:46.712008+0000","last_became_peered":"2023-06-08T03:48:46.712008+0000","last_unstale":"2023-06-08T03:48:51.293720+0000","last_undegraded":"2023-06-08T03:48:51.293720+0000","last_fullsized":"2023-06-08T03:48:51.293720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:15.552998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149899+0000","last_change":"2023-06-08T03:48:46.699795+0000","last_active":"2023-06-08T03:48:51.149899+0000","last_peered":"2023-06-08T03:48:51.149899+0000","last_clean":"2023-06-08T03:48:51.149899+0000","last_became_active":"2023-06-08T03:48:46.699537+0000","last_became_peered":"2023-06-08T03:48:46.699537+0000","last_unstale":"2023-06-08T03:48:51.149899+0000","last_undegraded":"2023-06-08T03:48:51.149899+0000","last_fullsized":"2023-06-08T03:48:51.149899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535864+0000","last_change":"2023-06-08T03:48:46.710846+0000","last_active":"2023-06-08T03:48:51.535864+0000","last_peered":"2023-06-08T03:48:51.535864+0000","last_clean":"2023-06-08T03:48:51.535864+0000","last_became_active":"2023-06-08T03:48:46.710550+0000","last_became_peered":"2023-06-08T03:48:46.710550+0000","last_unstale":"2023-06-08T03:48:51.535864+0000","last_undegraded":"2023-06-08T03:48:51.535864+0000","last_fullsized":"2023-06-08T03:48:51.535864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297076+0000","last_change":"2023-06-08T03:48:46.713844+0000","last_active":"2023-06-08T03:48:51.297076+0000","last_peered":"2023-06-08T03:48:51.297076+0000","last_clean":"2023-06-08T03:48:51.297076+0000","last_became_active":"2023-06-08T03:48:46.713550+0000","last_became_peered":"2023-06-08T03:48:46.713550+0000","last_unstale":"2023-06-08T03:48:51.297076+0000","last_undegraded":"2023-06-08T03:48:51.297076+0000","last_fullsized":"2023-06-08T03:48:51.297076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:06.159783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296797+0000","last_change":"2023-06-08T03:48:46.711918+0000","last_active":"2023-06-08T03:48:51.296797+0000","last_peered":"2023-06-08T03:48:51.296797+0000","last_clean":"2023-06-08T03:48:51.296797+0000","last_became_active":"2023-06-08T03:48:46.711662+0000","last_became_peered":"2023-06-08T03:48:46.711662+0000","last_unstale":"2023-06-08T03:48:51.296797+0000","last_undegraded":"2023-06-08T03:48:51.296797+0000","last_fullsized":"2023-06-08T03:48:51.296797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:40.934017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537069+0000","last_change":"2023-06-08T03:48:46.708436+0000","last_active":"2023-06-08T03:48:51.537069+0000","last_peered":"2023-06-08T03:48:51.537069+0000","last_clean":"2023-06-08T03:48:51.537069+0000","last_became_active":"2023-06-08T03:48:46.708003+0000","last_became_peered":"2023-06-08T03:48:46.708003+0000","last_unstale":"2023-06-08T03:48:51.537069+0000","last_undegraded":"2023-06-08T03:48:51.537069+0000","last_fullsized":"2023-06-08T03:48:51.537069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:33.522665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152308+0000","last_change":"2023-06-08T03:48:50.740643+0000","last_active":"2023-06-08T03:48:51.152308+0000","last_peered":"2023-06-08T03:48:51.152308+0000","last_clean":"2023-06-08T03:48:51.152308+0000","last_became_active":"2023-06-08T03:48:50.740283+0000","last_became_peered":"2023-06-08T03:48:50.740283+0000","last_unstale":"2023-06-08T03:48:51.152308+0000","last_undegraded":"2023-06-08T03:48:51.152308+0000","last_fullsized":"2023-06-08T03:48:51.152308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:09:55.615848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152091+0000","last_change":"2023-06-08T03:48:46.278224+0000","last_active":"2023-06-08T03:48:51.152091+0000","last_peered":"2023-06-08T03:48:51.152091+0000","last_clean":"2023-06-08T03:48:51.152091+0000","last_became_active":"2023-06-08T03:48:46.277952+0000","last_became_peered":"2023-06-08T03:48:46.277952+0000","last_unstale":"2023-06-08T03:48:51.152091+0000","last_undegraded":"2023-06-08T03:48:51.152091+0000","last_fullsized":"2023-06-08T03:48:51.152091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:10:42.875919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150566+0000","last_change":"2023-06-08T03:48:46.712050+0000","last_active":"2023-06-08T03:48:51.150566+0000","last_peered":"2023-06-08T03:48:51.150566+0000","last_clean":"2023-06-08T03:48:51.150566+0000","last_became_active":"2023-06-08T03:48:46.711791+0000","last_became_peered":"2023-06-08T03:48:46.711791+0000","last_unstale":"2023-06-08T03:48:51.150566+0000","last_undegraded":"2023-06-08T03:48:51.150566+0000","last_fullsized":"2023-06-08T03:48:51.150566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:48.552832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151606+0000","last_change":"2023-06-08T03:48:50.739355+0000","last_active":"2023-06-08T03:48:51.151606+0000","last_peered":"2023-06-08T03:48:51.151606+0000","last_clean":"2023-06-08T03:48:51.151606+0000","last_became_active":"2023-06-08T03:48:50.738867+0000","last_became_peered":"2023-06-08T03:48:50.738867+0000","last_unstale":"2023-06-08T03:48:51.151606+0000","last_undegraded":"2023-06-08T03:48:51.151606+0000","last_fullsized":"2023-06-08T03:48:51.151606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:39.206726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296216+0000","last_change":"2023-06-08T03:48:46.277487+0000","last_active":"2023-06-08T03:48:51.296216+0000","last_peered":"2023-06-08T03:48:51.296216+0000","last_clean":"2023-06-08T03:48:51.296216+0000","last_became_active":"2023-06-08T03:48:46.277147+0000","last_became_peered":"2023-06-08T03:48:46.277147+0000","last_unstale":"2023-06-08T03:48:51.296216+0000","last_undegraded":"2023-06-08T03:48:51.296216+0000","last_fullsized":"2023-06-08T03:48:51.296216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:15.249130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294014+0000","last_change":"2023-06-08T03:48:46.698321+0000","last_active":"2023-06-08T03:48:51.294014+0000","last_peered":"2023-06-08T03:48:51.294014+0000","last_clean":"2023-06-08T03:48:51.294014+0000","last_became_active":"2023-06-08T03:48:46.698051+0000","last_became_peered":"2023-06-08T03:48:46.698051+0000","last_unstale":"2023-06-08T03:48:51.294014+0000","last_undegraded":"2023-06-08T03:48:51.294014+0000","last_fullsized":"2023-06-08T03:48:51.294014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294220+0000","last_change":"2023-06-08T03:48:50.747722+0000","last_active":"2023-06-08T03:48:51.294220+0000","last_peered":"2023-06-08T03:48:51.294220+0000","last_clean":"2023-06-08T03:48:51.294220+0000","last_became_active":"2023-06-08T03:48:50.747297+0000","last_became_peered":"2023-06-08T03:48:50.747297+0000","last_unstale":"2023-06-08T03:48:51.294220+0000","last_undegraded":"2023-06-08T03:48:51.294220+0000","last_fullsized":"2023-06-08T03:48:51.294220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:08:44.335450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150061+0000","last_change":"2023-06-08T03:48:46.276409+0000","last_active":"2023-06-08T03:48:51.150061+0000","last_peered":"2023-06-08T03:48:51.150061+0000","last_clean":"2023-06-08T03:48:51.150061+0000","last_became_active":"2023-06-08T03:48:46.276099+0000","last_became_peered":"2023-06-08T03:48:46.276099+0000","last_unstale":"2023-06-08T03:48:51.150061+0000","last_undegraded":"2023-06-08T03:48:51.150061+0000","last_fullsized":"2023-06-08T03:48:51.150061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:32.517367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151843+0000","last_change":"2023-06-08T03:48:46.707301+0000","last_active":"2023-06-08T03:48:51.151843+0000","last_peered":"2023-06-08T03:48:51.151843+0000","last_clean":"2023-06-08T03:48:51.151843+0000","last_became_active":"2023-06-08T03:48:46.706988+0000","last_became_peered":"2023-06-08T03:48:46.706988+0000","last_unstale":"2023-06-08T03:48:51.151843+0000","last_undegraded":"2023-06-08T03:48:51.151843+0000","last_fullsized":"2023-06-08T03:48:51.151843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151210+0000","last_change":"2023-06-08T03:48:50.741708+0000","last_active":"2023-06-08T03:48:51.151210+0000","last_peered":"2023-06-08T03:48:51.151210+0000","last_clean":"2023-06-08T03:48:51.151210+0000","last_became_active":"2023-06-08T03:48:50.741299+0000","last_became_peered":"2023-06-08T03:48:50.741299+0000","last_unstale":"2023-06-08T03:48:51.151210+0000","last_undegraded":"2023-06-08T03:48:51.151210+0000","last_fullsized":"2023-06-08T03:48:51.151210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:13:01.589674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294322+0000","last_change":"2023-06-08T03:48:46.281457+0000","last_active":"2023-06-08T03:48:51.294322+0000","last_peered":"2023-06-08T03:48:51.294322+0000","last_clean":"2023-06-08T03:48:51.294322+0000","last_became_active":"2023-06-08T03:48:46.279939+0000","last_became_peered":"2023-06-08T03:48:46.279939+0000","last_unstale":"2023-06-08T03:48:51.294322+0000","last_undegraded":"2023-06-08T03:48:51.294322+0000","last_fullsized":"2023-06-08T03:48:51.294322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149914+0000","last_change":"2023-06-08T03:48:46.712616+0000","last_active":"2023-06-08T03:48:51.149914+0000","last_peered":"2023-06-08T03:48:51.149914+0000","last_clean":"2023-06-08T03:48:51.149914+0000","last_became_active":"2023-06-08T03:48:46.712276+0000","last_became_peered":"2023-06-08T03:48:46.712276+0000","last_unstale":"2023-06-08T03:48:51.149914+0000","last_undegraded":"2023-06-08T03:48:51.149914+0000","last_fullsized":"2023-06-08T03:48:51.149914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:01.718524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535551+0000","last_change":"2023-06-08T03:48:50.740006+0000","last_active":"2023-06-08T03:48:51.535551+0000","last_peered":"2023-06-08T03:48:51.535551+0000","last_clean":"2023-06-08T03:48:51.535551+0000","last_became_active":"2023-06-08T03:48:50.739564+0000","last_became_peered":"2023-06-08T03:48:50.739564+0000","last_unstale":"2023-06-08T03:48:51.535551+0000","last_undegraded":"2023-06-08T03:48:51.535551+0000","last_fullsized":"2023-06-08T03:48:51.535551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:05.176785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537564+0000","last_change":"2023-06-08T03:48:46.280740+0000","last_active":"2023-06-08T03:48:51.537564+0000","last_peered":"2023-06-08T03:48:51.537564+0000","last_clean":"2023-06-08T03:48:51.537564+0000","last_became_active":"2023-06-08T03:48:46.280343+0000","last_became_peered":"2023-06-08T03:48:46.280343+0000","last_unstale":"2023-06-08T03:48:51.537564+0000","last_undegraded":"2023-06-08T03:48:51.537564+0000","last_fullsized":"2023-06-08T03:48:51.537564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:52.150651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149747+0000","last_change":"2023-06-08T03:48:46.705918+0000","last_active":"2023-06-08T03:48:51.149747+0000","last_peered":"2023-06-08T03:48:51.149747+0000","last_clean":"2023-06-08T03:48:51.149747+0000","last_became_active":"2023-06-08T03:48:46.704743+0000","last_became_peered":"2023-06-08T03:48:46.704743+0000","last_unstale":"2023-06-08T03:48:51.149747+0000","last_undegraded":"2023-06-08T03:48:51.149747+0000","last_fullsized":"2023-06-08T03:48:51.149747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:45:00.911565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150382+0000","last_change":"2023-06-08T03:48:50.743251+0000","last_active":"2023-06-08T03:48:51.150382+0000","last_peered":"2023-06-08T03:48:51.150382+0000","last_clean":"2023-06-08T03:48:51.150382+0000","last_became_active":"2023-06-08T03:48:50.742850+0000","last_became_peered":"2023-06-08T03:48:50.742850+0000","last_unstale":"2023-06-08T03:48:51.150382+0000","last_undegraded":"2023-06-08T03:48:51.150382+0000","last_fullsized":"2023-06-08T03:48:51.150382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:16.576491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536288+0000","last_change":"2023-06-08T03:48:46.278683+0000","last_active":"2023-06-08T03:48:51.536288+0000","last_peered":"2023-06-08T03:48:51.536288+0000","last_clean":"2023-06-08T03:48:51.536288+0000","last_became_active":"2023-06-08T03:48:46.278372+0000","last_became_peered":"2023-06-08T03:48:46.278372+0000","last_unstale":"2023-06-08T03:48:51.536288+0000","last_undegraded":"2023-06-08T03:48:51.536288+0000","last_fullsized":"2023-06-08T03:48:51.536288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:07.547618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296438+0000","last_change":"2023-06-08T03:48:46.712049+0000","last_active":"2023-06-08T03:48:51.296438+0000","last_peered":"2023-06-08T03:48:51.296438+0000","last_clean":"2023-06-08T03:48:51.296438+0000","last_became_active":"2023-06-08T03:48:46.711788+0000","last_became_peered":"2023-06-08T03:48:46.711788+0000","last_unstale":"2023-06-08T03:48:51.296438+0000","last_undegraded":"2023-06-08T03:48:51.296438+0000","last_fullsized":"2023-06-08T03:48:51.296438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296638+0000","last_change":"2023-06-08T03:48:50.741729+0000","last_active":"2023-06-08T03:48:51.296638+0000","last_peered":"2023-06-08T03:48:51.296638+0000","last_clean":"2023-06-08T03:48:51.296638+0000","last_became_active":"2023-06-08T03:48:50.741267+0000","last_became_peered":"2023-06-08T03:48:50.741267+0000","last_unstale":"2023-06-08T03:48:51.296638+0000","last_undegraded":"2023-06-08T03:48:51.296638+0000","last_fullsized":"2023-06-08T03:48:51.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:56.191756+0000","last_change":"2023-06-08T03:48:46.279495+0000","last_active":"2023-06-08T03:48:56.191756+0000","last_peered":"2023-06-08T03:48:56.191756+0000","last_clean":"2023-06-08T03:48:56.191756+0000","last_became_active":"2023-06-08T03:48:46.279119+0000","last_became_peered":"2023-06-08T03:48:46.279119+0000","last_unstale":"2023-06-08T03:48:56.191756+0000","last_undegraded":"2023-06-08T03:48:56.191756+0000","last_fullsized":"2023-06-08T03:48:56.191756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:02.149567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152693+0000","last_change":"2023-06-08T03:48:46.708107+0000","last_active":"2023-06-08T03:48:51.152693+0000","last_peered":"2023-06-08T03:48:51.152693+0000","last_clean":"2023-06-08T03:48:51.152693+0000","last_became_active":"2023-06-08T03:48:46.707899+0000","last_became_peered":"2023-06-08T03:48:46.707899+0000","last_unstale":"2023-06-08T03:48:51.152693+0000","last_undegraded":"2023-06-08T03:48:51.152693+0000","last_fullsized":"2023-06-08T03:48:51.152693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:39:42.981044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537245+0000","last_change":"2023-06-08T03:48:50.745708+0000","last_active":"2023-06-08T03:48:51.537245+0000","last_peered":"2023-06-08T03:48:51.537245+0000","last_clean":"2023-06-08T03:48:51.537245+0000","last_became_active":"2023-06-08T03:48:50.742554+0000","last_became_peered":"2023-06-08T03:48:50.742554+0000","last_unstale":"2023-06-08T03:48:51.537245+0000","last_undegraded":"2023-06-08T03:48:51.537245+0000","last_fullsized":"2023-06-08T03:48:51.537245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:39.476075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535988+0000","last_change":"2023-06-08T03:48:46.285246+0000","last_active":"2023-06-08T03:48:51.535988+0000","last_peered":"2023-06-08T03:48:51.535988+0000","last_clean":"2023-06-08T03:48:51.535988+0000","last_became_active":"2023-06-08T03:48:46.284966+0000","last_became_peered":"2023-06-08T03:48:46.284966+0000","last_unstale":"2023-06-08T03:48:51.535988+0000","last_undegraded":"2023-06-08T03:48:51.535988+0000","last_fullsized":"2023-06-08T03:48:51.535988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150409+0000","last_change":"2023-06-08T03:48:46.716123+0000","last_active":"2023-06-08T03:48:51.150409+0000","last_peered":"2023-06-08T03:48:51.150409+0000","last_clean":"2023-06-08T03:48:51.150409+0000","last_became_active":"2023-06-08T03:48:46.715806+0000","last_became_peered":"2023-06-08T03:48:46.715806+0000","last_unstale":"2023-06-08T03:48:51.150409+0000","last_undegraded":"2023-06-08T03:48:51.150409+0000","last_fullsized":"2023-06-08T03:48:51.150409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150674+0000","last_change":"2023-06-08T03:48:50.742064+0000","last_active":"2023-06-08T03:48:51.150674+0000","last_peered":"2023-06-08T03:48:51.150674+0000","last_clean":"2023-06-08T03:48:51.150674+0000","last_became_active":"2023-06-08T03:48:50.741695+0000","last_became_peered":"2023-06-08T03:48:50.741695+0000","last_unstale":"2023-06-08T03:48:51.150674+0000","last_undegraded":"2023-06-08T03:48:51.150674+0000","last_fullsized":"2023-06-08T03:48:51.150674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:07.233826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294053+0000","last_change":"2023-06-08T03:48:46.278885+0000","last_active":"2023-06-08T03:48:51.294053+0000","last_peered":"2023-06-08T03:48:51.294053+0000","last_clean":"2023-06-08T03:48:51.294053+0000","last_became_active":"2023-06-08T03:48:46.278561+0000","last_became_peered":"2023-06-08T03:48:46.278561+0000","last_unstale":"2023-06-08T03:48:51.294053+0000","last_undegraded":"2023-06-08T03:48:51.294053+0000","last_fullsized":"2023-06-08T03:48:51.294053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:06:31.293995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537077+0000","last_change":"2023-06-08T03:48:46.708244+0000","last_active":"2023-06-08T03:48:51.537077+0000","last_peered":"2023-06-08T03:48:51.537077+0000","last_clean":"2023-06-08T03:48:51.537077+0000","last_became_active":"2023-06-08T03:48:46.707643+0000","last_became_peered":"2023-06-08T03:48:46.707643+0000","last_unstale":"2023-06-08T03:48:51.537077+0000","last_undegraded":"2023-06-08T03:48:51.537077+0000","last_fullsized":"2023-06-08T03:48:51.537077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150661+0000","last_change":"2023-06-08T03:48:50.745965+0000","last_active":"2023-06-08T03:48:51.150661+0000","last_peered":"2023-06-08T03:48:51.150661+0000","last_clean":"2023-06-08T03:48:51.150661+0000","last_became_active":"2023-06-08T03:48:50.745561+0000","last_became_peered":"2023-06-08T03:48:50.745561+0000","last_unstale":"2023-06-08T03:48:51.150661+0000","last_undegraded":"2023-06-08T03:48:51.150661+0000","last_fullsized":"2023-06-08T03:48:51.150661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:37.313561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535839+0000","last_change":"2023-06-08T03:48:46.284576+0000","last_active":"2023-06-08T03:48:51.535839+0000","last_peered":"2023-06-08T03:48:51.535839+0000","last_clean":"2023-06-08T03:48:51.535839+0000","last_became_active":"2023-06-08T03:48:46.284324+0000","last_became_peered":"2023-06-08T03:48:46.284324+0000","last_unstale":"2023-06-08T03:48:51.535839+0000","last_undegraded":"2023-06-08T03:48:51.535839+0000","last_fullsized":"2023-06-08T03:48:51.535839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294519+0000","last_change":"2023-06-08T03:48:46.699501+0000","last_active":"2023-06-08T03:48:51.294519+0000","last_peered":"2023-06-08T03:48:51.294519+0000","last_clean":"2023-06-08T03:48:51.294519+0000","last_became_active":"2023-06-08T03:48:46.699227+0000","last_became_peered":"2023-06-08T03:48:46.699227+0000","last_unstale":"2023-06-08T03:48:51.294519+0000","last_undegraded":"2023-06-08T03:48:51.294519+0000","last_fullsized":"2023-06-08T03:48:51.294519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536807+0000","last_change":"2023-06-08T03:48:50.752340+0000","last_active":"2023-06-08T03:48:51.536807+0000","last_peered":"2023-06-08T03:48:51.536807+0000","last_clean":"2023-06-08T03:48:51.536807+0000","last_became_active":"2023-06-08T03:48:50.751962+0000","last_became_peered":"2023-06-08T03:48:50.751962+0000","last_unstale":"2023-06-08T03:48:51.536807+0000","last_undegraded":"2023-06-08T03:48:51.536807+0000","last_fullsized":"2023-06-08T03:48:51.536807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:48.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151454+0000","last_change":"2023-06-08T03:48:46.274849+0000","last_active":"2023-06-08T03:48:51.151454+0000","last_peered":"2023-06-08T03:48:51.151454+0000","last_clean":"2023-06-08T03:48:51.151454+0000","last_became_active":"2023-06-08T03:48:46.274502+0000","last_became_peered":"2023-06-08T03:48:46.274502+0000","last_unstale":"2023-06-08T03:48:51.151454+0000","last_undegraded":"2023-06-08T03:48:51.151454+0000","last_fullsized":"2023-06-08T03:48:51.151454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:22:56.444477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150868+0000","last_change":"2023-06-08T03:48:46.704969+0000","last_active":"2023-06-08T03:48:51.150868+0000","last_peered":"2023-06-08T03:48:51.150868+0000","last_clean":"2023-06-08T03:48:51.150868+0000","last_became_active":"2023-06-08T03:48:46.704688+0000","last_became_peered":"2023-06-08T03:48:46.704688+0000","last_unstale":"2023-06-08T03:48:51.150868+0000","last_undegraded":"2023-06-08T03:48:51.150868+0000","last_fullsized":"2023-06-08T03:48:51.150868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:03.154866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536425+0000","last_change":"2023-06-08T03:48:50.751168+0000","last_active":"2023-06-08T03:48:51.536425+0000","last_peered":"2023-06-08T03:48:51.536425+0000","last_clean":"2023-06-08T03:48:51.536425+0000","last_became_active":"2023-06-08T03:48:50.750781+0000","last_became_peered":"2023-06-08T03:48:50.750781+0000","last_unstale":"2023-06-08T03:48:51.536425+0000","last_undegraded":"2023-06-08T03:48:51.536425+0000","last_fullsized":"2023-06-08T03:48:51.536425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:59.334663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536464+0000","last_change":"2023-06-08T03:48:46.284225+0000","last_active":"2023-06-08T03:48:51.536464+0000","last_peered":"2023-06-08T03:48:51.536464+0000","last_clean":"2023-06-08T03:48:51.536464+0000","last_became_active":"2023-06-08T03:48:46.283964+0000","last_became_peered":"2023-06-08T03:48:46.283964+0000","last_unstale":"2023-06-08T03:48:51.536464+0000","last_undegraded":"2023-06-08T03:48:51.536464+0000","last_fullsized":"2023-06-08T03:48:51.536464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:02.770266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535467+0000","last_change":"2023-06-08T03:48:46.705264+0000","last_active":"2023-06-08T03:48:51.535467+0000","last_peered":"2023-06-08T03:48:51.535467+0000","last_clean":"2023-06-08T03:48:51.535467+0000","last_became_active":"2023-06-08T03:48:46.704968+0000","last_became_peered":"2023-06-08T03:48:46.704968+0000","last_unstale":"2023-06-08T03:48:51.535467+0000","last_undegraded":"2023-06-08T03:48:51.535467+0000","last_fullsized":"2023-06-08T03:48:51.535467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:19.849225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535037+0000","last_change":"2023-06-08T03:48:50.747984+0000","last_active":"2023-06-08T03:48:51.535037+0000","last_peered":"2023-06-08T03:48:51.535037+0000","last_clean":"2023-06-08T03:48:51.535037+0000","last_became_active":"2023-06-08T03:48:50.747678+0000","last_became_peered":"2023-06-08T03:48:50.747678+0000","last_unstale":"2023-06-08T03:48:51.535037+0000","last_undegraded":"2023-06-08T03:48:51.535037+0000","last_fullsized":"2023-06-08T03:48:51.535037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:20:02.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536442+0000","last_change":"2023-06-08T03:48:46.284040+0000","last_active":"2023-06-08T03:48:51.536442+0000","last_peered":"2023-06-08T03:48:51.536442+0000","last_clean":"2023-06-08T03:48:51.536442+0000","last_became_active":"2023-06-08T03:48:46.283769+0000","last_became_peered":"2023-06-08T03:48:46.283769+0000","last_unstale":"2023-06-08T03:48:51.536442+0000","last_undegraded":"2023-06-08T03:48:51.536442+0000","last_fullsized":"2023-06-08T03:48:51.536442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:32.850002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151726+0000","last_change":"2023-06-08T03:48:46.714226+0000","last_active":"2023-06-08T03:48:51.151726+0000","last_peered":"2023-06-08T03:48:51.151726+0000","last_clean":"2023-06-08T03:48:51.151726+0000","last_became_active":"2023-06-08T03:48:46.713960+0000","last_became_peered":"2023-06-08T03:48:46.713960+0000","last_unstale":"2023-06-08T03:48:51.151726+0000","last_undegraded":"2023-06-08T03:48:51.151726+0000","last_fullsized":"2023-06-08T03:48:51.151726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:27:56.879349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535261+0000","last_change":"2023-06-08T03:48:50.746373+0000","last_active":"2023-06-08T03:48:51.535261+0000","last_peered":"2023-06-08T03:48:51.535261+0000","last_clean":"2023-06-08T03:48:51.535261+0000","last_became_active":"2023-06-08T03:48:50.745785+0000","last_became_peered":"2023-06-08T03:48:50.745785+0000","last_unstale":"2023-06-08T03:48:51.535261+0000","last_undegraded":"2023-06-08T03:48:51.535261+0000","last_fullsized":"2023-06-08T03:48:51.535261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:46:48.225879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536088+0000","last_change":"2023-06-08T03:48:46.280813+0000","last_active":"2023-06-08T03:48:51.536088+0000","last_peered":"2023-06-08T03:48:51.536088+0000","last_clean":"2023-06-08T03:48:51.536088+0000","last_became_active":"2023-06-08T03:48:46.280534+0000","last_became_peered":"2023-06-08T03:48:46.280534+0000","last_unstale":"2023-06-08T03:48:51.536088+0000","last_undegraded":"2023-06-08T03:48:51.536088+0000","last_fullsized":"2023-06-08T03:48:51.536088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:41.910566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152106+0000","last_change":"2023-06-08T03:48:46.716189+0000","last_active":"2023-06-08T03:48:51.152106+0000","last_peered":"2023-06-08T03:48:51.152106+0000","last_clean":"2023-06-08T03:48:51.152106+0000","last_became_active":"2023-06-08T03:48:46.715886+0000","last_became_peered":"2023-06-08T03:48:46.715886+0000","last_unstale":"2023-06-08T03:48:51.152106+0000","last_undegraded":"2023-06-08T03:48:51.152106+0000","last_fullsized":"2023-06-08T03:48:51.152106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.739296+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.738841+0000","last_became_peered":"2023-06-08T03:48:50.738841+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:50.270846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536854+0000","last_change":"2023-06-08T03:48:46.279229+0000","last_active":"2023-06-08T03:48:51.536854+0000","last_peered":"2023-06-08T03:48:51.536854+0000","last_clean":"2023-06-08T03:48:51.536854+0000","last_became_active":"2023-06-08T03:48:46.278915+0000","last_became_peered":"2023-06-08T03:48:46.278915+0000","last_unstale":"2023-06-08T03:48:51.536854+0000","last_undegraded":"2023-06-08T03:48:51.536854+0000","last_fullsized":"2023-06-08T03:48:51.536854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294432+0000","last_change":"2023-06-08T03:48:46.712160+0000","last_active":"2023-06-08T03:48:51.294432+0000","last_peered":"2023-06-08T03:48:51.294432+0000","last_clean":"2023-06-08T03:48:51.294432+0000","last_became_active":"2023-06-08T03:48:46.711866+0000","last_became_peered":"2023-06-08T03:48:46.711866+0000","last_unstale":"2023-06-08T03:48:51.294432+0000","last_undegraded":"2023-06-08T03:48:51.294432+0000","last_fullsized":"2023-06-08T03:48:51.294432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.746274+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.745820+0000","last_became_peered":"2023-06-08T03:48:50.745820+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:59:19.751648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150205+0000","last_change":"2023-06-08T03:48:46.276528+0000","last_active":"2023-06-08T03:48:51.150205+0000","last_peered":"2023-06-08T03:48:51.150205+0000","last_clean":"2023-06-08T03:48:51.150205+0000","last_became_active":"2023-06-08T03:48:46.276141+0000","last_became_peered":"2023-06-08T03:48:46.276141+0000","last_unstale":"2023-06-08T03:48:51.150205+0000","last_undegraded":"2023-06-08T03:48:51.150205+0000","last_fullsized":"2023-06-08T03:48:51.150205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:35.012515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151420+0000","last_change":"2023-06-08T03:48:46.709069+0000","last_active":"2023-06-08T03:48:51.151420+0000","last_peered":"2023-06-08T03:48:51.151420+0000","last_clean":"2023-06-08T03:48:51.151420+0000","last_became_active":"2023-06-08T03:48:46.708427+0000","last_became_peered":"2023-06-08T03:48:46.708427+0000","last_unstale":"2023-06-08T03:48:51.151420+0000","last_undegraded":"2023-06-08T03:48:51.151420+0000","last_fullsized":"2023-06-08T03:48:51.151420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:33.855300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296822+0000","last_change":"2023-06-08T03:48:50.744633+0000","last_active":"2023-06-08T03:48:51.296822+0000","last_peered":"2023-06-08T03:48:51.296822+0000","last_clean":"2023-06-08T03:48:51.296822+0000","last_became_active":"2023-06-08T03:48:50.744230+0000","last_became_peered":"2023-06-08T03:48:50.744230+0000","last_unstale":"2023-06-08T03:48:51.296822+0000","last_undegraded":"2023-06-08T03:48:51.296822+0000","last_fullsized":"2023-06-08T03:48:51.296822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:04.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152143+0000","last_change":"2023-06-08T03:48:46.277921+0000","last_active":"2023-06-08T03:48:51.152143+0000","last_peered":"2023-06-08T03:48:51.152143+0000","last_clean":"2023-06-08T03:48:51.152143+0000","last_became_active":"2023-06-08T03:48:46.277634+0000","last_became_peered":"2023-06-08T03:48:46.277634+0000","last_unstale":"2023-06-08T03:48:51.152143+0000","last_undegraded":"2023-06-08T03:48:51.152143+0000","last_fullsized":"2023-06-08T03:48:51.152143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:20.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152053+0000","last_change":"2023-06-08T03:48:46.706196+0000","last_active":"2023-06-08T03:48:51.152053+0000","last_peered":"2023-06-08T03:48:51.152053+0000","last_clean":"2023-06-08T03:48:51.152053+0000","last_became_active":"2023-06-08T03:48:46.705906+0000","last_became_peered":"2023-06-08T03:48:46.705906+0000","last_unstale":"2023-06-08T03:48:51.152053+0000","last_undegraded":"2023-06-08T03:48:51.152053+0000","last_fullsized":"2023-06-08T03:48:51.152053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:02:18.561814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537144+0000","last_change":"2023-06-08T03:48:50.747319+0000","last_active":"2023-06-08T03:48:51.537144+0000","last_peered":"2023-06-08T03:48:51.537144+0000","last_clean":"2023-06-08T03:48:51.537144+0000","last_became_active":"2023-06-08T03:48:50.746943+0000","last_became_peered":"2023-06-08T03:48:50.746943+0000","last_unstale":"2023-06-08T03:48:51.537144+0000","last_undegraded":"2023-06-08T03:48:51.537144+0000","last_fullsized":"2023-06-08T03:48:51.537144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:46.374125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151194+0000","last_change":"2023-06-08T03:48:46.277755+0000","last_active":"2023-06-08T03:48:51.151194+0000","last_peered":"2023-06-08T03:48:51.151194+0000","last_clean":"2023-06-08T03:48:51.151194+0000","last_became_active":"2023-06-08T03:48:46.277421+0000","last_became_peered":"2023-06-08T03:48:46.277421+0000","last_unstale":"2023-06-08T03:48:51.151194+0000","last_undegraded":"2023-06-08T03:48:51.151194+0000","last_fullsized":"2023-06-08T03:48:51.151194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.153481+0000","last_change":"2023-06-08T03:48:46.708084+0000","last_active":"2023-06-08T03:48:51.153481+0000","last_peered":"2023-06-08T03:48:51.153481+0000","last_clean":"2023-06-08T03:48:51.153481+0000","last_became_active":"2023-06-08T03:48:46.707810+0000","last_became_peered":"2023-06-08T03:48:46.707810+0000","last_unstale":"2023-06-08T03:48:51.153481+0000","last_undegraded":"2023-06-08T03:48:51.153481+0000","last_fullsized":"2023-06-08T03:48:51.153481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:42:31.285512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151893+0000","last_change":"2023-06-08T03:48:50.746365+0000","last_active":"2023-06-08T03:48:51.151893+0000","last_peered":"2023-06-08T03:48:51.151893+0000","last_clean":"2023-06-08T03:48:51.151893+0000","last_became_active":"2023-06-08T03:48:50.745965+0000","last_became_peered":"2023-06-08T03:48:50.745965+0000","last_unstale":"2023-06-08T03:48:51.151893+0000","last_undegraded":"2023-06-08T03:48:51.151893+0000","last_fullsized":"2023-06-08T03:48:51.151893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:50:52.715702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149902+0000","last_change":"2023-06-08T03:48:46.281571+0000","last_active":"2023-06-08T03:48:51.149902+0000","last_peered":"2023-06-08T03:48:51.149902+0000","last_clean":"2023-06-08T03:48:51.149902+0000","last_became_active":"2023-06-08T03:48:46.281171+0000","last_became_peered":"2023-06-08T03:48:46.281171+0000","last_unstale":"2023-06-08T03:48:51.149902+0000","last_undegraded":"2023-06-08T03:48:51.149902+0000","last_fullsized":"2023-06-08T03:48:51.149902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297204+0000","last_change":"2023-06-08T03:48:46.705939+0000","last_active":"2023-06-08T03:48:51.297204+0000","last_peered":"2023-06-08T03:48:51.297204+0000","last_clean":"2023-06-08T03:48:51.297204+0000","last_became_active":"2023-06-08T03:48:46.705467+0000","last_became_peered":"2023-06-08T03:48:46.705467+0000","last_unstale":"2023-06-08T03:48:51.297204+0000","last_undegraded":"2023-06-08T03:48:51.297204+0000","last_fullsized":"2023-06-08T03:48:51.297204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:32.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151964+0000","last_change":"2023-06-08T03:48:50.741943+0000","last_active":"2023-06-08T03:48:51.151964+0000","last_peered":"2023-06-08T03:48:51.151964+0000","last_clean":"2023-06-08T03:48:51.151964+0000","last_became_active":"2023-06-08T03:48:50.741608+0000","last_became_peered":"2023-06-08T03:48:50.741608+0000","last_unstale":"2023-06-08T03:48:51.151964+0000","last_undegraded":"2023-06-08T03:48:51.151964+0000","last_fullsized":"2023-06-08T03:48:51.151964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:51:13.186018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150823+0000","last_change":"2023-06-08T03:48:46.278306+0000","last_active":"2023-06-08T03:48:51.150823+0000","last_peered":"2023-06-08T03:48:51.150823+0000","last_clean":"2023-06-08T03:48:51.150823+0000","last_became_active":"2023-06-08T03:48:46.277947+0000","last_became_peered":"2023-06-08T03:48:46.277947+0000","last_unstale":"2023-06-08T03:48:51.150823+0000","last_undegraded":"2023-06-08T03:48:51.150823+0000","last_fullsized":"2023-06-08T03:48:51.150823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:49.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152311+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:48:51.152311+0000","last_peered":"2023-06-08T03:48:51.152311+0000","last_clean":"2023-06-08T03:48:51.152311+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:48:51.152311+0000","last_undegraded":"2023-06-08T03:48:51.152311+0000","last_fullsized":"2023-06-08T03:48:51.152311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:31:06.762730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:46.705629+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:46.705364+0000","last_became_peered":"2023-06-08T03:48:46.705364+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:50.749541+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:50.749054+0000","last_became_peered":"2023-06-08T03:48:50.749054+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:10.319490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150370+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:48:51.150370+0000","last_peered":"2023-06-08T03:48:51.150370+0000","last_clean":"2023-06-08T03:48:51.150370+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:48:51.150370+0000","last_undegraded":"2023-06-08T03:48:51.150370+0000","last_fullsized":"2023-06-08T03:48:51.150370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:47.060840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294022+0000","last_change":"2023-06-08T03:48:46.278145+0000","last_active":"2023-06-08T03:48:51.294022+0000","last_peered":"2023-06-08T03:48:51.294022+0000","last_clean":"2023-06-08T03:48:51.294022+0000","last_became_active":"2023-06-08T03:48:46.277856+0000","last_became_peered":"2023-06-08T03:48:46.277856+0000","last_unstale":"2023-06-08T03:48:51.294022+0000","last_undegraded":"2023-06-08T03:48:51.294022+0000","last_fullsized":"2023-06-08T03:48:51.294022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:05.154485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151419+0000","last_change":"2023-06-08T03:48:46.710096+0000","last_active":"2023-06-08T03:48:51.151419+0000","last_peered":"2023-06-08T03:48:51.151419+0000","last_clean":"2023-06-08T03:48:51.151419+0000","last_became_active":"2023-06-08T03:48:46.709818+0000","last_became_peered":"2023-06-08T03:48:46.709818+0000","last_unstale":"2023-06-08T03:48:51.151419+0000","last_undegraded":"2023-06-08T03:48:51.151419+0000","last_fullsized":"2023-06-08T03:48:51.151419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536871+0000","last_change":"2023-06-08T03:48:50.741926+0000","last_active":"2023-06-08T03:48:51.536871+0000","last_peered":"2023-06-08T03:48:51.536871+0000","last_clean":"2023-06-08T03:48:51.536871+0000","last_became_active":"2023-06-08T03:48:50.741525+0000","last_became_peered":"2023-06-08T03:48:50.741525+0000","last_unstale":"2023-06-08T03:48:51.536871+0000","last_undegraded":"2023-06-08T03:48:51.536871+0000","last_fullsized":"2023-06-08T03:48:51.536871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:51.416831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296460+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:48:51.296460+0000","last_peered":"2023-06-08T03:48:51.296460+0000","last_clean":"2023-06-08T03:48:51.296460+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:48:51.296460+0000","last_undegraded":"2023-06-08T03:48:51.296460+0000","last_fullsized":"2023-06-08T03:48:51.296460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:15.592925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536615+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:48:51.536615+0000","last_peered":"2023-06-08T03:48:51.536615+0000","last_clean":"2023-06-08T03:48:51.536615+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:48:51.536615+0000","last_undegraded":"2023-06-08T03:48:51.536615+0000","last_fullsized":"2023-06-08T03:48:51.536615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:57.059756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293693+0000","last_change":"2023-06-08T03:48:46.271960+0000","last_active":"2023-06-08T03:48:51.293693+0000","last_peered":"2023-06-08T03:48:51.293693+0000","last_clean":"2023-06-08T03:48:51.293693+0000","last_became_active":"2023-06-08T03:48:46.271631+0000","last_became_peered":"2023-06-08T03:48:46.271631+0000","last_unstale":"2023-06-08T03:48:51.293693+0000","last_undegraded":"2023-06-08T03:48:51.293693+0000","last_fullsized":"2023-06-08T03:48:51.293693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:39.928718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294243+0000","last_change":"2023-06-08T03:48:46.713531+0000","last_active":"2023-06-08T03:48:51.294243+0000","last_peered":"2023-06-08T03:48:51.294243+0000","last_clean":"2023-06-08T03:48:51.294243+0000","last_became_active":"2023-06-08T03:48:46.713244+0000","last_became_peered":"2023-06-08T03:48:46.713244+0000","last_unstale":"2023-06-08T03:48:51.294243+0000","last_undegraded":"2023-06-08T03:48:51.294243+0000","last_fullsized":"2023-06-08T03:48:51.294243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:15.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535548+0000","last_change":"2023-06-08T03:48:50.741357+0000","last_active":"2023-06-08T03:48:51.535548+0000","last_peered":"2023-06-08T03:48:51.535548+0000","last_clean":"2023-06-08T03:48:51.535548+0000","last_became_active":"2023-06-08T03:48:50.740948+0000","last_became_peered":"2023-06-08T03:48:50.740948+0000","last_unstale":"2023-06-08T03:48:51.535548+0000","last_undegraded":"2023-06-08T03:48:51.535548+0000","last_fullsized":"2023-06-08T03:48:51.535548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:30:29.499824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536124+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:48:51.536124+0000","last_peered":"2023-06-08T03:48:51.536124+0000","last_clean":"2023-06-08T03:48:51.536124+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:48:51.536124+0000","last_undegraded":"2023-06-08T03:48:51.536124+0000","last_fullsized":"2023-06-08T03:48:51.536124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:29.922704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296203+0000","last_change":"2023-06-08T03:48:46.277931+0000","last_active":"2023-06-08T03:48:51.296203+0000","last_peered":"2023-06-08T03:48:51.296203+0000","last_clean":"2023-06-08T03:48:51.296203+0000","last_became_active":"2023-06-08T03:48:46.277604+0000","last_became_peered":"2023-06-08T03:48:46.277604+0000","last_unstale":"2023-06-08T03:48:51.296203+0000","last_undegraded":"2023-06-08T03:48:51.296203+0000","last_fullsized":"2023-06-08T03:48:51.296203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:34.743166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297099+0000","last_change":"2023-06-08T03:48:46.705736+0000","last_active":"2023-06-08T03:48:51.297099+0000","last_peered":"2023-06-08T03:48:51.297099+0000","last_clean":"2023-06-08T03:48:51.297099+0000","last_became_active":"2023-06-08T03:48:46.705176+0000","last_became_peered":"2023-06-08T03:48:46.705176+0000","last_unstale":"2023-06-08T03:48:51.297099+0000","last_undegraded":"2023-06-08T03:48:51.297099+0000","last_fullsized":"2023-06-08T03:48:51.297099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536231+0000","last_change":"2023-06-08T03:48:50.742690+0000","last_active":"2023-06-08T03:48:51.536231+0000","last_peered":"2023-06-08T03:48:51.536231+0000","last_clean":"2023-06-08T03:48:51.536231+0000","last_became_active":"2023-06-08T03:48:50.742283+0000","last_became_peered":"2023-06-08T03:48:50.742283+0000","last_unstale":"2023-06-08T03:48:51.536231+0000","last_undegraded":"2023-06-08T03:48:51.536231+0000","last_fullsized":"2023-06-08T03:48:51.536231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:36.980926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535737+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:48:51.535737+0000","last_peered":"2023-06-08T03:48:51.535737+0000","last_clean":"2023-06-08T03:48:51.535737+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:48:51.535737+0000","last_undegraded":"2023-06-08T03:48:51.535737+0000","last_fullsized":"2023-06-08T03:48:51.535737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:37.932523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150042+0000","last_change":"2023-06-08T03:48:46.281860+0000","last_active":"2023-06-08T03:48:51.150042+0000","last_peered":"2023-06-08T03:48:51.150042+0000","last_clean":"2023-06-08T03:48:51.150042+0000","last_became_active":"2023-06-08T03:48:46.281558+0000","last_became_peered":"2023-06-08T03:48:46.281558+0000","last_unstale":"2023-06-08T03:48:51.150042+0000","last_undegraded":"2023-06-08T03:48:51.150042+0000","last_fullsized":"2023-06-08T03:48:51.150042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.712745+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.712473+0000","last_became_peered":"2023-06-08T03:48:46.712473+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:11.555796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294139+0000","last_change":"2023-06-08T03:48:50.741909+0000","last_active":"2023-06-08T03:48:51.294139+0000","last_peered":"2023-06-08T03:48:51.294139+0000","last_clean":"2023-06-08T03:48:51.294139+0000","last_became_active":"2023-06-08T03:48:50.741480+0000","last_became_peered":"2023-06-08T03:48:50.741480+0000","last_unstale":"2023-06-08T03:48:51.294139+0000","last_undegraded":"2023-06-08T03:48:51.294139+0000","last_fullsized":"2023-06-08T03:48:51.294139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:23:11.394158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535613+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:48:51.535613+0000","last_peered":"2023-06-08T03:48:51.535613+0000","last_clean":"2023-06-08T03:48:51.535613+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:48:51.535613+0000","last_undegraded":"2023-06-08T03:48:51.535613+0000","last_fullsized":"2023-06-08T03:48:51.535613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:08.960350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152806+0000","last_change":"2023-06-08T03:48:46.277332+0000","last_active":"2023-06-08T03:48:51.152806+0000","last_peered":"2023-06-08T03:48:51.152806+0000","last_clean":"2023-06-08T03:48:51.152806+0000","last_became_active":"2023-06-08T03:48:46.277048+0000","last_became_peered":"2023-06-08T03:48:46.277048+0000","last_unstale":"2023-06-08T03:48:51.152806+0000","last_undegraded":"2023-06-08T03:48:51.152806+0000","last_fullsized":"2023-06-08T03:48:51.152806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:20:43.010981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296324+0000","last_change":"2023-06-08T03:48:46.713941+0000","last_active":"2023-06-08T03:48:51.296324+0000","last_peered":"2023-06-08T03:48:51.296324+0000","last_clean":"2023-06-08T03:48:51.296324+0000","last_became_active":"2023-06-08T03:48:46.713519+0000","last_became_peered":"2023-06-08T03:48:46.713519+0000","last_unstale":"2023-06-08T03:48:51.296324+0000","last_undegraded":"2023-06-08T03:48:51.296324+0000","last_fullsized":"2023-06-08T03:48:51.296324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152339+0000","last_change":"2023-06-08T03:48:50.746277+0000","last_active":"2023-06-08T03:48:51.152339+0000","last_peered":"2023-06-08T03:48:51.152339+0000","last_clean":"2023-06-08T03:48:51.152339+0000","last_became_active":"2023-06-08T03:48:50.745762+0000","last_became_peered":"2023-06-08T03:48:50.745762+0000","last_unstale":"2023-06-08T03:48:51.152339+0000","last_undegraded":"2023-06-08T03:48:51.152339+0000","last_fullsized":"2023-06-08T03:48:51.152339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151603+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:48:51.151603+0000","last_peered":"2023-06-08T03:48:51.151603+0000","last_clean":"2023-06-08T03:48:51.151603+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:48:51.151603+0000","last_undegraded":"2023-06-08T03:48:51.151603+0000","last_fullsized":"2023-06-08T03:48:51.151603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:16.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296662+0000","last_change":"2023-06-08T03:48:46.280443+0000","last_active":"2023-06-08T03:48:51.296662+0000","last_peered":"2023-06-08T03:48:51.296662+0000","last_clean":"2023-06-08T03:48:51.296662+0000","last_became_active":"2023-06-08T03:48:46.280150+0000","last_became_peered":"2023-06-08T03:48:46.280150+0000","last_unstale":"2023-06-08T03:48:51.296662+0000","last_undegraded":"2023-06-08T03:48:51.296662+0000","last_fullsized":"2023-06-08T03:48:51.296662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:10.550497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294224+0000","last_change":"2023-06-08T03:48:46.704536+0000","last_active":"2023-06-08T03:48:51.294224+0000","last_peered":"2023-06-08T03:48:51.294224+0000","last_clean":"2023-06-08T03:48:51.294224+0000","last_became_active":"2023-06-08T03:48:46.704247+0000","last_became_peered":"2023-06-08T03:48:46.704247+0000","last_unstale":"2023-06-08T03:48:51.294224+0000","last_undegraded":"2023-06-08T03:48:51.294224+0000","last_fullsized":"2023-06-08T03:48:51.294224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294090+0000","last_change":"2023-06-08T03:48:50.746038+0000","last_active":"2023-06-08T03:48:51.294090+0000","last_peered":"2023-06-08T03:48:51.294090+0000","last_clean":"2023-06-08T03:48:51.294090+0000","last_became_active":"2023-06-08T03:48:50.742671+0000","last_became_peered":"2023-06-08T03:48:50.742671+0000","last_unstale":"2023-06-08T03:48:51.294090+0000","last_undegraded":"2023-06-08T03:48:51.294090+0000","last_fullsized":"2023-06-08T03:48:51.294090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:35.814289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151774+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:48:51.151774+0000","last_peered":"2023-06-08T03:48:51.151774+0000","last_clean":"2023-06-08T03:48:51.151774+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:48:51.151774+0000","last_undegraded":"2023-06-08T03:48:51.151774+0000","last_fullsized":"2023-06-08T03:48:51.151774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:42.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536891+0000","last_change":"2023-06-08T03:48:46.279903+0000","last_active":"2023-06-08T03:48:51.536891+0000","last_peered":"2023-06-08T03:48:51.536891+0000","last_clean":"2023-06-08T03:48:51.536891+0000","last_became_active":"2023-06-08T03:48:46.279643+0000","last_became_peered":"2023-06-08T03:48:46.279643+0000","last_unstale":"2023-06-08T03:48:51.536891+0000","last_undegraded":"2023-06-08T03:48:51.536891+0000","last_fullsized":"2023-06-08T03:48:51.536891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296218+0000","last_change":"2023-06-08T03:48:46.710102+0000","last_active":"2023-06-08T03:48:51.296218+0000","last_peered":"2023-06-08T03:48:51.296218+0000","last_clean":"2023-06-08T03:48:51.296218+0000","last_became_active":"2023-06-08T03:48:46.708006+0000","last_became_peered":"2023-06-08T03:48:46.708006+0000","last_unstale":"2023-06-08T03:48:51.296218+0000","last_undegraded":"2023-06-08T03:48:51.296218+0000","last_fullsized":"2023-06-08T03:48:51.296218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:22.614696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296866+0000","last_change":"2023-06-08T03:48:50.745383+0000","last_active":"2023-06-08T03:48:51.296866+0000","last_peered":"2023-06-08T03:48:51.296866+0000","last_clean":"2023-06-08T03:48:51.296866+0000","last_became_active":"2023-06-08T03:48:50.744898+0000","last_became_peered":"2023-06-08T03:48:50.744898+0000","last_unstale":"2023-06-08T03:48:51.296866+0000","last_undegraded":"2023-06-08T03:48:51.296866+0000","last_fullsized":"2023-06-08T03:48:51.296866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:19.011259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294205+0000","last_change":"2023-06-08T03:48:46.272132+0000","last_active":"2023-06-08T03:48:51.294205+0000","last_peered":"2023-06-08T03:48:51.294205+0000","last_clean":"2023-06-08T03:48:51.294205+0000","last_became_active":"2023-06-08T03:48:46.271635+0000","last_became_peered":"2023-06-08T03:48:46.271635+0000","last_unstale":"2023-06-08T03:48:51.294205+0000","last_undegraded":"2023-06-08T03:48:51.294205+0000","last_fullsized":"2023-06-08T03:48:51.294205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:18.843927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535531+0000","last_change":"2023-06-08T03:48:46.716188+0000","last_active":"2023-06-08T03:48:51.535531+0000","last_peered":"2023-06-08T03:48:51.535531+0000","last_clean":"2023-06-08T03:48:51.535531+0000","last_became_active":"2023-06-08T03:48:46.715960+0000","last_became_peered":"2023-06-08T03:48:46.715960+0000","last_unstale":"2023-06-08T03:48:51.535531+0000","last_undegraded":"2023-06-08T03:48:51.535531+0000","last_fullsized":"2023-06-08T03:48:51.535531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:59:38.213584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536363+0000","last_change":"2023-06-08T03:48:50.741907+0000","last_active":"2023-06-08T03:48:51.536363+0000","last_peered":"2023-06-08T03:48:51.536363+0000","last_clean":"2023-06-08T03:48:51.536363+0000","last_became_active":"2023-06-08T03:48:50.741526+0000","last_became_peered":"2023-06-08T03:48:50.741526+0000","last_unstale":"2023-06-08T03:48:51.536363+0000","last_undegraded":"2023-06-08T03:48:51.536363+0000","last_fullsized":"2023-06-08T03:48:51.536363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536462+0000","last_change":"2023-06-08T03:48:46.283972+0000","last_active":"2023-06-08T03:48:51.536462+0000","last_peered":"2023-06-08T03:48:51.536462+0000","last_clean":"2023-06-08T03:48:51.536462+0000","last_became_active":"2023-06-08T03:48:46.283686+0000","last_became_peered":"2023-06-08T03:48:46.283686+0000","last_unstale":"2023-06-08T03:48:51.536462+0000","last_undegraded":"2023-06-08T03:48:51.536462+0000","last_fullsized":"2023-06-08T03:48:51.536462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152862+0000","last_change":"2023-06-08T03:48:46.708793+0000","last_active":"2023-06-08T03:48:51.152862+0000","last_peered":"2023-06-08T03:48:51.152862+0000","last_clean":"2023-06-08T03:48:51.152862+0000","last_became_active":"2023-06-08T03:48:46.708492+0000","last_became_peered":"2023-06-08T03:48:46.708492+0000","last_unstale":"2023-06-08T03:48:51.152862+0000","last_undegraded":"2023-06-08T03:48:51.152862+0000","last_fullsized":"2023-06-08T03:48:51.152862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:54:28.053659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537064+0000","last_change":"2023-06-08T03:48:50.748191+0000","last_active":"2023-06-08T03:48:51.537064+0000","last_peered":"2023-06-08T03:48:51.537064+0000","last_clean":"2023-06-08T03:48:51.537064+0000","last_became_active":"2023-06-08T03:48:50.747824+0000","last_became_peered":"2023-06-08T03:48:50.747824+0000","last_unstale":"2023-06-08T03:48:51.537064+0000","last_undegraded":"2023-06-08T03:48:51.537064+0000","last_fullsized":"2023-06-08T03:48:51.537064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:16.373129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536733+0000","last_change":"2023-06-08T03:48:46.283956+0000","last_active":"2023-06-08T03:48:51.536733+0000","last_peered":"2023-06-08T03:48:51.536733+0000","last_clean":"2023-06-08T03:48:51.536733+0000","last_became_active":"2023-06-08T03:48:46.283667+0000","last_became_peered":"2023-06-08T03:48:46.283667+0000","last_unstale":"2023-06-08T03:48:51.536733+0000","last_undegraded":"2023-06-08T03:48:51.536733+0000","last_fullsized":"2023-06-08T03:48:51.536733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:43.022334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151349+0000","last_change":"2023-06-08T03:48:46.705342+0000","last_active":"2023-06-08T03:48:51.151349+0000","last_peered":"2023-06-08T03:48:51.151349+0000","last_clean":"2023-06-08T03:48:51.151349+0000","last_became_active":"2023-06-08T03:48:46.704758+0000","last_became_peered":"2023-06-08T03:48:46.704758+0000","last_unstale":"2023-06-08T03:48:51.151349+0000","last_undegraded":"2023-06-08T03:48:51.151349+0000","last_fullsized":"2023-06-08T03:48:51.151349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:03.775564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150985+0000","last_change":"2023-06-08T03:48:50.749457+0000","last_active":"2023-06-08T03:48:51.150985+0000","last_peered":"2023-06-08T03:48:51.150985+0000","last_clean":"2023-06-08T03:48:51.150985+0000","last_became_active":"2023-06-08T03:48:50.749024+0000","last_became_peered":"2023-06-08T03:48:50.749024+0000","last_unstale":"2023-06-08T03:48:51.150985+0000","last_undegraded":"2023-06-08T03:48:51.150985+0000","last_fullsized":"2023-06-08T03:48:51.150985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150602+0000","last_change":"2023-06-08T03:48:46.274180+0000","last_active":"2023-06-08T03:48:51.150602+0000","last_peered":"2023-06-08T03:48:51.150602+0000","last_clean":"2023-06-08T03:48:51.150602+0000","last_became_active":"2023-06-08T03:48:46.273751+0000","last_became_peered":"2023-06-08T03:48:46.273751+0000","last_unstale":"2023-06-08T03:48:51.150602+0000","last_undegraded":"2023-06-08T03:48:51.150602+0000","last_fullsized":"2023-06-08T03:48:51.150602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149813+0000","last_change":"2023-06-08T03:48:46.699197+0000","last_active":"2023-06-08T03:48:51.149813+0000","last_peered":"2023-06-08T03:48:51.149813+0000","last_clean":"2023-06-08T03:48:51.149813+0000","last_became_active":"2023-06-08T03:48:46.698921+0000","last_became_peered":"2023-06-08T03:48:46.698921+0000","last_unstale":"2023-06-08T03:48:51.149813+0000","last_undegraded":"2023-06-08T03:48:51.149813+0000","last_fullsized":"2023-06-08T03:48:51.149813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296459+0000","last_change":"2023-06-08T03:48:50.742031+0000","last_active":"2023-06-08T03:48:51.296459+0000","last_peered":"2023-06-08T03:48:51.296459+0000","last_clean":"2023-06-08T03:48:51.296459+0000","last_became_active":"2023-06-08T03:48:50.741621+0000","last_became_peered":"2023-06-08T03:48:50.741621+0000","last_unstale":"2023-06-08T03:48:51.296459+0000","last_undegraded":"2023-06-08T03:48:51.296459+0000","last_fullsized":"2023-06-08T03:48:51.296459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:59.951799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294491+0000","last_change":"2023-06-08T03:48:46.280946+0000","last_active":"2023-06-08T03:48:51.294491+0000","last_peered":"2023-06-08T03:48:51.294491+0000","last_clean":"2023-06-08T03:48:51.294491+0000","last_became_active":"2023-06-08T03:48:46.279562+0000","last_became_peered":"2023-06-08T03:48:46.279562+0000","last_unstale":"2023-06-08T03:48:51.294491+0000","last_undegraded":"2023-06-08T03:48:51.294491+0000","last_fullsized":"2023-06-08T03:48:51.294491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151164+0000","last_change":"2023-06-08T03:48:46.709469+0000","last_active":"2023-06-08T03:48:51.151164+0000","last_peered":"2023-06-08T03:48:51.151164+0000","last_clean":"2023-06-08T03:48:51.151164+0000","last_became_active":"2023-06-08T03:48:46.709131+0000","last_became_peered":"2023-06-08T03:48:46.709131+0000","last_unstale":"2023-06-08T03:48:51.151164+0000","last_undegraded":"2023-06-08T03:48:51.151164+0000","last_fullsized":"2023-06-08T03:48:51.151164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:09.642499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151705+0000","last_change":"2023-06-08T03:48:46.699962+0000","last_active":"2023-06-08T03:48:51.151705+0000","last_peered":"2023-06-08T03:48:51.151705+0000","last_clean":"2023-06-08T03:48:51.151705+0000","last_became_active":"2023-06-08T03:48:46.699670+0000","last_became_peered":"2023-06-08T03:48:46.699670+0000","last_unstale":"2023-06-08T03:48:51.151705+0000","last_undegraded":"2023-06-08T03:48:51.151705+0000","last_fullsized":"2023-06-08T03:48:51.151705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:16.254429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150141+0000","last_change":"2023-06-08T03:48:46.712641+0000","last_active":"2023-06-08T03:48:51.150141+0000","last_peered":"2023-06-08T03:48:51.150141+0000","last_clean":"2023-06-08T03:48:51.150141+0000","last_became_active":"2023-06-08T03:48:46.712338+0000","last_became_peered":"2023-06-08T03:48:46.712338+0000","last_unstale":"2023-06-08T03:48:51.150141+0000","last_undegraded":"2023-06-08T03:48:51.150141+0000","last_fullsized":"2023-06-08T03:48:51.150141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:42.915864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152242+0000","last_change":"2023-06-08T03:48:46.711282+0000","last_active":"2023-06-08T03:48:51.152242+0000","last_peered":"2023-06-08T03:48:51.152242+0000","last_clean":"2023-06-08T03:48:51.152242+0000","last_became_active":"2023-06-08T03:48:46.711006+0000","last_became_peered":"2023-06-08T03:48:46.711006+0000","last_unstale":"2023-06-08T03:48:51.152242+0000","last_undegraded":"2023-06-08T03:48:51.152242+0000","last_fullsized":"2023-06-08T03:48:51.152242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:23:18.302863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150081+0000","last_change":"2023-06-08T03:48:46.711221+0000","last_active":"2023-06-08T03:48:51.150081+0000","last_peered":"2023-06-08T03:48:51.150081+0000","last_clean":"2023-06-08T03:48:51.150081+0000","last_became_active":"2023-06-08T03:48:46.710772+0000","last_became_peered":"2023-06-08T03:48:46.710772+0000","last_unstale":"2023-06-08T03:48:51.150081+0000","last_undegraded":"2023-06-08T03:48:51.150081+0000","last_fullsized":"2023-06-08T03:48:51.150081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296341+0000","last_change":"2023-06-08T03:48:46.712982+0000","last_active":"2023-06-08T03:48:51.296341+0000","last_peered":"2023-06-08T03:48:51.296341+0000","last_clean":"2023-06-08T03:48:51.296341+0000","last_became_active":"2023-06-08T03:48:46.712737+0000","last_became_peered":"2023-06-08T03:48:46.712737+0000","last_unstale":"2023-06-08T03:48:51.296341+0000","last_undegraded":"2023-06-08T03:48:51.296341+0000","last_fullsized":"2023-06-08T03:48:51.296341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:48.748581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":703779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1760000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.122999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0410000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.9870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5179999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:49:09.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:49:09.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.878+0000 7f47dd2d8700 1 Processor -- start 2023-06-08T03:49:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.878+0000 7f47dd2d8700 1 -- start start 2023-06-08T03:49:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.879+0000 7f47dd2d8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f47d80afa30 0x7f47d80b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47dd2d8700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80b01a0 con 0x7f47d80b0c40 2023-06-08T03:49:09.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47dd2d8700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80b0900 con 0x7f47d80cd980 2023-06-08T03:49:09.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47dd2d8700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d80b06f0 con 0x7f47d80afa30 2023-06-08T03:49:09.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f47d80b0c40 0x7f47d80cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53612/0 (socket says 172.21.15.43:53612) 2023-06-08T03:49:09.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d67fc700 1 -- 172.21.15.43:0/3520889216 learned_addr learned my addr 172.21.15.43:0/3520889216 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:09.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/3520889216 >> v2:172.21.15.135:3300/0 conn(0x7f47d80afa30 0x7f47d80b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021492474 0 0) 0x7f47d80b01a0 con 0x7f47d80b0c40 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c00035b0 con 0x7f47d80b0c40 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 441147670 0 0) 0x7f47c00035b0 con 0x7f47d80b0c40 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 >> v2:172.21.15.135:3300/0 conn(0x7f47d80afa30 msgr2=0x7f47d80b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 --2- 172.21.15.43:0/3520889216 >> v2:172.21.15.135:3300/0 conn(0x7f47d80afa30 0x7f47d80b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 >> v1:172.21.15.135:6789/0 conn(0x7f47d80cd980 legacy=0x7f47d80cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80ca7a0 con 0x7f47d80b0c40 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f47cc001670 con 0x7f47d80b0c40 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 >> v1:172.21.15.43:6789/0 conn(0x7f47d80b0c40 legacy=0x7f47d80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c0004850 0x7f47c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c0005200 0x7f47c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80b06f0 con 0x7f47c0003a00 2023-06-08T03:49:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c000c080 con 0x7f47c0005200 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c000c240 con 0x7f47c0004850 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.880+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d67fc700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c0004850 0x7f47c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d77fe700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c0005200 0x7f47c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d6ffd700 1 -- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c0004850 msgr2=0x7f47c0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c0004850 0x7f47c0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d6ffd700 1 -- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c0005200 msgr2=0x7f47c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c0005200 0x7f47c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d6ffd700 1 -- 172.21.15.43:0/3520889216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00035b0 con 0x7f47c0003a00 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d77fe700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c0005200 0x7f47c000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d77fe700 1 -- 172.21.15.43:0/3520889216 reap_dead start 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47c0003e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009b40 tx=0x7f47c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e028d73db1f8f8e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8005a20 con 0x7f47c0003a00 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8005b80 con 0x7f47c0003a00 2023-06-08T03:49:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.881+0000 7f47d5ffb700 1 -- 172.21.15.43:0/3520889216 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800e6c0 con 0x7f47c0003a00 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 -- 172.21.15.43:0/3520889216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 msgr2=0x7f47c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47c0003e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009b40 tx=0x7f47c0005880 comp rx=0 tx=0).stop 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 -- 172.21.15.43:0/3520889216 shutdown_connections 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/3520889216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47c0003e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 -- 172.21.15.43:0/3520889216 >> 172.21.15.43:0/3520889216 conn(0x7f47d806b7e0 msgr2=0x7f47d80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 -- 172.21.15.43:0/3520889216 shutdown_connections 2023-06-08T03:49:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.882+0000 7f47dd2d8700 1 -- 172.21.15.43:0/3520889216 wait complete. 2023-06-08T03:49:09.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.884+0000 7f47dd2d8700 1 Processor -- start 2023-06-08T03:49:09.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.884+0000 7f47dd2d8700 1 -- start start 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47d80b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47d80b44f0 0x7f47d80c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80c35b0 0x7f47d80b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80c4b90 con 0x7f47c0003a00 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80c3b10 con 0x7f47d80c35b0 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80c3df0 con 0x7f47d80b44f0 2023-06-08T03:49:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47d80b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47d80b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58720/0 (socket says 172.21.15.43:58720) 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 -- 172.21.15.43:0/2961407404 learned_addr learned my addr 172.21.15.43:0/2961407404 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d67fc700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47d80b44f0 0x7f47d80c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d77fe700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80c35b0 0x7f47d80b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 -- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47d80b44f0 msgr2=0x7f47d80c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47d80b44f0 0x7f47d80c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 -- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80c35b0 msgr2=0x7f47d80b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80c35b0 0x7f47d80b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 -- 172.21.15.43:0/2961407404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80c40d0 con 0x7f47c0003a00 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47d6ffd700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47d80b3fb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47c8000c00 tx=0x7f47c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8021070 con 0x7f47c0003a00 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8005e70 con 0x7f47c0003a00 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d80c43b0 con 0x7f47c0003a00 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8004460 con 0x7f47c0003a00 2023-06-08T03:49:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.885+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d8155000 con 0x7f47c0003a00 2023-06-08T03:49:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.887+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d8070d40 con 0x7f47c0003a00 2023-06-08T03:49:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.887+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47c80036a0 con 0x7f47c0003a00 2023-06-08T03:49:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.887+0000 7f47bf7fe700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f47c406ace0 0x7f47c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.888+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f47c808a5f0 con 0x7f47c0003a00 2023-06-08T03:49:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.888+0000 7f47d67fc700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f47c406ace0 0x7f47c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.888+0000 7f47d67fc700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f47c406ace0 0x7f47c406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47d80aeb10 tx=0x7f47cc000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:09.892+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47c8055500 con 0x7f47c0003a00 2023-06-08T03:49:10.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.088+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47d80b0460 con 0x7f47c406ace0 2023-06-08T03:49:10.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.099+0000 7f47bf7fe700 1 -- 172.21.15.43:0/2961407404 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367532 (secure 0 0 0) 0x7f47cc004920 con 0x7f47c406ace0 2023-06-08T03:49:10.106 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:10.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f47c406ace0 msgr2=0x7f47c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f47c406ace0 0x7f47c406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47d80aeb10 tx=0x7f47cc000ed0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 msgr2=0x7f47d80b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47d80b3fb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47c8000c00 tx=0x7f47c80047c0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 shutdown_connections 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f47c406ace0 0x7f47c406d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47c0003a00 0x7f47d80b3fb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80c35b0 0x7f47d80b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 --2- 172.21.15.43:0/2961407404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47d80b44f0 0x7f47d80c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 >> 172.21.15.43:0/2961407404 conn(0x7f47d806b7e0 msgr2=0x7f47d80cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:10.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 shutdown_connections 2023-06-08T03:49:10.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.102+0000 7f47dd2d8700 1 -- 172.21.15.43:0/2961407404 wait complete. 2023-06-08T03:49:10.110 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:49:10.119 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-06-08T03:49:09.568187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":3304,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":3383296,"data_stored":2065128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004002"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535614+0000","last_change":"2023-06-08T03:48:46.695933+0000","last_active":"2023-06-08T03:48:51.535614+0000","last_peered":"2023-06-08T03:48:51.535614+0000","last_clean":"2023-06-08T03:48:51.535614+0000","last_became_active":"2023-06-08T03:48:46.695656+0000","last_became_peered":"2023-06-08T03:48:46.695656+0000","last_unstale":"2023-06-08T03:48:51.535614+0000","last_undegraded":"2023-06-08T03:48:51.535614+0000","last_fullsized":"2023-06-08T03:48:51.535614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:30:50.250635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537474+0000","last_change":"2023-06-08T03:48:46.714866+0000","last_active":"2023-06-08T03:48:51.537474+0000","last_peered":"2023-06-08T03:48:51.537474+0000","last_clean":"2023-06-08T03:48:51.537474+0000","last_became_active":"2023-06-08T03:48:46.714589+0000","last_became_peered":"2023-06-08T03:48:46.714589+0000","last_unstale":"2023-06-08T03:48:51.537474+0000","last_undegraded":"2023-06-08T03:48:51.537474+0000","last_fullsized":"2023-06-08T03:48:51.537474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152613+0000","last_change":"2023-06-08T03:48:46.706256+0000","last_active":"2023-06-08T03:48:51.152613+0000","last_peered":"2023-06-08T03:48:51.152613+0000","last_clean":"2023-06-08T03:48:51.152613+0000","last_became_active":"2023-06-08T03:48:46.705978+0000","last_became_peered":"2023-06-08T03:48:46.705978+0000","last_unstale":"2023-06-08T03:48:51.152613+0000","last_undegraded":"2023-06-08T03:48:51.152613+0000","last_fullsized":"2023-06-08T03:48:51.152613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:22:14.470541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151950+0000","last_change":"2023-06-08T03:48:46.707135+0000","last_active":"2023-06-08T03:48:51.151950+0000","last_peered":"2023-06-08T03:48:51.151950+0000","last_clean":"2023-06-08T03:48:51.151950+0000","last_became_active":"2023-06-08T03:48:46.706761+0000","last_became_peered":"2023-06-08T03:48:46.706761+0000","last_unstale":"2023-06-08T03:48:51.151950+0000","last_undegraded":"2023-06-08T03:48:51.151950+0000","last_fullsized":"2023-06-08T03:48:51.151950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:56.493538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294344+0000","last_change":"2023-06-08T03:48:46.699911+0000","last_active":"2023-06-08T03:48:51.294344+0000","last_peered":"2023-06-08T03:48:51.294344+0000","last_clean":"2023-06-08T03:48:51.294344+0000","last_became_active":"2023-06-08T03:48:46.699664+0000","last_became_peered":"2023-06-08T03:48:46.699664+0000","last_unstale":"2023-06-08T03:48:51.294344+0000","last_undegraded":"2023-06-08T03:48:51.294344+0000","last_fullsized":"2023-06-08T03:48:51.294344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152397+0000","last_change":"2023-06-08T03:48:46.705516+0000","last_active":"2023-06-08T03:48:51.152397+0000","last_peered":"2023-06-08T03:48:51.152397+0000","last_clean":"2023-06-08T03:48:51.152397+0000","last_became_active":"2023-06-08T03:48:46.705065+0000","last_became_peered":"2023-06-08T03:48:46.705065+0000","last_unstale":"2023-06-08T03:48:51.152397+0000","last_undegraded":"2023-06-08T03:48:51.152397+0000","last_fullsized":"2023-06-08T03:48:51.152397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:14:12.765404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536130+0000","last_change":"2023-06-08T03:48:46.715167+0000","last_active":"2023-06-08T03:48:51.536130+0000","last_peered":"2023-06-08T03:48:51.536130+0000","last_clean":"2023-06-08T03:48:51.536130+0000","last_became_active":"2023-06-08T03:48:46.714516+0000","last_became_peered":"2023-06-08T03:48:46.714516+0000","last_unstale":"2023-06-08T03:48:51.536130+0000","last_undegraded":"2023-06-08T03:48:51.536130+0000","last_fullsized":"2023-06-08T03:48:51.536130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535554+0000","last_change":"2023-06-08T03:48:46.711469+0000","last_active":"2023-06-08T03:48:51.535554+0000","last_peered":"2023-06-08T03:48:51.535554+0000","last_clean":"2023-06-08T03:48:51.535554+0000","last_became_active":"2023-06-08T03:48:46.711192+0000","last_became_peered":"2023-06-08T03:48:46.711192+0000","last_unstale":"2023-06-08T03:48:51.535554+0000","last_undegraded":"2023-06-08T03:48:51.535554+0000","last_fullsized":"2023-06-08T03:48:51.535554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294108+0000","last_change":"2023-06-08T03:48:46.699402+0000","last_active":"2023-06-08T03:48:51.294108+0000","last_peered":"2023-06-08T03:48:51.294108+0000","last_clean":"2023-06-08T03:48:51.294108+0000","last_became_active":"2023-06-08T03:48:46.699147+0000","last_became_peered":"2023-06-08T03:48:46.699147+0000","last_unstale":"2023-06-08T03:48:51.294108+0000","last_undegraded":"2023-06-08T03:48:51.294108+0000","last_fullsized":"2023-06-08T03:48:51.294108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537669+0000","last_change":"2023-06-08T03:48:46.704142+0000","last_active":"2023-06-08T03:48:51.537669+0000","last_peered":"2023-06-08T03:48:51.537669+0000","last_clean":"2023-06-08T03:48:51.537669+0000","last_became_active":"2023-06-08T03:48:46.703834+0000","last_became_peered":"2023-06-08T03:48:46.703834+0000","last_unstale":"2023-06-08T03:48:51.537669+0000","last_undegraded":"2023-06-08T03:48:51.537669+0000","last_fullsized":"2023-06-08T03:48:51.537669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152529+0000","last_change":"2023-06-08T03:48:46.714056+0000","last_active":"2023-06-08T03:48:51.152529+0000","last_peered":"2023-06-08T03:48:51.152529+0000","last_clean":"2023-06-08T03:48:51.152529+0000","last_became_active":"2023-06-08T03:48:46.713591+0000","last_became_peered":"2023-06-08T03:48:46.713591+0000","last_unstale":"2023-06-08T03:48:51.152529+0000","last_undegraded":"2023-06-08T03:48:51.152529+0000","last_fullsized":"2023-06-08T03:48:51.152529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:27:27.515952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535329+0000","last_change":"2023-06-08T03:48:46.709172+0000","last_active":"2023-06-08T03:48:51.535329+0000","last_peered":"2023-06-08T03:48:51.535329+0000","last_clean":"2023-06-08T03:48:51.535329+0000","last_became_active":"2023-06-08T03:48:46.708965+0000","last_became_peered":"2023-06-08T03:48:46.708965+0000","last_unstale":"2023-06-08T03:48:51.535329+0000","last_undegraded":"2023-06-08T03:48:51.535329+0000","last_fullsized":"2023-06-08T03:48:51.535329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:08:38.733800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535191+0000","last_change":"2023-06-08T03:48:46.700006+0000","last_active":"2023-06-08T03:48:51.535191+0000","last_peered":"2023-06-08T03:48:51.535191+0000","last_clean":"2023-06-08T03:48:51.535191+0000","last_became_active":"2023-06-08T03:48:46.699757+0000","last_became_peered":"2023-06-08T03:48:46.699757+0000","last_unstale":"2023-06-08T03:48:51.535191+0000","last_undegraded":"2023-06-08T03:48:51.535191+0000","last_fullsized":"2023-06-08T03:48:51.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:03:26.492541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536448+0000","last_change":"2023-06-08T03:48:46.704941+0000","last_active":"2023-06-08T03:48:51.536448+0000","last_peered":"2023-06-08T03:48:51.536448+0000","last_clean":"2023-06-08T03:48:51.536448+0000","last_became_active":"2023-06-08T03:48:46.704597+0000","last_became_peered":"2023-06-08T03:48:46.704597+0000","last_unstale":"2023-06-08T03:48:51.536448+0000","last_undegraded":"2023-06-08T03:48:51.536448+0000","last_fullsized":"2023-06-08T03:48:51.536448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:06.861229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536330+0000","last_change":"2023-06-08T03:48:46.715344+0000","last_active":"2023-06-08T03:48:51.536330+0000","last_peered":"2023-06-08T03:48:51.536330+0000","last_clean":"2023-06-08T03:48:51.536330+0000","last_became_active":"2023-06-08T03:48:46.714900+0000","last_became_peered":"2023-06-08T03:48:46.714900+0000","last_unstale":"2023-06-08T03:48:51.536330+0000","last_undegraded":"2023-06-08T03:48:51.536330+0000","last_fullsized":"2023-06-08T03:48:51.536330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.706828+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.706509+0000","last_became_peered":"2023-06-08T03:48:46.706509+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:46.242079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294194+0000","last_change":"2023-06-08T03:48:46.695842+0000","last_active":"2023-06-08T03:48:51.294194+0000","last_peered":"2023-06-08T03:48:51.294194+0000","last_clean":"2023-06-08T03:48:51.294194+0000","last_became_active":"2023-06-08T03:48:46.695612+0000","last_became_peered":"2023-06-08T03:48:46.695612+0000","last_unstale":"2023-06-08T03:48:51.294194+0000","last_undegraded":"2023-06-08T03:48:51.294194+0000","last_fullsized":"2023-06-08T03:48:51.294194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:20:54.828539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152362+0000","last_change":"2023-06-08T03:48:46.697084+0000","last_active":"2023-06-08T03:48:51.152362+0000","last_peered":"2023-06-08T03:48:51.152362+0000","last_clean":"2023-06-08T03:48:51.152362+0000","last_became_active":"2023-06-08T03:48:46.696841+0000","last_became_peered":"2023-06-08T03:48:46.696841+0000","last_unstale":"2023-06-08T03:48:51.152362+0000","last_undegraded":"2023-06-08T03:48:51.152362+0000","last_fullsized":"2023-06-08T03:48:51.152362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:47.104870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535352+0000","last_change":"2023-06-08T03:48:46.707641+0000","last_active":"2023-06-08T03:48:51.535352+0000","last_peered":"2023-06-08T03:48:51.535352+0000","last_clean":"2023-06-08T03:48:51.535352+0000","last_became_active":"2023-06-08T03:48:46.707211+0000","last_became_peered":"2023-06-08T03:48:46.707211+0000","last_unstale":"2023-06-08T03:48:51.535352+0000","last_undegraded":"2023-06-08T03:48:51.535352+0000","last_fullsized":"2023-06-08T03:48:51.535352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:39.020693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151721+0000","last_change":"2023-06-08T03:48:46.709738+0000","last_active":"2023-06-08T03:48:51.151721+0000","last_peered":"2023-06-08T03:48:51.151721+0000","last_clean":"2023-06-08T03:48:51.151721+0000","last_became_active":"2023-06-08T03:48:46.709340+0000","last_became_peered":"2023-06-08T03:48:46.709340+0000","last_unstale":"2023-06-08T03:48:51.151721+0000","last_undegraded":"2023-06-08T03:48:51.151721+0000","last_fullsized":"2023-06-08T03:48:51.151721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:23.681916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536282+0000","last_change":"2023-06-08T03:48:46.709790+0000","last_active":"2023-06-08T03:48:51.536282+0000","last_peered":"2023-06-08T03:48:51.536282+0000","last_clean":"2023-06-08T03:48:51.536282+0000","last_became_active":"2023-06-08T03:48:46.709528+0000","last_became_peered":"2023-06-08T03:48:46.709528+0000","last_unstale":"2023-06-08T03:48:51.536282+0000","last_undegraded":"2023-06-08T03:48:51.536282+0000","last_fullsized":"2023-06-08T03:48:51.536282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:53.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293720+0000","last_change":"2023-06-08T03:48:46.712267+0000","last_active":"2023-06-08T03:48:51.293720+0000","last_peered":"2023-06-08T03:48:51.293720+0000","last_clean":"2023-06-08T03:48:51.293720+0000","last_became_active":"2023-06-08T03:48:46.712008+0000","last_became_peered":"2023-06-08T03:48:46.712008+0000","last_unstale":"2023-06-08T03:48:51.293720+0000","last_undegraded":"2023-06-08T03:48:51.293720+0000","last_fullsized":"2023-06-08T03:48:51.293720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:15.552998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149899+0000","last_change":"2023-06-08T03:48:46.699795+0000","last_active":"2023-06-08T03:48:51.149899+0000","last_peered":"2023-06-08T03:48:51.149899+0000","last_clean":"2023-06-08T03:48:51.149899+0000","last_became_active":"2023-06-08T03:48:46.699537+0000","last_became_peered":"2023-06-08T03:48:46.699537+0000","last_unstale":"2023-06-08T03:48:51.149899+0000","last_undegraded":"2023-06-08T03:48:51.149899+0000","last_fullsized":"2023-06-08T03:48:51.149899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535864+0000","last_change":"2023-06-08T03:48:46.710846+0000","last_active":"2023-06-08T03:48:51.535864+0000","last_peered":"2023-06-08T03:48:51.535864+0000","last_clean":"2023-06-08T03:48:51.535864+0000","last_became_active":"2023-06-08T03:48:46.710550+0000","last_became_peered":"2023-06-08T03:48:46.710550+0000","last_unstale":"2023-06-08T03:48:51.535864+0000","last_undegraded":"2023-06-08T03:48:51.535864+0000","last_fullsized":"2023-06-08T03:48:51.535864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:13.118230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297076+0000","last_change":"2023-06-08T03:48:46.713844+0000","last_active":"2023-06-08T03:48:51.297076+0000","last_peered":"2023-06-08T03:48:51.297076+0000","last_clean":"2023-06-08T03:48:51.297076+0000","last_became_active":"2023-06-08T03:48:46.713550+0000","last_became_peered":"2023-06-08T03:48:46.713550+0000","last_unstale":"2023-06-08T03:48:51.297076+0000","last_undegraded":"2023-06-08T03:48:51.297076+0000","last_fullsized":"2023-06-08T03:48:51.297076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:06.159783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296797+0000","last_change":"2023-06-08T03:48:46.711918+0000","last_active":"2023-06-08T03:48:51.296797+0000","last_peered":"2023-06-08T03:48:51.296797+0000","last_clean":"2023-06-08T03:48:51.296797+0000","last_became_active":"2023-06-08T03:48:46.711662+0000","last_became_peered":"2023-06-08T03:48:46.711662+0000","last_unstale":"2023-06-08T03:48:51.296797+0000","last_undegraded":"2023-06-08T03:48:51.296797+0000","last_fullsized":"2023-06-08T03:48:51.296797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:40.934017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537069+0000","last_change":"2023-06-08T03:48:46.708436+0000","last_active":"2023-06-08T03:48:51.537069+0000","last_peered":"2023-06-08T03:48:51.537069+0000","last_clean":"2023-06-08T03:48:51.537069+0000","last_became_active":"2023-06-08T03:48:46.708003+0000","last_became_peered":"2023-06-08T03:48:46.708003+0000","last_unstale":"2023-06-08T03:48:51.537069+0000","last_undegraded":"2023-06-08T03:48:51.537069+0000","last_fullsized":"2023-06-08T03:48:51.537069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:33.522665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152308+0000","last_change":"2023-06-08T03:48:50.740643+0000","last_active":"2023-06-08T03:48:51.152308+0000","last_peered":"2023-06-08T03:48:51.152308+0000","last_clean":"2023-06-08T03:48:51.152308+0000","last_became_active":"2023-06-08T03:48:50.740283+0000","last_became_peered":"2023-06-08T03:48:50.740283+0000","last_unstale":"2023-06-08T03:48:51.152308+0000","last_undegraded":"2023-06-08T03:48:51.152308+0000","last_fullsized":"2023-06-08T03:48:51.152308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:09:55.615848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152091+0000","last_change":"2023-06-08T03:48:46.278224+0000","last_active":"2023-06-08T03:48:51.152091+0000","last_peered":"2023-06-08T03:48:51.152091+0000","last_clean":"2023-06-08T03:48:51.152091+0000","last_became_active":"2023-06-08T03:48:46.277952+0000","last_became_peered":"2023-06-08T03:48:46.277952+0000","last_unstale":"2023-06-08T03:48:51.152091+0000","last_undegraded":"2023-06-08T03:48:51.152091+0000","last_fullsized":"2023-06-08T03:48:51.152091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:10:42.875919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150566+0000","last_change":"2023-06-08T03:48:46.712050+0000","last_active":"2023-06-08T03:48:51.150566+0000","last_peered":"2023-06-08T03:48:51.150566+0000","last_clean":"2023-06-08T03:48:51.150566+0000","last_became_active":"2023-06-08T03:48:46.711791+0000","last_became_peered":"2023-06-08T03:48:46.711791+0000","last_unstale":"2023-06-08T03:48:51.150566+0000","last_undegraded":"2023-06-08T03:48:51.150566+0000","last_fullsized":"2023-06-08T03:48:51.150566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:48.552832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151606+0000","last_change":"2023-06-08T03:48:50.739355+0000","last_active":"2023-06-08T03:48:51.151606+0000","last_peered":"2023-06-08T03:48:51.151606+0000","last_clean":"2023-06-08T03:48:51.151606+0000","last_became_active":"2023-06-08T03:48:50.738867+0000","last_became_peered":"2023-06-08T03:48:50.738867+0000","last_unstale":"2023-06-08T03:48:51.151606+0000","last_undegraded":"2023-06-08T03:48:51.151606+0000","last_fullsized":"2023-06-08T03:48:51.151606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:39.206726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296216+0000","last_change":"2023-06-08T03:48:46.277487+0000","last_active":"2023-06-08T03:48:51.296216+0000","last_peered":"2023-06-08T03:48:51.296216+0000","last_clean":"2023-06-08T03:48:51.296216+0000","last_became_active":"2023-06-08T03:48:46.277147+0000","last_became_peered":"2023-06-08T03:48:46.277147+0000","last_unstale":"2023-06-08T03:48:51.296216+0000","last_undegraded":"2023-06-08T03:48:51.296216+0000","last_fullsized":"2023-06-08T03:48:51.296216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:15.249130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294014+0000","last_change":"2023-06-08T03:48:46.698321+0000","last_active":"2023-06-08T03:48:51.294014+0000","last_peered":"2023-06-08T03:48:51.294014+0000","last_clean":"2023-06-08T03:48:51.294014+0000","last_became_active":"2023-06-08T03:48:46.698051+0000","last_became_peered":"2023-06-08T03:48:46.698051+0000","last_unstale":"2023-06-08T03:48:51.294014+0000","last_undegraded":"2023-06-08T03:48:51.294014+0000","last_fullsized":"2023-06-08T03:48:51.294014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294220+0000","last_change":"2023-06-08T03:48:50.747722+0000","last_active":"2023-06-08T03:48:51.294220+0000","last_peered":"2023-06-08T03:48:51.294220+0000","last_clean":"2023-06-08T03:48:51.294220+0000","last_became_active":"2023-06-08T03:48:50.747297+0000","last_became_peered":"2023-06-08T03:48:50.747297+0000","last_unstale":"2023-06-08T03:48:51.294220+0000","last_undegraded":"2023-06-08T03:48:51.294220+0000","last_fullsized":"2023-06-08T03:48:51.294220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:08:44.335450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150061+0000","last_change":"2023-06-08T03:48:46.276409+0000","last_active":"2023-06-08T03:48:51.150061+0000","last_peered":"2023-06-08T03:48:51.150061+0000","last_clean":"2023-06-08T03:48:51.150061+0000","last_became_active":"2023-06-08T03:48:46.276099+0000","last_became_peered":"2023-06-08T03:48:46.276099+0000","last_unstale":"2023-06-08T03:48:51.150061+0000","last_undegraded":"2023-06-08T03:48:51.150061+0000","last_fullsized":"2023-06-08T03:48:51.150061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:32.517367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151843+0000","last_change":"2023-06-08T03:48:46.707301+0000","last_active":"2023-06-08T03:48:51.151843+0000","last_peered":"2023-06-08T03:48:51.151843+0000","last_clean":"2023-06-08T03:48:51.151843+0000","last_became_active":"2023-06-08T03:48:46.706988+0000","last_became_peered":"2023-06-08T03:48:46.706988+0000","last_unstale":"2023-06-08T03:48:51.151843+0000","last_undegraded":"2023-06-08T03:48:51.151843+0000","last_fullsized":"2023-06-08T03:48:51.151843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151210+0000","last_change":"2023-06-08T03:48:50.741708+0000","last_active":"2023-06-08T03:48:51.151210+0000","last_peered":"2023-06-08T03:48:51.151210+0000","last_clean":"2023-06-08T03:48:51.151210+0000","last_became_active":"2023-06-08T03:48:50.741299+0000","last_became_peered":"2023-06-08T03:48:50.741299+0000","last_unstale":"2023-06-08T03:48:51.151210+0000","last_undegraded":"2023-06-08T03:48:51.151210+0000","last_fullsized":"2023-06-08T03:48:51.151210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:13:01.589674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294322+0000","last_change":"2023-06-08T03:48:46.281457+0000","last_active":"2023-06-08T03:48:51.294322+0000","last_peered":"2023-06-08T03:48:51.294322+0000","last_clean":"2023-06-08T03:48:51.294322+0000","last_became_active":"2023-06-08T03:48:46.279939+0000","last_became_peered":"2023-06-08T03:48:46.279939+0000","last_unstale":"2023-06-08T03:48:51.294322+0000","last_undegraded":"2023-06-08T03:48:51.294322+0000","last_fullsized":"2023-06-08T03:48:51.294322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149914+0000","last_change":"2023-06-08T03:48:46.712616+0000","last_active":"2023-06-08T03:48:51.149914+0000","last_peered":"2023-06-08T03:48:51.149914+0000","last_clean":"2023-06-08T03:48:51.149914+0000","last_became_active":"2023-06-08T03:48:46.712276+0000","last_became_peered":"2023-06-08T03:48:46.712276+0000","last_unstale":"2023-06-08T03:48:51.149914+0000","last_undegraded":"2023-06-08T03:48:51.149914+0000","last_fullsized":"2023-06-08T03:48:51.149914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:01.718524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535551+0000","last_change":"2023-06-08T03:48:50.740006+0000","last_active":"2023-06-08T03:48:51.535551+0000","last_peered":"2023-06-08T03:48:51.535551+0000","last_clean":"2023-06-08T03:48:51.535551+0000","last_became_active":"2023-06-08T03:48:50.739564+0000","last_became_peered":"2023-06-08T03:48:50.739564+0000","last_unstale":"2023-06-08T03:48:51.535551+0000","last_undegraded":"2023-06-08T03:48:51.535551+0000","last_fullsized":"2023-06-08T03:48:51.535551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:05.176785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537564+0000","last_change":"2023-06-08T03:48:46.280740+0000","last_active":"2023-06-08T03:48:51.537564+0000","last_peered":"2023-06-08T03:48:51.537564+0000","last_clean":"2023-06-08T03:48:51.537564+0000","last_became_active":"2023-06-08T03:48:46.280343+0000","last_became_peered":"2023-06-08T03:48:46.280343+0000","last_unstale":"2023-06-08T03:48:51.537564+0000","last_undegraded":"2023-06-08T03:48:51.537564+0000","last_fullsized":"2023-06-08T03:48:51.537564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:52.150651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149747+0000","last_change":"2023-06-08T03:48:46.705918+0000","last_active":"2023-06-08T03:48:51.149747+0000","last_peered":"2023-06-08T03:48:51.149747+0000","last_clean":"2023-06-08T03:48:51.149747+0000","last_became_active":"2023-06-08T03:48:46.704743+0000","last_became_peered":"2023-06-08T03:48:46.704743+0000","last_unstale":"2023-06-08T03:48:51.149747+0000","last_undegraded":"2023-06-08T03:48:51.149747+0000","last_fullsized":"2023-06-08T03:48:51.149747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:45:00.911565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150382+0000","last_change":"2023-06-08T03:48:50.743251+0000","last_active":"2023-06-08T03:48:51.150382+0000","last_peered":"2023-06-08T03:48:51.150382+0000","last_clean":"2023-06-08T03:48:51.150382+0000","last_became_active":"2023-06-08T03:48:50.742850+0000","last_became_peered":"2023-06-08T03:48:50.742850+0000","last_unstale":"2023-06-08T03:48:51.150382+0000","last_undegraded":"2023-06-08T03:48:51.150382+0000","last_fullsized":"2023-06-08T03:48:51.150382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:14:16.576491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536288+0000","last_change":"2023-06-08T03:48:46.278683+0000","last_active":"2023-06-08T03:48:51.536288+0000","last_peered":"2023-06-08T03:48:51.536288+0000","last_clean":"2023-06-08T03:48:51.536288+0000","last_became_active":"2023-06-08T03:48:46.278372+0000","last_became_peered":"2023-06-08T03:48:46.278372+0000","last_unstale":"2023-06-08T03:48:51.536288+0000","last_undegraded":"2023-06-08T03:48:51.536288+0000","last_fullsized":"2023-06-08T03:48:51.536288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:07.547618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296438+0000","last_change":"2023-06-08T03:48:46.712049+0000","last_active":"2023-06-08T03:48:51.296438+0000","last_peered":"2023-06-08T03:48:51.296438+0000","last_clean":"2023-06-08T03:48:51.296438+0000","last_became_active":"2023-06-08T03:48:46.711788+0000","last_became_peered":"2023-06-08T03:48:46.711788+0000","last_unstale":"2023-06-08T03:48:51.296438+0000","last_undegraded":"2023-06-08T03:48:51.296438+0000","last_fullsized":"2023-06-08T03:48:51.296438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296638+0000","last_change":"2023-06-08T03:48:50.741729+0000","last_active":"2023-06-08T03:48:51.296638+0000","last_peered":"2023-06-08T03:48:51.296638+0000","last_clean":"2023-06-08T03:48:51.296638+0000","last_became_active":"2023-06-08T03:48:50.741267+0000","last_became_peered":"2023-06-08T03:48:50.741267+0000","last_unstale":"2023-06-08T03:48:51.296638+0000","last_undegraded":"2023-06-08T03:48:51.296638+0000","last_fullsized":"2023-06-08T03:48:51.296638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:56.191756+0000","last_change":"2023-06-08T03:48:46.279495+0000","last_active":"2023-06-08T03:48:56.191756+0000","last_peered":"2023-06-08T03:48:56.191756+0000","last_clean":"2023-06-08T03:48:56.191756+0000","last_became_active":"2023-06-08T03:48:46.279119+0000","last_became_peered":"2023-06-08T03:48:46.279119+0000","last_unstale":"2023-06-08T03:48:56.191756+0000","last_undegraded":"2023-06-08T03:48:56.191756+0000","last_fullsized":"2023-06-08T03:48:56.191756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:02.149567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152693+0000","last_change":"2023-06-08T03:48:46.708107+0000","last_active":"2023-06-08T03:48:51.152693+0000","last_peered":"2023-06-08T03:48:51.152693+0000","last_clean":"2023-06-08T03:48:51.152693+0000","last_became_active":"2023-06-08T03:48:46.707899+0000","last_became_peered":"2023-06-08T03:48:46.707899+0000","last_unstale":"2023-06-08T03:48:51.152693+0000","last_undegraded":"2023-06-08T03:48:51.152693+0000","last_fullsized":"2023-06-08T03:48:51.152693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:39:42.981044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537245+0000","last_change":"2023-06-08T03:48:50.745708+0000","last_active":"2023-06-08T03:48:51.537245+0000","last_peered":"2023-06-08T03:48:51.537245+0000","last_clean":"2023-06-08T03:48:51.537245+0000","last_became_active":"2023-06-08T03:48:50.742554+0000","last_became_peered":"2023-06-08T03:48:50.742554+0000","last_unstale":"2023-06-08T03:48:51.537245+0000","last_undegraded":"2023-06-08T03:48:51.537245+0000","last_fullsized":"2023-06-08T03:48:51.537245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:39.476075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535988+0000","last_change":"2023-06-08T03:48:46.285246+0000","last_active":"2023-06-08T03:48:51.535988+0000","last_peered":"2023-06-08T03:48:51.535988+0000","last_clean":"2023-06-08T03:48:51.535988+0000","last_became_active":"2023-06-08T03:48:46.284966+0000","last_became_peered":"2023-06-08T03:48:46.284966+0000","last_unstale":"2023-06-08T03:48:51.535988+0000","last_undegraded":"2023-06-08T03:48:51.535988+0000","last_fullsized":"2023-06-08T03:48:51.535988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150409+0000","last_change":"2023-06-08T03:48:46.716123+0000","last_active":"2023-06-08T03:48:51.150409+0000","last_peered":"2023-06-08T03:48:51.150409+0000","last_clean":"2023-06-08T03:48:51.150409+0000","last_became_active":"2023-06-08T03:48:46.715806+0000","last_became_peered":"2023-06-08T03:48:46.715806+0000","last_unstale":"2023-06-08T03:48:51.150409+0000","last_undegraded":"2023-06-08T03:48:51.150409+0000","last_fullsized":"2023-06-08T03:48:51.150409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:08.552917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150674+0000","last_change":"2023-06-08T03:48:50.742064+0000","last_active":"2023-06-08T03:48:51.150674+0000","last_peered":"2023-06-08T03:48:51.150674+0000","last_clean":"2023-06-08T03:48:51.150674+0000","last_became_active":"2023-06-08T03:48:50.741695+0000","last_became_peered":"2023-06-08T03:48:50.741695+0000","last_unstale":"2023-06-08T03:48:51.150674+0000","last_undegraded":"2023-06-08T03:48:51.150674+0000","last_fullsized":"2023-06-08T03:48:51.150674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:07.233826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294053+0000","last_change":"2023-06-08T03:48:46.278885+0000","last_active":"2023-06-08T03:48:51.294053+0000","last_peered":"2023-06-08T03:48:51.294053+0000","last_clean":"2023-06-08T03:48:51.294053+0000","last_became_active":"2023-06-08T03:48:46.278561+0000","last_became_peered":"2023-06-08T03:48:46.278561+0000","last_unstale":"2023-06-08T03:48:51.294053+0000","last_undegraded":"2023-06-08T03:48:51.294053+0000","last_fullsized":"2023-06-08T03:48:51.294053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:06:31.293995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537077+0000","last_change":"2023-06-08T03:48:46.708244+0000","last_active":"2023-06-08T03:48:51.537077+0000","last_peered":"2023-06-08T03:48:51.537077+0000","last_clean":"2023-06-08T03:48:51.537077+0000","last_became_active":"2023-06-08T03:48:46.707643+0000","last_became_peered":"2023-06-08T03:48:46.707643+0000","last_unstale":"2023-06-08T03:48:51.537077+0000","last_undegraded":"2023-06-08T03:48:51.537077+0000","last_fullsized":"2023-06-08T03:48:51.537077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150661+0000","last_change":"2023-06-08T03:48:50.745965+0000","last_active":"2023-06-08T03:48:51.150661+0000","last_peered":"2023-06-08T03:48:51.150661+0000","last_clean":"2023-06-08T03:48:51.150661+0000","last_became_active":"2023-06-08T03:48:50.745561+0000","last_became_peered":"2023-06-08T03:48:50.745561+0000","last_unstale":"2023-06-08T03:48:51.150661+0000","last_undegraded":"2023-06-08T03:48:51.150661+0000","last_fullsized":"2023-06-08T03:48:51.150661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:37.313561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535839+0000","last_change":"2023-06-08T03:48:46.284576+0000","last_active":"2023-06-08T03:48:51.535839+0000","last_peered":"2023-06-08T03:48:51.535839+0000","last_clean":"2023-06-08T03:48:51.535839+0000","last_became_active":"2023-06-08T03:48:46.284324+0000","last_became_peered":"2023-06-08T03:48:46.284324+0000","last_unstale":"2023-06-08T03:48:51.535839+0000","last_undegraded":"2023-06-08T03:48:51.535839+0000","last_fullsized":"2023-06-08T03:48:51.535839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294519+0000","last_change":"2023-06-08T03:48:46.699501+0000","last_active":"2023-06-08T03:48:51.294519+0000","last_peered":"2023-06-08T03:48:51.294519+0000","last_clean":"2023-06-08T03:48:51.294519+0000","last_became_active":"2023-06-08T03:48:46.699227+0000","last_became_peered":"2023-06-08T03:48:46.699227+0000","last_unstale":"2023-06-08T03:48:51.294519+0000","last_undegraded":"2023-06-08T03:48:51.294519+0000","last_fullsized":"2023-06-08T03:48:51.294519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:44.027633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536807+0000","last_change":"2023-06-08T03:48:50.752340+0000","last_active":"2023-06-08T03:48:51.536807+0000","last_peered":"2023-06-08T03:48:51.536807+0000","last_clean":"2023-06-08T03:48:51.536807+0000","last_became_active":"2023-06-08T03:48:50.751962+0000","last_became_peered":"2023-06-08T03:48:50.751962+0000","last_unstale":"2023-06-08T03:48:51.536807+0000","last_undegraded":"2023-06-08T03:48:51.536807+0000","last_fullsized":"2023-06-08T03:48:51.536807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:48.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151454+0000","last_change":"2023-06-08T03:48:46.274849+0000","last_active":"2023-06-08T03:48:51.151454+0000","last_peered":"2023-06-08T03:48:51.151454+0000","last_clean":"2023-06-08T03:48:51.151454+0000","last_became_active":"2023-06-08T03:48:46.274502+0000","last_became_peered":"2023-06-08T03:48:46.274502+0000","last_unstale":"2023-06-08T03:48:51.151454+0000","last_undegraded":"2023-06-08T03:48:51.151454+0000","last_fullsized":"2023-06-08T03:48:51.151454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:22:56.444477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150868+0000","last_change":"2023-06-08T03:48:46.704969+0000","last_active":"2023-06-08T03:48:51.150868+0000","last_peered":"2023-06-08T03:48:51.150868+0000","last_clean":"2023-06-08T03:48:51.150868+0000","last_became_active":"2023-06-08T03:48:46.704688+0000","last_became_peered":"2023-06-08T03:48:46.704688+0000","last_unstale":"2023-06-08T03:48:51.150868+0000","last_undegraded":"2023-06-08T03:48:51.150868+0000","last_fullsized":"2023-06-08T03:48:51.150868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:34:03.154866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536425+0000","last_change":"2023-06-08T03:48:50.751168+0000","last_active":"2023-06-08T03:48:51.536425+0000","last_peered":"2023-06-08T03:48:51.536425+0000","last_clean":"2023-06-08T03:48:51.536425+0000","last_became_active":"2023-06-08T03:48:50.750781+0000","last_became_peered":"2023-06-08T03:48:50.750781+0000","last_unstale":"2023-06-08T03:48:51.536425+0000","last_undegraded":"2023-06-08T03:48:51.536425+0000","last_fullsized":"2023-06-08T03:48:51.536425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:59.334663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536464+0000","last_change":"2023-06-08T03:48:46.284225+0000","last_active":"2023-06-08T03:48:51.536464+0000","last_peered":"2023-06-08T03:48:51.536464+0000","last_clean":"2023-06-08T03:48:51.536464+0000","last_became_active":"2023-06-08T03:48:46.283964+0000","last_became_peered":"2023-06-08T03:48:46.283964+0000","last_unstale":"2023-06-08T03:48:51.536464+0000","last_undegraded":"2023-06-08T03:48:51.536464+0000","last_fullsized":"2023-06-08T03:48:51.536464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:02.770266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535467+0000","last_change":"2023-06-08T03:48:46.705264+0000","last_active":"2023-06-08T03:48:51.535467+0000","last_peered":"2023-06-08T03:48:51.535467+0000","last_clean":"2023-06-08T03:48:51.535467+0000","last_became_active":"2023-06-08T03:48:46.704968+0000","last_became_peered":"2023-06-08T03:48:46.704968+0000","last_unstale":"2023-06-08T03:48:51.535467+0000","last_undegraded":"2023-06-08T03:48:51.535467+0000","last_fullsized":"2023-06-08T03:48:51.535467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:19.849225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535037+0000","last_change":"2023-06-08T03:48:50.747984+0000","last_active":"2023-06-08T03:48:51.535037+0000","last_peered":"2023-06-08T03:48:51.535037+0000","last_clean":"2023-06-08T03:48:51.535037+0000","last_became_active":"2023-06-08T03:48:50.747678+0000","last_became_peered":"2023-06-08T03:48:50.747678+0000","last_unstale":"2023-06-08T03:48:51.535037+0000","last_undegraded":"2023-06-08T03:48:51.535037+0000","last_fullsized":"2023-06-08T03:48:51.535037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:20:02.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536442+0000","last_change":"2023-06-08T03:48:46.284040+0000","last_active":"2023-06-08T03:48:51.536442+0000","last_peered":"2023-06-08T03:48:51.536442+0000","last_clean":"2023-06-08T03:48:51.536442+0000","last_became_active":"2023-06-08T03:48:46.283769+0000","last_became_peered":"2023-06-08T03:48:46.283769+0000","last_unstale":"2023-06-08T03:48:51.536442+0000","last_undegraded":"2023-06-08T03:48:51.536442+0000","last_fullsized":"2023-06-08T03:48:51.536442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:32.850002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151726+0000","last_change":"2023-06-08T03:48:46.714226+0000","last_active":"2023-06-08T03:48:51.151726+0000","last_peered":"2023-06-08T03:48:51.151726+0000","last_clean":"2023-06-08T03:48:51.151726+0000","last_became_active":"2023-06-08T03:48:46.713960+0000","last_became_peered":"2023-06-08T03:48:46.713960+0000","last_unstale":"2023-06-08T03:48:51.151726+0000","last_undegraded":"2023-06-08T03:48:51.151726+0000","last_fullsized":"2023-06-08T03:48:51.151726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:27:56.879349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535261+0000","last_change":"2023-06-08T03:48:50.746373+0000","last_active":"2023-06-08T03:48:51.535261+0000","last_peered":"2023-06-08T03:48:51.535261+0000","last_clean":"2023-06-08T03:48:51.535261+0000","last_became_active":"2023-06-08T03:48:50.745785+0000","last_became_peered":"2023-06-08T03:48:50.745785+0000","last_unstale":"2023-06-08T03:48:51.535261+0000","last_undegraded":"2023-06-08T03:48:51.535261+0000","last_fullsized":"2023-06-08T03:48:51.535261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:46:48.225879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536088+0000","last_change":"2023-06-08T03:48:46.280813+0000","last_active":"2023-06-08T03:48:51.536088+0000","last_peered":"2023-06-08T03:48:51.536088+0000","last_clean":"2023-06-08T03:48:51.536088+0000","last_became_active":"2023-06-08T03:48:46.280534+0000","last_became_peered":"2023-06-08T03:48:46.280534+0000","last_unstale":"2023-06-08T03:48:51.536088+0000","last_undegraded":"2023-06-08T03:48:51.536088+0000","last_fullsized":"2023-06-08T03:48:51.536088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:41.910566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152106+0000","last_change":"2023-06-08T03:48:46.716189+0000","last_active":"2023-06-08T03:48:51.152106+0000","last_peered":"2023-06-08T03:48:51.152106+0000","last_clean":"2023-06-08T03:48:51.152106+0000","last_became_active":"2023-06-08T03:48:46.715886+0000","last_became_peered":"2023-06-08T03:48:46.715886+0000","last_unstale":"2023-06-08T03:48:51.152106+0000","last_undegraded":"2023-06-08T03:48:51.152106+0000","last_fullsized":"2023-06-08T03:48:51.152106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:58:18.788556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.739296+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.738841+0000","last_became_peered":"2023-06-08T03:48:50.738841+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:50.270846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536854+0000","last_change":"2023-06-08T03:48:46.279229+0000","last_active":"2023-06-08T03:48:51.536854+0000","last_peered":"2023-06-08T03:48:51.536854+0000","last_clean":"2023-06-08T03:48:51.536854+0000","last_became_active":"2023-06-08T03:48:46.278915+0000","last_became_peered":"2023-06-08T03:48:46.278915+0000","last_unstale":"2023-06-08T03:48:51.536854+0000","last_undegraded":"2023-06-08T03:48:51.536854+0000","last_fullsized":"2023-06-08T03:48:51.536854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294432+0000","last_change":"2023-06-08T03:48:46.712160+0000","last_active":"2023-06-08T03:48:51.294432+0000","last_peered":"2023-06-08T03:48:51.294432+0000","last_clean":"2023-06-08T03:48:51.294432+0000","last_became_active":"2023-06-08T03:48:46.711866+0000","last_became_peered":"2023-06-08T03:48:46.711866+0000","last_unstale":"2023-06-08T03:48:51.294432+0000","last_undegraded":"2023-06-08T03:48:51.294432+0000","last_fullsized":"2023-06-08T03:48:51.294432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535241+0000","last_change":"2023-06-08T03:48:50.746274+0000","last_active":"2023-06-08T03:48:51.535241+0000","last_peered":"2023-06-08T03:48:51.535241+0000","last_clean":"2023-06-08T03:48:51.535241+0000","last_became_active":"2023-06-08T03:48:50.745820+0000","last_became_peered":"2023-06-08T03:48:50.745820+0000","last_unstale":"2023-06-08T03:48:51.535241+0000","last_undegraded":"2023-06-08T03:48:51.535241+0000","last_fullsized":"2023-06-08T03:48:51.535241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:59:19.751648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150205+0000","last_change":"2023-06-08T03:48:46.276528+0000","last_active":"2023-06-08T03:48:51.150205+0000","last_peered":"2023-06-08T03:48:51.150205+0000","last_clean":"2023-06-08T03:48:51.150205+0000","last_became_active":"2023-06-08T03:48:46.276141+0000","last_became_peered":"2023-06-08T03:48:46.276141+0000","last_unstale":"2023-06-08T03:48:51.150205+0000","last_undegraded":"2023-06-08T03:48:51.150205+0000","last_fullsized":"2023-06-08T03:48:51.150205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:35.012515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151420+0000","last_change":"2023-06-08T03:48:46.709069+0000","last_active":"2023-06-08T03:48:51.151420+0000","last_peered":"2023-06-08T03:48:51.151420+0000","last_clean":"2023-06-08T03:48:51.151420+0000","last_became_active":"2023-06-08T03:48:46.708427+0000","last_became_peered":"2023-06-08T03:48:46.708427+0000","last_unstale":"2023-06-08T03:48:51.151420+0000","last_undegraded":"2023-06-08T03:48:51.151420+0000","last_fullsized":"2023-06-08T03:48:51.151420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:05:33.855300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296822+0000","last_change":"2023-06-08T03:48:50.744633+0000","last_active":"2023-06-08T03:48:51.296822+0000","last_peered":"2023-06-08T03:48:51.296822+0000","last_clean":"2023-06-08T03:48:51.296822+0000","last_became_active":"2023-06-08T03:48:50.744230+0000","last_became_peered":"2023-06-08T03:48:50.744230+0000","last_unstale":"2023-06-08T03:48:51.296822+0000","last_undegraded":"2023-06-08T03:48:51.296822+0000","last_fullsized":"2023-06-08T03:48:51.296822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:04.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152143+0000","last_change":"2023-06-08T03:48:46.277921+0000","last_active":"2023-06-08T03:48:51.152143+0000","last_peered":"2023-06-08T03:48:51.152143+0000","last_clean":"2023-06-08T03:48:51.152143+0000","last_became_active":"2023-06-08T03:48:46.277634+0000","last_became_peered":"2023-06-08T03:48:46.277634+0000","last_unstale":"2023-06-08T03:48:51.152143+0000","last_undegraded":"2023-06-08T03:48:51.152143+0000","last_fullsized":"2023-06-08T03:48:51.152143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:20.682736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152053+0000","last_change":"2023-06-08T03:48:46.706196+0000","last_active":"2023-06-08T03:48:51.152053+0000","last_peered":"2023-06-08T03:48:51.152053+0000","last_clean":"2023-06-08T03:48:51.152053+0000","last_became_active":"2023-06-08T03:48:46.705906+0000","last_became_peered":"2023-06-08T03:48:46.705906+0000","last_unstale":"2023-06-08T03:48:51.152053+0000","last_undegraded":"2023-06-08T03:48:51.152053+0000","last_fullsized":"2023-06-08T03:48:51.152053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:02:18.561814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537144+0000","last_change":"2023-06-08T03:48:50.747319+0000","last_active":"2023-06-08T03:48:51.537144+0000","last_peered":"2023-06-08T03:48:51.537144+0000","last_clean":"2023-06-08T03:48:51.537144+0000","last_became_active":"2023-06-08T03:48:50.746943+0000","last_became_peered":"2023-06-08T03:48:50.746943+0000","last_unstale":"2023-06-08T03:48:51.537144+0000","last_undegraded":"2023-06-08T03:48:51.537144+0000","last_fullsized":"2023-06-08T03:48:51.537144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:46.374125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151194+0000","last_change":"2023-06-08T03:48:46.277755+0000","last_active":"2023-06-08T03:48:51.151194+0000","last_peered":"2023-06-08T03:48:51.151194+0000","last_clean":"2023-06-08T03:48:51.151194+0000","last_became_active":"2023-06-08T03:48:46.277421+0000","last_became_peered":"2023-06-08T03:48:46.277421+0000","last_unstale":"2023-06-08T03:48:51.151194+0000","last_undegraded":"2023-06-08T03:48:51.151194+0000","last_fullsized":"2023-06-08T03:48:51.151194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.153481+0000","last_change":"2023-06-08T03:48:46.708084+0000","last_active":"2023-06-08T03:48:51.153481+0000","last_peered":"2023-06-08T03:48:51.153481+0000","last_clean":"2023-06-08T03:48:51.153481+0000","last_became_active":"2023-06-08T03:48:46.707810+0000","last_became_peered":"2023-06-08T03:48:46.707810+0000","last_unstale":"2023-06-08T03:48:51.153481+0000","last_undegraded":"2023-06-08T03:48:51.153481+0000","last_fullsized":"2023-06-08T03:48:51.153481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:42:31.285512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151893+0000","last_change":"2023-06-08T03:48:50.746365+0000","last_active":"2023-06-08T03:48:51.151893+0000","last_peered":"2023-06-08T03:48:51.151893+0000","last_clean":"2023-06-08T03:48:51.151893+0000","last_became_active":"2023-06-08T03:48:50.745965+0000","last_became_peered":"2023-06-08T03:48:50.745965+0000","last_unstale":"2023-06-08T03:48:51.151893+0000","last_undegraded":"2023-06-08T03:48:51.151893+0000","last_fullsized":"2023-06-08T03:48:51.151893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:50:52.715702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149902+0000","last_change":"2023-06-08T03:48:46.281571+0000","last_active":"2023-06-08T03:48:51.149902+0000","last_peered":"2023-06-08T03:48:51.149902+0000","last_clean":"2023-06-08T03:48:51.149902+0000","last_became_active":"2023-06-08T03:48:46.281171+0000","last_became_peered":"2023-06-08T03:48:46.281171+0000","last_unstale":"2023-06-08T03:48:51.149902+0000","last_undegraded":"2023-06-08T03:48:51.149902+0000","last_fullsized":"2023-06-08T03:48:51.149902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297204+0000","last_change":"2023-06-08T03:48:46.705939+0000","last_active":"2023-06-08T03:48:51.297204+0000","last_peered":"2023-06-08T03:48:51.297204+0000","last_clean":"2023-06-08T03:48:51.297204+0000","last_became_active":"2023-06-08T03:48:46.705467+0000","last_became_peered":"2023-06-08T03:48:46.705467+0000","last_unstale":"2023-06-08T03:48:51.297204+0000","last_undegraded":"2023-06-08T03:48:51.297204+0000","last_fullsized":"2023-06-08T03:48:51.297204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:32.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151964+0000","last_change":"2023-06-08T03:48:50.741943+0000","last_active":"2023-06-08T03:48:51.151964+0000","last_peered":"2023-06-08T03:48:51.151964+0000","last_clean":"2023-06-08T03:48:51.151964+0000","last_became_active":"2023-06-08T03:48:50.741608+0000","last_became_peered":"2023-06-08T03:48:50.741608+0000","last_unstale":"2023-06-08T03:48:51.151964+0000","last_undegraded":"2023-06-08T03:48:51.151964+0000","last_fullsized":"2023-06-08T03:48:51.151964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:51:13.186018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150823+0000","last_change":"2023-06-08T03:48:46.278306+0000","last_active":"2023-06-08T03:48:51.150823+0000","last_peered":"2023-06-08T03:48:51.150823+0000","last_clean":"2023-06-08T03:48:51.150823+0000","last_became_active":"2023-06-08T03:48:46.277947+0000","last_became_peered":"2023-06-08T03:48:46.277947+0000","last_unstale":"2023-06-08T03:48:51.150823+0000","last_undegraded":"2023-06-08T03:48:51.150823+0000","last_fullsized":"2023-06-08T03:48:51.150823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:49.551708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152311+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:48:51.152311+0000","last_peered":"2023-06-08T03:48:51.152311+0000","last_clean":"2023-06-08T03:48:51.152311+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:48:51.152311+0000","last_undegraded":"2023-06-08T03:48:51.152311+0000","last_fullsized":"2023-06-08T03:48:51.152311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:31:06.762730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:46.705629+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:46.705364+0000","last_became_peered":"2023-06-08T03:48:46.705364+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:11:45.390642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149779+0000","last_change":"2023-06-08T03:48:50.749541+0000","last_active":"2023-06-08T03:48:51.149779+0000","last_peered":"2023-06-08T03:48:51.149779+0000","last_clean":"2023-06-08T03:48:51.149779+0000","last_became_active":"2023-06-08T03:48:50.749054+0000","last_became_peered":"2023-06-08T03:48:50.749054+0000","last_unstale":"2023-06-08T03:48:51.149779+0000","last_undegraded":"2023-06-08T03:48:51.149779+0000","last_fullsized":"2023-06-08T03:48:51.149779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:53:10.319490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150370+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:48:51.150370+0000","last_peered":"2023-06-08T03:48:51.150370+0000","last_clean":"2023-06-08T03:48:51.150370+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:48:51.150370+0000","last_undegraded":"2023-06-08T03:48:51.150370+0000","last_fullsized":"2023-06-08T03:48:51.150370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:52:47.060840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294022+0000","last_change":"2023-06-08T03:48:46.278145+0000","last_active":"2023-06-08T03:48:51.294022+0000","last_peered":"2023-06-08T03:48:51.294022+0000","last_clean":"2023-06-08T03:48:51.294022+0000","last_became_active":"2023-06-08T03:48:46.277856+0000","last_became_peered":"2023-06-08T03:48:46.277856+0000","last_unstale":"2023-06-08T03:48:51.294022+0000","last_undegraded":"2023-06-08T03:48:51.294022+0000","last_fullsized":"2023-06-08T03:48:51.294022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:15:05.154485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151419+0000","last_change":"2023-06-08T03:48:46.710096+0000","last_active":"2023-06-08T03:48:51.151419+0000","last_peered":"2023-06-08T03:48:51.151419+0000","last_clean":"2023-06-08T03:48:51.151419+0000","last_became_active":"2023-06-08T03:48:46.709818+0000","last_became_peered":"2023-06-08T03:48:46.709818+0000","last_unstale":"2023-06-08T03:48:51.151419+0000","last_undegraded":"2023-06-08T03:48:51.151419+0000","last_fullsized":"2023-06-08T03:48:51.151419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:15:50.557006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536871+0000","last_change":"2023-06-08T03:48:50.741926+0000","last_active":"2023-06-08T03:48:51.536871+0000","last_peered":"2023-06-08T03:48:51.536871+0000","last_clean":"2023-06-08T03:48:51.536871+0000","last_became_active":"2023-06-08T03:48:50.741525+0000","last_became_peered":"2023-06-08T03:48:50.741525+0000","last_unstale":"2023-06-08T03:48:51.536871+0000","last_undegraded":"2023-06-08T03:48:51.536871+0000","last_fullsized":"2023-06-08T03:48:51.536871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:51.416831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296460+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:48:51.296460+0000","last_peered":"2023-06-08T03:48:51.296460+0000","last_clean":"2023-06-08T03:48:51.296460+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:48:51.296460+0000","last_undegraded":"2023-06-08T03:48:51.296460+0000","last_fullsized":"2023-06-08T03:48:51.296460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:15.592925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536615+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:48:51.536615+0000","last_peered":"2023-06-08T03:48:51.536615+0000","last_clean":"2023-06-08T03:48:51.536615+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:48:51.536615+0000","last_undegraded":"2023-06-08T03:48:51.536615+0000","last_fullsized":"2023-06-08T03:48:51.536615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:33:57.059756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.293693+0000","last_change":"2023-06-08T03:48:46.271960+0000","last_active":"2023-06-08T03:48:51.293693+0000","last_peered":"2023-06-08T03:48:51.293693+0000","last_clean":"2023-06-08T03:48:51.293693+0000","last_became_active":"2023-06-08T03:48:46.271631+0000","last_became_peered":"2023-06-08T03:48:46.271631+0000","last_unstale":"2023-06-08T03:48:51.293693+0000","last_undegraded":"2023-06-08T03:48:51.293693+0000","last_fullsized":"2023-06-08T03:48:51.293693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:05:39.928718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294243+0000","last_change":"2023-06-08T03:48:46.713531+0000","last_active":"2023-06-08T03:48:51.294243+0000","last_peered":"2023-06-08T03:48:51.294243+0000","last_clean":"2023-06-08T03:48:51.294243+0000","last_became_active":"2023-06-08T03:48:46.713244+0000","last_became_peered":"2023-06-08T03:48:46.713244+0000","last_unstale":"2023-06-08T03:48:51.294243+0000","last_undegraded":"2023-06-08T03:48:51.294243+0000","last_fullsized":"2023-06-08T03:48:51.294243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:15.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535548+0000","last_change":"2023-06-08T03:48:50.741357+0000","last_active":"2023-06-08T03:48:51.535548+0000","last_peered":"2023-06-08T03:48:51.535548+0000","last_clean":"2023-06-08T03:48:51.535548+0000","last_became_active":"2023-06-08T03:48:50.740948+0000","last_became_peered":"2023-06-08T03:48:50.740948+0000","last_unstale":"2023-06-08T03:48:51.535548+0000","last_undegraded":"2023-06-08T03:48:51.535548+0000","last_fullsized":"2023-06-08T03:48:51.535548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:30:29.499824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536124+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:48:51.536124+0000","last_peered":"2023-06-08T03:48:51.536124+0000","last_clean":"2023-06-08T03:48:51.536124+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:48:51.536124+0000","last_undegraded":"2023-06-08T03:48:51.536124+0000","last_fullsized":"2023-06-08T03:48:51.536124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:09:29.922704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296203+0000","last_change":"2023-06-08T03:48:46.277931+0000","last_active":"2023-06-08T03:48:51.296203+0000","last_peered":"2023-06-08T03:48:51.296203+0000","last_clean":"2023-06-08T03:48:51.296203+0000","last_became_active":"2023-06-08T03:48:46.277604+0000","last_became_peered":"2023-06-08T03:48:46.277604+0000","last_unstale":"2023-06-08T03:48:51.296203+0000","last_undegraded":"2023-06-08T03:48:51.296203+0000","last_fullsized":"2023-06-08T03:48:51.296203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:34.743166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.297099+0000","last_change":"2023-06-08T03:48:46.705736+0000","last_active":"2023-06-08T03:48:51.297099+0000","last_peered":"2023-06-08T03:48:51.297099+0000","last_clean":"2023-06-08T03:48:51.297099+0000","last_became_active":"2023-06-08T03:48:46.705176+0000","last_became_peered":"2023-06-08T03:48:46.705176+0000","last_unstale":"2023-06-08T03:48:51.297099+0000","last_undegraded":"2023-06-08T03:48:51.297099+0000","last_fullsized":"2023-06-08T03:48:51.297099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:00:52.575796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536231+0000","last_change":"2023-06-08T03:48:50.742690+0000","last_active":"2023-06-08T03:48:51.536231+0000","last_peered":"2023-06-08T03:48:51.536231+0000","last_clean":"2023-06-08T03:48:51.536231+0000","last_became_active":"2023-06-08T03:48:50.742283+0000","last_became_peered":"2023-06-08T03:48:50.742283+0000","last_unstale":"2023-06-08T03:48:51.536231+0000","last_undegraded":"2023-06-08T03:48:51.536231+0000","last_fullsized":"2023-06-08T03:48:51.536231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:36.980926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535737+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:48:51.535737+0000","last_peered":"2023-06-08T03:48:51.535737+0000","last_clean":"2023-06-08T03:48:51.535737+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:48:51.535737+0000","last_undegraded":"2023-06-08T03:48:51.535737+0000","last_fullsized":"2023-06-08T03:48:51.535737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:37.932523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150042+0000","last_change":"2023-06-08T03:48:46.281860+0000","last_active":"2023-06-08T03:48:51.150042+0000","last_peered":"2023-06-08T03:48:51.150042+0000","last_clean":"2023-06-08T03:48:51.150042+0000","last_became_active":"2023-06-08T03:48:46.281558+0000","last_became_peered":"2023-06-08T03:48:46.281558+0000","last_unstale":"2023-06-08T03:48:51.150042+0000","last_undegraded":"2023-06-08T03:48:51.150042+0000","last_fullsized":"2023-06-08T03:48:51.150042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:11.909569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152544+0000","last_change":"2023-06-08T03:48:46.712745+0000","last_active":"2023-06-08T03:48:51.152544+0000","last_peered":"2023-06-08T03:48:51.152544+0000","last_clean":"2023-06-08T03:48:51.152544+0000","last_became_active":"2023-06-08T03:48:46.712473+0000","last_became_peered":"2023-06-08T03:48:46.712473+0000","last_unstale":"2023-06-08T03:48:51.152544+0000","last_undegraded":"2023-06-08T03:48:51.152544+0000","last_fullsized":"2023-06-08T03:48:51.152544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:11.555796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294139+0000","last_change":"2023-06-08T03:48:50.741909+0000","last_active":"2023-06-08T03:48:51.294139+0000","last_peered":"2023-06-08T03:48:51.294139+0000","last_clean":"2023-06-08T03:48:51.294139+0000","last_became_active":"2023-06-08T03:48:50.741480+0000","last_became_peered":"2023-06-08T03:48:50.741480+0000","last_unstale":"2023-06-08T03:48:51.294139+0000","last_undegraded":"2023-06-08T03:48:51.294139+0000","last_fullsized":"2023-06-08T03:48:51.294139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:23:11.394158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535613+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:48:51.535613+0000","last_peered":"2023-06-08T03:48:51.535613+0000","last_clean":"2023-06-08T03:48:51.535613+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:48:51.535613+0000","last_undegraded":"2023-06-08T03:48:51.535613+0000","last_fullsized":"2023-06-08T03:48:51.535613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:29:08.960350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152806+0000","last_change":"2023-06-08T03:48:46.277332+0000","last_active":"2023-06-08T03:48:51.152806+0000","last_peered":"2023-06-08T03:48:51.152806+0000","last_clean":"2023-06-08T03:48:51.152806+0000","last_became_active":"2023-06-08T03:48:46.277048+0000","last_became_peered":"2023-06-08T03:48:46.277048+0000","last_unstale":"2023-06-08T03:48:51.152806+0000","last_undegraded":"2023-06-08T03:48:51.152806+0000","last_fullsized":"2023-06-08T03:48:51.152806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:20:43.010981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296324+0000","last_change":"2023-06-08T03:48:46.713941+0000","last_active":"2023-06-08T03:48:51.296324+0000","last_peered":"2023-06-08T03:48:51.296324+0000","last_clean":"2023-06-08T03:48:51.296324+0000","last_became_active":"2023-06-08T03:48:46.713519+0000","last_became_peered":"2023-06-08T03:48:46.713519+0000","last_unstale":"2023-06-08T03:48:51.296324+0000","last_undegraded":"2023-06-08T03:48:51.296324+0000","last_fullsized":"2023-06-08T03:48:51.296324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:56:23.173849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152339+0000","last_change":"2023-06-08T03:48:50.746277+0000","last_active":"2023-06-08T03:48:51.152339+0000","last_peered":"2023-06-08T03:48:51.152339+0000","last_clean":"2023-06-08T03:48:51.152339+0000","last_became_active":"2023-06-08T03:48:50.745762+0000","last_became_peered":"2023-06-08T03:48:50.745762+0000","last_unstale":"2023-06-08T03:48:51.152339+0000","last_undegraded":"2023-06-08T03:48:51.152339+0000","last_fullsized":"2023-06-08T03:48:51.152339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:54:52.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151603+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:48:51.151603+0000","last_peered":"2023-06-08T03:48:51.151603+0000","last_clean":"2023-06-08T03:48:51.151603+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:48:51.151603+0000","last_undegraded":"2023-06-08T03:48:51.151603+0000","last_fullsized":"2023-06-08T03:48:51.151603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:16.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296662+0000","last_change":"2023-06-08T03:48:46.280443+0000","last_active":"2023-06-08T03:48:51.296662+0000","last_peered":"2023-06-08T03:48:51.296662+0000","last_clean":"2023-06-08T03:48:51.296662+0000","last_became_active":"2023-06-08T03:48:46.280150+0000","last_became_peered":"2023-06-08T03:48:46.280150+0000","last_unstale":"2023-06-08T03:48:51.296662+0000","last_undegraded":"2023-06-08T03:48:51.296662+0000","last_fullsized":"2023-06-08T03:48:51.296662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:35:10.550497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294224+0000","last_change":"2023-06-08T03:48:46.704536+0000","last_active":"2023-06-08T03:48:51.294224+0000","last_peered":"2023-06-08T03:48:51.294224+0000","last_clean":"2023-06-08T03:48:51.294224+0000","last_became_active":"2023-06-08T03:48:46.704247+0000","last_became_peered":"2023-06-08T03:48:46.704247+0000","last_unstale":"2023-06-08T03:48:51.294224+0000","last_undegraded":"2023-06-08T03:48:51.294224+0000","last_fullsized":"2023-06-08T03:48:51.294224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:15.230055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294090+0000","last_change":"2023-06-08T03:48:50.746038+0000","last_active":"2023-06-08T03:48:51.294090+0000","last_peered":"2023-06-08T03:48:51.294090+0000","last_clean":"2023-06-08T03:48:51.294090+0000","last_became_active":"2023-06-08T03:48:50.742671+0000","last_became_peered":"2023-06-08T03:48:50.742671+0000","last_unstale":"2023-06-08T03:48:51.294090+0000","last_undegraded":"2023-06-08T03:48:51.294090+0000","last_fullsized":"2023-06-08T03:48:51.294090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:05:35.814289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151774+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:48:51.151774+0000","last_peered":"2023-06-08T03:48:51.151774+0000","last_clean":"2023-06-08T03:48:51.151774+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:48:51.151774+0000","last_undegraded":"2023-06-08T03:48:51.151774+0000","last_fullsized":"2023-06-08T03:48:51.151774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:42.653472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536891+0000","last_change":"2023-06-08T03:48:46.279903+0000","last_active":"2023-06-08T03:48:51.536891+0000","last_peered":"2023-06-08T03:48:51.536891+0000","last_clean":"2023-06-08T03:48:51.536891+0000","last_became_active":"2023-06-08T03:48:46.279643+0000","last_became_peered":"2023-06-08T03:48:46.279643+0000","last_unstale":"2023-06-08T03:48:51.536891+0000","last_undegraded":"2023-06-08T03:48:51.536891+0000","last_fullsized":"2023-06-08T03:48:51.536891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:58.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296218+0000","last_change":"2023-06-08T03:48:46.710102+0000","last_active":"2023-06-08T03:48:51.296218+0000","last_peered":"2023-06-08T03:48:51.296218+0000","last_clean":"2023-06-08T03:48:51.296218+0000","last_became_active":"2023-06-08T03:48:46.708006+0000","last_became_peered":"2023-06-08T03:48:46.708006+0000","last_unstale":"2023-06-08T03:48:51.296218+0000","last_undegraded":"2023-06-08T03:48:51.296218+0000","last_fullsized":"2023-06-08T03:48:51.296218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:34:22.614696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296866+0000","last_change":"2023-06-08T03:48:50.745383+0000","last_active":"2023-06-08T03:48:51.296866+0000","last_peered":"2023-06-08T03:48:51.296866+0000","last_clean":"2023-06-08T03:48:51.296866+0000","last_became_active":"2023-06-08T03:48:50.744898+0000","last_became_peered":"2023-06-08T03:48:50.744898+0000","last_unstale":"2023-06-08T03:48:51.296866+0000","last_undegraded":"2023-06-08T03:48:51.296866+0000","last_fullsized":"2023-06-08T03:48:51.296866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:19.011259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294205+0000","last_change":"2023-06-08T03:48:46.272132+0000","last_active":"2023-06-08T03:48:51.294205+0000","last_peered":"2023-06-08T03:48:51.294205+0000","last_clean":"2023-06-08T03:48:51.294205+0000","last_became_active":"2023-06-08T03:48:46.271635+0000","last_became_peered":"2023-06-08T03:48:46.271635+0000","last_unstale":"2023-06-08T03:48:51.294205+0000","last_undegraded":"2023-06-08T03:48:51.294205+0000","last_fullsized":"2023-06-08T03:48:51.294205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:56:18.843927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.535531+0000","last_change":"2023-06-08T03:48:46.716188+0000","last_active":"2023-06-08T03:48:51.535531+0000","last_peered":"2023-06-08T03:48:51.535531+0000","last_clean":"2023-06-08T03:48:51.535531+0000","last_became_active":"2023-06-08T03:48:46.715960+0000","last_became_peered":"2023-06-08T03:48:46.715960+0000","last_unstale":"2023-06-08T03:48:51.535531+0000","last_undegraded":"2023-06-08T03:48:51.535531+0000","last_fullsized":"2023-06-08T03:48:51.535531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:59:38.213584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536363+0000","last_change":"2023-06-08T03:48:50.741907+0000","last_active":"2023-06-08T03:48:51.536363+0000","last_peered":"2023-06-08T03:48:51.536363+0000","last_clean":"2023-06-08T03:48:51.536363+0000","last_became_active":"2023-06-08T03:48:50.741526+0000","last_became_peered":"2023-06-08T03:48:50.741526+0000","last_unstale":"2023-06-08T03:48:51.536363+0000","last_undegraded":"2023-06-08T03:48:51.536363+0000","last_fullsized":"2023-06-08T03:48:51.536363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536462+0000","last_change":"2023-06-08T03:48:46.283972+0000","last_active":"2023-06-08T03:48:51.536462+0000","last_peered":"2023-06-08T03:48:51.536462+0000","last_clean":"2023-06-08T03:48:51.536462+0000","last_became_active":"2023-06-08T03:48:46.283686+0000","last_became_peered":"2023-06-08T03:48:46.283686+0000","last_unstale":"2023-06-08T03:48:51.536462+0000","last_undegraded":"2023-06-08T03:48:51.536462+0000","last_fullsized":"2023-06-08T03:48:51.536462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:44:59.906266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152862+0000","last_change":"2023-06-08T03:48:46.708793+0000","last_active":"2023-06-08T03:48:51.152862+0000","last_peered":"2023-06-08T03:48:51.152862+0000","last_clean":"2023-06-08T03:48:51.152862+0000","last_became_active":"2023-06-08T03:48:46.708492+0000","last_became_peered":"2023-06-08T03:48:46.708492+0000","last_unstale":"2023-06-08T03:48:51.152862+0000","last_undegraded":"2023-06-08T03:48:51.152862+0000","last_fullsized":"2023-06-08T03:48:51.152862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:54:28.053659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.537064+0000","last_change":"2023-06-08T03:48:50.748191+0000","last_active":"2023-06-08T03:48:51.537064+0000","last_peered":"2023-06-08T03:48:51.537064+0000","last_clean":"2023-06-08T03:48:51.537064+0000","last_became_active":"2023-06-08T03:48:50.747824+0000","last_became_peered":"2023-06-08T03:48:50.747824+0000","last_unstale":"2023-06-08T03:48:51.537064+0000","last_undegraded":"2023-06-08T03:48:51.537064+0000","last_fullsized":"2023-06-08T03:48:51.537064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:35:16.373129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.536733+0000","last_change":"2023-06-08T03:48:46.283956+0000","last_active":"2023-06-08T03:48:51.536733+0000","last_peered":"2023-06-08T03:48:51.536733+0000","last_clean":"2023-06-08T03:48:51.536733+0000","last_became_active":"2023-06-08T03:48:46.283667+0000","last_became_peered":"2023-06-08T03:48:46.283667+0000","last_unstale":"2023-06-08T03:48:51.536733+0000","last_undegraded":"2023-06-08T03:48:51.536733+0000","last_fullsized":"2023-06-08T03:48:51.536733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:42:43.022334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151349+0000","last_change":"2023-06-08T03:48:46.705342+0000","last_active":"2023-06-08T03:48:51.151349+0000","last_peered":"2023-06-08T03:48:51.151349+0000","last_clean":"2023-06-08T03:48:51.151349+0000","last_became_active":"2023-06-08T03:48:46.704758+0000","last_became_peered":"2023-06-08T03:48:46.704758+0000","last_unstale":"2023-06-08T03:48:51.151349+0000","last_undegraded":"2023-06-08T03:48:51.151349+0000","last_fullsized":"2023-06-08T03:48:51.151349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:03.775564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150985+0000","last_change":"2023-06-08T03:48:50.749457+0000","last_active":"2023-06-08T03:48:51.150985+0000","last_peered":"2023-06-08T03:48:51.150985+0000","last_clean":"2023-06-08T03:48:51.150985+0000","last_became_active":"2023-06-08T03:48:50.749024+0000","last_became_peered":"2023-06-08T03:48:50.749024+0000","last_unstale":"2023-06-08T03:48:51.150985+0000","last_undegraded":"2023-06-08T03:48:51.150985+0000","last_fullsized":"2023-06-08T03:48:51.150985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:19:52.011093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150602+0000","last_change":"2023-06-08T03:48:46.274180+0000","last_active":"2023-06-08T03:48:51.150602+0000","last_peered":"2023-06-08T03:48:51.150602+0000","last_clean":"2023-06-08T03:48:51.150602+0000","last_became_active":"2023-06-08T03:48:46.273751+0000","last_became_peered":"2023-06-08T03:48:46.273751+0000","last_unstale":"2023-06-08T03:48:51.150602+0000","last_undegraded":"2023-06-08T03:48:51.150602+0000","last_fullsized":"2023-06-08T03:48:51.150602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:54.871103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.149813+0000","last_change":"2023-06-08T03:48:46.699197+0000","last_active":"2023-06-08T03:48:51.149813+0000","last_peered":"2023-06-08T03:48:51.149813+0000","last_clean":"2023-06-08T03:48:51.149813+0000","last_became_active":"2023-06-08T03:48:46.698921+0000","last_became_peered":"2023-06-08T03:48:46.698921+0000","last_unstale":"2023-06-08T03:48:51.149813+0000","last_undegraded":"2023-06-08T03:48:51.149813+0000","last_fullsized":"2023-06-08T03:48:51.149813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:56:47.958570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296459+0000","last_change":"2023-06-08T03:48:50.742031+0000","last_active":"2023-06-08T03:48:51.296459+0000","last_peered":"2023-06-08T03:48:51.296459+0000","last_clean":"2023-06-08T03:48:51.296459+0000","last_became_active":"2023-06-08T03:48:50.741621+0000","last_became_peered":"2023-06-08T03:48:50.741621+0000","last_unstale":"2023-06-08T03:48:51.296459+0000","last_undegraded":"2023-06-08T03:48:51.296459+0000","last_fullsized":"2023-06-08T03:48:51.296459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:49.711694+0000","last_clean_scrub_stamp":"2023-06-08T03:48:49.711694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:34:59.951799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.294491+0000","last_change":"2023-06-08T03:48:46.280946+0000","last_active":"2023-06-08T03:48:51.294491+0000","last_peered":"2023-06-08T03:48:51.294491+0000","last_clean":"2023-06-08T03:48:51.294491+0000","last_became_active":"2023-06-08T03:48:46.279562+0000","last_became_peered":"2023-06-08T03:48:46.279562+0000","last_unstale":"2023-06-08T03:48:51.294491+0000","last_undegraded":"2023-06-08T03:48:51.294491+0000","last_fullsized":"2023-06-08T03:48:51.294491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:45.248134+0000","last_clean_scrub_stamp":"2023-06-08T03:48:45.248134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:01:00.713226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151164+0000","last_change":"2023-06-08T03:48:46.709469+0000","last_active":"2023-06-08T03:48:51.151164+0000","last_peered":"2023-06-08T03:48:51.151164+0000","last_clean":"2023-06-08T03:48:51.151164+0000","last_became_active":"2023-06-08T03:48:46.709131+0000","last_became_peered":"2023-06-08T03:48:46.709131+0000","last_unstale":"2023-06-08T03:48:51.151164+0000","last_undegraded":"2023-06-08T03:48:51.151164+0000","last_fullsized":"2023-06-08T03:48:51.151164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:26:09.642499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.151705+0000","last_change":"2023-06-08T03:48:46.699962+0000","last_active":"2023-06-08T03:48:51.151705+0000","last_peered":"2023-06-08T03:48:51.151705+0000","last_clean":"2023-06-08T03:48:51.151705+0000","last_became_active":"2023-06-08T03:48:46.699670+0000","last_became_peered":"2023-06-08T03:48:46.699670+0000","last_unstale":"2023-06-08T03:48:51.151705+0000","last_undegraded":"2023-06-08T03:48:51.151705+0000","last_fullsized":"2023-06-08T03:48:51.151705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:20:16.254429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150141+0000","last_change":"2023-06-08T03:48:46.712641+0000","last_active":"2023-06-08T03:48:51.150141+0000","last_peered":"2023-06-08T03:48:51.150141+0000","last_clean":"2023-06-08T03:48:51.150141+0000","last_became_active":"2023-06-08T03:48:46.712338+0000","last_became_peered":"2023-06-08T03:48:46.712338+0000","last_unstale":"2023-06-08T03:48:51.150141+0000","last_undegraded":"2023-06-08T03:48:51.150141+0000","last_fullsized":"2023-06-08T03:48:51.150141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:42.915864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.152242+0000","last_change":"2023-06-08T03:48:46.711282+0000","last_active":"2023-06-08T03:48:51.152242+0000","last_peered":"2023-06-08T03:48:51.152242+0000","last_clean":"2023-06-08T03:48:51.152242+0000","last_became_active":"2023-06-08T03:48:46.711006+0000","last_became_peered":"2023-06-08T03:48:46.711006+0000","last_unstale":"2023-06-08T03:48:51.152242+0000","last_undegraded":"2023-06-08T03:48:51.152242+0000","last_fullsized":"2023-06-08T03:48:51.152242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:23:18.302863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.150081+0000","last_change":"2023-06-08T03:48:46.711221+0000","last_active":"2023-06-08T03:48:51.150081+0000","last_peered":"2023-06-08T03:48:51.150081+0000","last_clean":"2023-06-08T03:48:51.150081+0000","last_became_active":"2023-06-08T03:48:46.710772+0000","last_became_peered":"2023-06-08T03:48:46.710772+0000","last_unstale":"2023-06-08T03:48:51.150081+0000","last_undegraded":"2023-06-08T03:48:51.150081+0000","last_fullsized":"2023-06-08T03:48:51.150081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:06:36.197814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-08T03:48:51.296341+0000","last_change":"2023-06-08T03:48:46.712982+0000","last_active":"2023-06-08T03:48:51.296341+0000","last_peered":"2023-06-08T03:48:51.296341+0000","last_clean":"2023-06-08T03:48:51.296341+0000","last_became_active":"2023-06-08T03:48:46.712737+0000","last_became_peered":"2023-06-08T03:48:46.712737+0000","last_unstale":"2023-06-08T03:48:51.296341+0000","last_undegraded":"2023-06-08T03:48:51.296341+0000","last_fullsized":"2023-06-08T03:48:51.296341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:46.253432+0000","last_clean_scrub_stamp":"2023-06-08T03:48:46.253432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:47:48.748581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":703779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1760000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.122999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0410000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.9870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5179999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:49:10.127 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-08T03:49:10.127 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-08T03:49:10.127 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-08T03:49:10.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-08T03:49:10.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.278+0000 7f1e7088d700 1 Processor -- start 2023-06-08T03:49:10.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.278+0000 7f1e7088d700 1 -- start start 2023-06-08T03:49:10.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e7088d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1e6c15e1a0 0x7f1e6c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e7088d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c15e8c0 con 0x7f1e6c15d650 2023-06-08T03:49:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e7088d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0afeb0 con 0x7f1e6c15d280 2023-06-08T03:49:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e7088d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0b3fa0 con 0x7f1e6c15e1a0 2023-06-08T03:49:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e69d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1e6c15d650 0x7f1e6c0cc570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53634/0 (socket says 172.21.15.43:53634) 2023-06-08T03:49:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e69d9b700 1 -- 172.21.15.43:0/2808989406 learned_addr learned my addr 172.21.15.43:0/2808989406 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6ad9d700 1 --2- 172.21.15.43:0/2808989406 >> v2:172.21.15.135:3300/0 conn(0x7f1e6c15e1a0 0x7f1e6c0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6959a700 1 -- 172.21.15.43:0/2808989406 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053075019 0 0) 0x7f1e6c15e8c0 con 0x7f1e6c15d650 2023-06-08T03:49:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6959a700 1 -- 172.21.15.43:0/2808989406 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e540035b0 con 0x7f1e6c15d650 2023-06-08T03:49:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6ad9d700 1 -- 172.21.15.43:0/2808989406 >> v1:172.21.15.135:6789/0 conn(0x7f1e6c15d280 legacy=0x7f1e6c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6ad9d700 1 -- 172.21.15.43:0/2808989406 >> v1:172.21.15.43:6789/0 conn(0x7f1e6c15d650 legacy=0x7f1e6c0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6ad9d700 1 -- 172.21.15.43:0/2808989406 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0cdb10 con 0x7f1e6c15e1a0 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.280+0000 7f1e6ad9d700 1 --2- 172.21.15.43:0/2808989406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0af970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009d90 tx=0x7f1e6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c47ab4c796160ed server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e6959a700 1 -- 172.21.15.43:0/2808989406 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400e070 con 0x7f1e6c15e1a0 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e6959a700 1 -- 172.21.15.43:0/2808989406 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6400bb20 con 0x7f1e6c15e1a0 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e6959a700 1 -- 172.21.15.43:0/2808989406 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012430 con 0x7f1e6c15e1a0 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 -- 172.21.15.43:0/2808989406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 msgr2=0x7f1e6c0af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 --2- 172.21.15.43:0/2808989406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0af970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009d90 tx=0x7f1e6400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 -- 172.21.15.43:0/2808989406 shutdown_connections 2023-06-08T03:49:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 --2- 172.21.15.43:0/2808989406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0af970 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 -- 172.21.15.43:0/2808989406 >> 172.21.15.43:0/2808989406 conn(0x7f1e6c069db0 msgr2=0x7f1e6c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 -- 172.21.15.43:0/2808989406 shutdown_connections 2023-06-08T03:49:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.281+0000 7f1e7088d700 1 -- 172.21.15.43:0/2808989406 wait complete. 2023-06-08T03:49:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 Processor -- start 2023-06-08T03:49:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 -- start start 2023-06-08T03:49:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 0x7f1e6c0aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e6c15d650 0x7f1e6c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c06c7f0 con 0x7f1e6c15d280 2023-06-08T03:49:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0af530 con 0x7f1e6c15e1a0 2023-06-08T03:49:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.283+0000 7f1e7088d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c06bbe0 con 0x7f1e6c15d650 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 0x7f1e6c0aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 0x7f1e6c0aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58734/0 (socket says 172.21.15.43:58734) 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 -- 172.21.15.43:0/3451031527 learned_addr learned my addr 172.21.15.43:0/3451031527 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6ad9d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e69d9b700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e6c15d650 0x7f1e6c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 -- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e6c15d650 msgr2=0x7f1e6c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e6c15d650 0x7f1e6c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 -- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 msgr2=0x7f1e6c0c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 -- 172.21.15.43:0/3451031527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64009a70 con 0x7f1e6c15d280 2023-06-08T03:49:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e6a59c700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 0x7f1e6c0aeff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c4e0 tx=0x7f1e5c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0052d0 con 0x7f1e6c15d280 2023-06-08T03:49:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c005430 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c06bec0 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0038c0 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.284+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c06c480 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.285+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c073fa0 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.286+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e5c003a20 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.286+0000 7f1e5affd700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1e4c06ace0 0x7f1e4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.286+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e5c088940 con 0x7f1e6c15d280 2023-06-08T03:49:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.286+0000 7f1e69d9b700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1e4c06ace0 0x7f1e4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.287+0000 7f1e69d9b700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1e4c06ace0 0x7f1e4c06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0cb0b0 tx=0x7f1e60007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.291+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e5c053700 con 0x7f1e6c15d280 2023-06-08T03:49:10.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.530+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e6c0afeb0 con 0x7f1e6c15d280 2023-06-08T03:49:10.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.531+0000 7f1e5affd700 1 -- 172.21.15.43:0/3451031527 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1e6c0afeb0 con 0x7f1e6c15d280 2023-06-08T03:49:10.535 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:10.535 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-08T03:49:10.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1e4c06ace0 msgr2=0x7f1e4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1e4c06ace0 0x7f1e4c06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0cb0b0 tx=0x7f1e60007dc0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 msgr2=0x7f1e6c0aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 0x7f1e6c0aeff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c4e0 tx=0x7f1e5c00c7f0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 shutdown_connections 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1e4c06ace0 0x7f1e4c06d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e6c15d280 0x7f1e6c0aeff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e6c15e1a0 0x7f1e6c0c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 --2- 172.21.15.43:0/3451031527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e6c15d650 0x7f1e6c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 >> 172.21.15.43:0/3451031527 conn(0x7f1e6c069db0 msgr2=0x7f1e6c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:10.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 shutdown_connections 2023-06-08T03:49:10.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.533+0000 7f1e7088d700 1 -- 172.21.15.43:0/3451031527 wait complete. 2023-06-08T03:49:10.549 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-08T03:49:10.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:10.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.669+0000 7f2c00bf3700 1 Processor -- start 2023-06-08T03:49:10.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.669+0000 7f2c00bf3700 1 -- start start 2023-06-08T03:49:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2c00bf3700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2bfc15c590 0x7f2bfc0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2c00bf3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2bfc06a4c0 0x7f2bfc0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2c00bf3700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0af050 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2c00bf3700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0afae0 con 0x7f2bfc15c590 2023-06-08T03:49:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2c00bf3700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0af800 con 0x7f2bfc06a4c0 2023-06-08T03:49:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2bfc15c590 0x7f2bfc0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2bfc15c590 0x7f2bfc0af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58742/0 (socket says 172.21.15.43:58742) 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 -- 172.21.15.43:0/1572599140 learned_addr learned my addr 172.21.15.43:0/1572599140 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfad9d700 1 --2- 172.21.15.43:0/1572599140 >> v2:172.21.15.135:3300/0 conn(0x7f2bfc06a4c0 0x7f2bfc0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 -- 172.21.15.43:0/1572599140 >> v2:172.21.15.135:3300/0 conn(0x7f2bfc06a4c0 msgr2=0x7f2bfc0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 --2- 172.21.15.43:0/1572599140 >> v2:172.21.15.135:3300/0 conn(0x7f2bfc06a4c0 0x7f2bfc0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 -- 172.21.15.43:0/1572599140 >> v1:172.21.15.135:6789/0 conn(0x7f2bfc0ccba0 legacy=0x7f2bfc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.670+0000 7f2bfa59c700 1 -- 172.21.15.43:0/1572599140 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0cc0c0 con 0x7f2bfc15c590 2023-06-08T03:49:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2bfa59c700 1 --2- 172.21.15.43:0/1572599140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc15c590 0x7f2bfc0af220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc072390 tx=0x7f2bf0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37d2868cddee330 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2bf959a700 1 -- 172.21.15.43:0/1572599140 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0005e30 con 0x7f2bfc15c590 2023-06-08T03:49:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2bf959a700 1 -- 172.21.15.43:0/1572599140 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0006030 con 0x7f2bfc15c590 2023-06-08T03:49:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2bf959a700 1 -- 172.21.15.43:0/1572599140 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00063e0 con 0x7f2bfc15c590 2023-06-08T03:49:10.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1572599140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc15c590 msgr2=0x7f2bfc0af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1572599140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc15c590 0x7f2bfc0af220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc072390 tx=0x7f2bf0009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1572599140 shutdown_connections 2023-06-08T03:49:10.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1572599140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc15c590 0x7f2bfc0af220 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1572599140 >> v2:172.21.15.135:3300/0 conn(0x7f2bfc06a4c0 0x7f2bfc0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1572599140 >> 172.21.15.43:0/1572599140 conn(0x7f2bfc06b7e0 msgr2=0x7f2bfc0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1572599140 shutdown_connections 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.671+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1572599140 wait complete. 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.673+0000 7f2c00bf3700 1 Processor -- start 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.673+0000 7f2c00bf3700 1 -- start start 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.673+0000 7f2c00bf3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bfc06a4c0 0x7f2bfc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.673+0000 7f2c00bf3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 0x7f2bfc15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2c00bf3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2bfc15c590 0x7f2bfc0c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2c00bf3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0c5900 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2c00bf3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0c9110 con 0x7f2bfc06a4c0 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2c00bf3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0b2670 con 0x7f2bfc15c590 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 0x7f2bfc15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bfa59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bfc06a4c0 0x7f2bfc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 0x7f2bfc15aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58750/0 (socket says 172.21.15.43:58750) 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bfa59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bfc06a4c0 0x7f2bfc15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40364/0 (socket says 172.21.15.43:40364) 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 -- 172.21.15.43:0/1104050405 learned_addr learned my addr 172.21.15.43:0/1104050405 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bfad9d700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2bfc15c590 0x7f2bfc0c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 -- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2bfc15c590 msgr2=0x7f2bfc0c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2bfc15c590 0x7f2bfc0c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 -- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bfc06a4c0 msgr2=0x7f2bfc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bfc06a4c0 0x7f2bfc15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 -- 172.21.15.43:0/1104050405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009500 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2bf9d9b700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 0x7f2bfc15aa30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c4d0 tx=0x7f2bec00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011790 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec0118f0 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc0b2950 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011ca0 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.674+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc0b2f10 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.675+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc073fa0 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.676+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bec01c460 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.676+0000 7f2beaffd700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bdc06ace0 0x7f2bdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.676+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2bec089430 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.676+0000 7f2bfa59c700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bdc06ace0 0x7f2bdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.677+0000 7f2bfa59c700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bdc06ace0 0x7f2bdc06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc072390 tx=0x7f2bf0008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.681+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bec054220 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.882+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bfc071dc0 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.884+0000 7f2beaffd700 1 -- 172.21.15.43:0/1104050405 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f2bec057840 con 0x7f2bfc0ccba0 2023-06-08T03:49:10.888 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:10.888 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:10.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bdc06ace0 msgr2=0x7f2bdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bdc06ace0 0x7f2bdc06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc072390 tx=0x7f2bf0008070 comp rx=0 tx=0).stop 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 msgr2=0x7f2bfc15aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 0x7f2bfc15aa30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c4d0 tx=0x7f2bec00c7e0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 shutdown_connections 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bdc06ace0 0x7f2bdc06d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2bfc15c590 0x7f2bfc0c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bfc06a4c0 0x7f2bfc15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 --2- 172.21.15.43:0/1104050405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bfc0ccba0 0x7f2bfc15aa30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:10.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 >> 172.21.15.43:0/1104050405 conn(0x7f2bfc06b7e0 msgr2=0x7f2bfc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:10.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 shutdown_connections 2023-06-08T03:49:10.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:10.886+0000 7f2c00bf3700 1 -- 172.21.15.43:0/1104050405 wait complete. 2023-06-08T03:49:10.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:10.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:11.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.026+0000 7f93a2ed2700 1 Processor -- start 2023-06-08T03:49:11.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.026+0000 7f93a2ed2700 1 -- start start 2023-06-08T03:49:11.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a2ed2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f939c06a4c0 0x7f939c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a2ed2700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c15c8f0 con 0x7f939c15c520 2023-06-08T03:49:11.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a2ed2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c0719b0 con 0x7f939c071560 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a2ed2700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0cd940 con 0x7f939c06a4c0 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a0c6e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f939c15c520 0x7f939c0cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53660/0 (socket says 172.21.15.43:53660) 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a0c6e700 1 -- 172.21.15.43:0/1327633875 learned_addr learned my addr 172.21.15.43:0/1327633875 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f93a146f700 1 --2- 172.21.15.43:0/1327633875 >> v2:172.21.15.135:3300/0 conn(0x7f939c06a4c0 0x7f939c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546226420 0 0) 0x7f9390001110 con 0x7f939c15c520 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.027+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c0035b0 con 0x7f939c15c520 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901661367 0 0) 0x7f938c0035b0 con 0x7f939c15c520 2023-06-08T03:49:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 >> v2:172.21.15.135:3300/0 conn(0x7f939c06a4c0 msgr2=0x7f939c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 --2- 172.21.15.43:0/1327633875 >> v2:172.21.15.135:3300/0 conn(0x7f939c06a4c0 0x7f939c0b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 >> v1:172.21.15.135:6789/0 conn(0x7f939c071560 legacy=0x7f939c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0cd3c0 con 0x7f939c15c520 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f9390001800 con 0x7f939c15c520 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 >> v1:172.21.15.43:6789/0 conn(0x7f939c15c520 legacy=0x7f939c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938c003a00 0x7f938c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c004850 0x7f938c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c005200 0x7f938c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0cd940 con 0x7f938c003a00 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c00c110 con 0x7f938c004850 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c00c2d0 con 0x7f938c005200 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938c003a00 0x7f938c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a146f700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c005200 0x7f938c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f939bfff700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c004850 0x7f938c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 -- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c005200 msgr2=0x7f938c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c005200 0x7f938c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 -- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c004850 msgr2=0x7f938c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c004850 0x7f938c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 -- 172.21.15.43:0/1327633875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0035b0 con 0x7f938c003a00 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a146f700 1 -- 172.21.15.43:0/1327633875 reap_dead start 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.028+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938c003a00 0x7f938c003e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f939000c210 tx=0x7f938c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cee70aa40bef30 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000cd30 con 0x7f938c003a00 2023-06-08T03:49:11.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9390005960 con 0x7f938c003a00 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f939b7fe700 1 -- 172.21.15.43:0/1327633875 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390005d10 con 0x7f938c003a00 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 -- 172.21.15.43:0/1327633875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938c003a00 msgr2=0x7f938c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938c003a00 0x7f938c003e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f939000c210 tx=0x7f938c005880 comp rx=0 tx=0).stop 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 -- 172.21.15.43:0/1327633875 shutdown_connections 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/1327633875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938c003a00 0x7f938c003e10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 -- 172.21.15.43:0/1327633875 >> 172.21.15.43:0/1327633875 conn(0x7f939c06aec0 msgr2=0x7f939c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 -- 172.21.15.43:0/1327633875 shutdown_connections 2023-06-08T03:49:11.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.029+0000 7f93a2ed2700 1 -- 172.21.15.43:0/1327633875 wait complete. 2023-06-08T03:49:11.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.030+0000 7f93a2ed2700 1 Processor -- start 2023-06-08T03:49:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.030+0000 7f93a2ed2700 1 -- start start 2023-06-08T03:49:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f93a2ed2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c003a00 0x7f939c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f93a2ed2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 0x7f939c0ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f93a2ed2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c0adea0 0x7f939c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f93a2ed2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c1f5a30 con 0x7f939c15f4c0 2023-06-08T03:49:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f93a2ed2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0ae310 con 0x7f938c003a00 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f93a2ed2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c15f930 con 0x7f939c0adea0 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f939bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 0x7f939c0ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f939bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 0x7f939c0ad960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58770/0 (socket says 172.21.15.43:58770) 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.031+0000 7f939bfff700 1 -- 172.21.15.43:0/2749340608 learned_addr learned my addr 172.21.15.43:0/2749340608 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c003a00 0x7f939c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93a146f700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c0adea0 0x7f939c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f939bfff700 1 -- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c0adea0 msgr2=0x7f939c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f939bfff700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c0adea0 0x7f939c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f939bfff700 1 -- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c003a00 msgr2=0x7f939c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f939bfff700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c003a00 0x7f939c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f939bfff700 1 -- 172.21.15.43:0/2749340608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c15e420 con 0x7f939c15f4c0 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93a146f700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c0adea0 0x7f939c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f939bfff700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 0x7f939c0ad960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f938800f7a0 tx=0x7f938800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880052e0 con 0x7f939c15f4c0 2023-06-08T03:49:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388005440 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c15e700 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880038c0 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.032+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c15ecc0 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.033+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c073fa0 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.034+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9388003a20 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.034+0000 7f93997fa700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.034+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9388089390 con 0x7f939c15f4c0 2023-06-08T03:49:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.034+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.035+0000 7f93a0c6e700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9390000c00 tx=0x7f939000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.038+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9388054150 con 0x7f939c15f4c0 2023-06-08T03:49:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.235+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f939c0b55d0 con 0x7f939c15f4c0 2023-06-08T03:49:11.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.236+0000 7f93997fa700 1 -- 172.21.15.43:0/2749340608 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9388057770 con 0x7f939c15f4c0 2023-06-08T03:49:11.240 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:11.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 msgr2=0x7f938006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9390000c00 tx=0x7f939000a000 comp rx=0 tx=0).stop 2023-06-08T03:49:11.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 msgr2=0x7f939c0ad960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 0x7f939c0ad960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f938800f7a0 tx=0x7f938800fab0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 shutdown_connections 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c0adea0 0x7f939c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c003a00 0x7f939c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 --2- 172.21.15.43:0/2749340608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c15f4c0 0x7f939c0ad960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 >> 172.21.15.43:0/2749340608 conn(0x7f939c06aec0 msgr2=0x7f939c0c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 shutdown_connections 2023-06-08T03:49:11.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.238+0000 7f93a2ed2700 1 -- 172.21.15.43:0/2749340608 wait complete. 2023-06-08T03:49:11.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:11.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.378+0000 7f44df36f700 1 Processor -- start 2023-06-08T03:49:11.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.378+0000 7f44df36f700 1 -- start start 2023-06-08T03:49:11.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44df36f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44d80cd840 0x7f44d80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44df36f700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d80d0d30 con 0x7f44d815c270 2023-06-08T03:49:11.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44df36f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d80d1520 con 0x7f44d80ce310 2023-06-08T03:49:11.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44df36f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806aec0 con 0x7f44d80cd840 2023-06-08T03:49:11.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44dd10b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f44d815c270 0x7f44d80cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53680/0 (socket says 172.21.15.43:53680) 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44dd10b700 1 -- 172.21.15.43:0/1656263528 learned_addr learned my addr 172.21.15.43:0/1656263528 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44dc90a700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44d80cd840 0x7f44d80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208931561 0 0) 0x7f44d80d0d30 con 0x7f44d815c270 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c40035b0 con 0x7f44d815c270 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597125483 0 0) 0x7f44c40035b0 con 0x7f44d815c270 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44d80cd840 msgr2=0x7f44d80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44d80cd840 0x7f44d80d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 >> v1:172.21.15.135:6789/0 conn(0x7f44d80ce310 legacy=0x7f44d80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80cb1a0 con 0x7f44d815c270 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f44d4001670 con 0x7f44d815c270 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 >> v1:172.21.15.43:6789/0 conn(0x7f44d815c270 legacy=0x7f44d80cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.379+0000 7f44cffff700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44c4003a30 0x7f44c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c40043d0 0x7f44c4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c4005040 0x7f44c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c400bf50 con 0x7f44c4003a30 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c400c090 con 0x7f44c4005040 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c400c250 con 0x7f44c40043d0 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dc90a700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44d80cd840 0x7f44d80d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44c4003a30 0x7f44c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd90c700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c4005040 0x7f44c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dc90a700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c40043d0 0x7f44c4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 -- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c40043d0 msgr2=0x7f44c4004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c40043d0 0x7f44c4004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 -- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c4005040 msgr2=0x7f44c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c4005040 0x7f44c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 -- 172.21.15.43:0/1656263528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40035b0 con 0x7f44c4003a30 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44dd10b700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44c4003a30 0x7f44c4003e00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c2f0 tx=0x7f44c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682eccd8105b718c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400ce30 con 0x7f44c4003a30 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4005960 con 0x7f44c4003a30 2023-06-08T03:49:11.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.380+0000 7f44cffff700 1 -- 172.21.15.43:0/1656263528 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4005d10 con 0x7f44c4003a30 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44df36f700 1 -- 172.21.15.43:0/1656263528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44c4003a30 msgr2=0x7f44c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44df36f700 1 --2- 172.21.15.43:0/1656263528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44c4003a30 0x7f44c4003e00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c2f0 tx=0x7f44c4005880 comp rx=0 tx=0).stop 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44dd90c700 1 -- 172.21.15.43:0/1656263528 reap_dead start 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44df36f700 1 -- 172.21.15.43:0/1656263528 shutdown_connections 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44df36f700 1 -- 172.21.15.43:0/1656263528 >> 172.21.15.43:0/1656263528 conn(0x7f44d8069db0 msgr2=0x7f44d806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44df36f700 1 -- 172.21.15.43:0/1656263528 shutdown_connections 2023-06-08T03:49:11.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.381+0000 7f44df36f700 1 -- 172.21.15.43:0/1656263528 wait complete. 2023-06-08T03:49:11.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.382+0000 7f44df36f700 1 Processor -- start 2023-06-08T03:49:11.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.382+0000 7f44df36f700 1 -- start start 2023-06-08T03:49:11.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44df36f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4003a30 0x7f44d80c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44df36f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 0x7f44d80c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44df36f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44d8154eb0 0x7f44d80c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44df36f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80c73e0 con 0x7f44d8156960 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44df36f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80b5f90 con 0x7f44d8154eb0 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44df36f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80b6270 con 0x7f44c4003a30 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44dc90a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 0x7f44d80c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44dc90a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 0x7f44d80c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58790/0 (socket says 172.21.15.43:58790) 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44dc90a700 1 -- 172.21.15.43:0/912863483 learned_addr learned my addr 172.21.15.43:0/912863483 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44dd90c700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44d8154eb0 0x7f44d80c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.383+0000 7f44dd10b700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4003a30 0x7f44d80c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44dc90a700 1 -- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4003a30 msgr2=0x7f44d80c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44dc90a700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4003a30 0x7f44d80c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44dc90a700 1 -- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44d8154eb0 msgr2=0x7f44d80c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44dc90a700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44d8154eb0 0x7f44d80c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44dc90a700 1 -- 172.21.15.43:0/912863483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80b3710 con 0x7f44d8156960 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44dc90a700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 0x7f44d80c4d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44c8011c00 tx=0x7f44c8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8004030 con 0x7f44d8156960 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8004190 con 0x7f44d8156960 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d80b39f0 con 0x7f44d8156960 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8004520 con 0x7f44d8156960 2023-06-08T03:49:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.384+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d80c7810 con 0x7f44d8156960 2023-06-08T03:49:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.385+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d80b3570 con 0x7f44d8156960 2023-06-08T03:49:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.386+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44c800f8c0 con 0x7f44d8156960 2023-06-08T03:49:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.386+0000 7f44cdffb700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f44bc06ace0 0x7f44bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.386+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44c8089a80 con 0x7f44d8156960 2023-06-08T03:49:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.386+0000 7f44dd10b700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f44bc06ace0 0x7f44bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.387+0000 7f44dd10b700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f44bc06ace0 0x7f44bc06d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44d4015040 tx=0x7f44d4007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.391+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44d80b3570 con 0x7f44d8156960 2023-06-08T03:49:11.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.587+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44d8066680 con 0x7f44d8156960 2023-06-08T03:49:11.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.588+0000 7f44cdffb700 1 -- 172.21.15.43:0/912863483 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44d8066680 con 0x7f44d8156960 2023-06-08T03:49:11.592 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:11.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f44bc06ace0 msgr2=0x7f44bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f44bc06ace0 0x7f44bc06d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44d4015040 tx=0x7f44d4007000 comp rx=0 tx=0).stop 2023-06-08T03:49:11.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 msgr2=0x7f44d80c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 0x7f44d80c4d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44c8011c00 tx=0x7f44c8011f10 comp rx=0 tx=0).stop 2023-06-08T03:49:11.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 shutdown_connections 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f44bc06ace0 0x7f44bc06d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44d8154eb0 0x7f44d80c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4003a30 0x7f44d80c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 --2- 172.21.15.43:0/912863483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44d8156960 0x7f44d80c4d20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 >> 172.21.15.43:0/912863483 conn(0x7f44d8069db0 msgr2=0x7f44d80b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 shutdown_connections 2023-06-08T03:49:11.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.590+0000 7f44df36f700 1 -- 172.21.15.43:0/912863483 wait complete. 2023-06-08T03:49:11.606 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:11.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.728+0000 7f67f9230700 1 Processor -- start 2023-06-08T03:49:11.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f9230700 1 -- start start 2023-06-08T03:49:11.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f9230700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 0x7f67f40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f9230700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40720f0 con 0x7f67f415a400 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f9230700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40cb960 con 0x7f67f4069db0 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f9230700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40cbc40 con 0x7f67f40ccc00 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f259c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f67f415a400 0x7f67f406a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53700/0 (socket says 172.21.15.43:53700) 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.729+0000 7f67f259c700 1 -- 172.21.15.43:0/2326858923 learned_addr learned my addr 172.21.15.43:0/2326858923 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f359e700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 0x7f67f40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108454799 0 0) 0x7f67f40720f0 con 0x7f67f415a400 2023-06-08T03:49:11.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67dc0035b0 con 0x7f67f415a400 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 788565850 0 0) 0x7f67dc0035b0 con 0x7f67f415a400 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 msgr2=0x7f67f40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 0x7f67f40b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 >> v1:172.21.15.135:6789/0 conn(0x7f67f4069db0 legacy=0x7f67f40c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4071d80 con 0x7f67f415a400 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f67e4001670 con 0x7f67f415a400 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 >> v1:172.21.15.43:6789/0 conn(0x7f67f415a400 legacy=0x7f67f406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67dc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67dc004850 0x7f67dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 0x7f67dc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40cbc40 con 0x7f67dc003a30 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc00bb10 con 0x7f67dc004850 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc00bcd0 con 0x7f67f40ccc00 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67dc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f259c700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67dc004850 0x7f67dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f359e700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 0x7f67dc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f2d9d700 1 -- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 msgr2=0x7f67dc005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.730+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f40ccc00 0x7f67dc005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f2d9d700 1 -- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67dc004850 msgr2=0x7f67dc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67dc004850 0x7f67dc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f2d9d700 1 -- 172.21.15.43:0/2326858923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0035b0 con 0x7f67dc003a30 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67dc003e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f67e8001800 tx=0x7f67dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ffec98e60d097f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80012f0 con 0x7f67dc003a30 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e80052f0 con 0x7f67dc003a30 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f1d9b700 1 -- 172.21.15.43:0/2326858923 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8006860 con 0x7f67dc003a30 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f9230700 1 -- 172.21.15.43:0/2326858923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 msgr2=0x7f67dc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f9230700 1 --2- 172.21.15.43:0/2326858923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67dc003e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f67e8001800 tx=0x7f67dc005880 comp rx=0 tx=0).stop 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f359e700 1 -- 172.21.15.43:0/2326858923 reap_dead start 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f9230700 1 -- 172.21.15.43:0/2326858923 shutdown_connections 2023-06-08T03:49:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f9230700 1 -- 172.21.15.43:0/2326858923 >> 172.21.15.43:0/2326858923 conn(0x7f67f406aec0 msgr2=0x7f67f406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:11.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f9230700 1 -- 172.21.15.43:0/2326858923 shutdown_connections 2023-06-08T03:49:11.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.731+0000 7f67f9230700 1 -- 172.21.15.43:0/2326858923 wait complete. 2023-06-08T03:49:11.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.733+0000 7f67f9230700 1 Processor -- start 2023-06-08T03:49:11.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.733+0000 7f67f9230700 1 -- start start 2023-06-08T03:49:11.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f9230700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67f41f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f9230700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f415abd0 0x7f67f40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f9230700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67f415b040 0x7f67f40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f9230700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40c3330 con 0x7f67dc003a30 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f9230700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40c3610 con 0x7f67f415b040 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f9230700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40c38f0 con 0x7f67f415abd0 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67f41f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67f41f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58808/0 (socket says 172.21.15.43:58808) 2023-06-08T03:49:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 -- 172.21.15.43:0/3516136182 learned_addr learned my addr 172.21.15.43:0/3516136182 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f259c700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f415abd0 0x7f67f40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f359e700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67f415b040 0x7f67f40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 -- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f415abd0 msgr2=0x7f67f40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f415abd0 0x7f67f40c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 -- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67f415b040 msgr2=0x7f67f40c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67f415b040 0x7f67f40c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 -- 172.21.15.43:0/3516136182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40c3bd0 con 0x7f67dc003a30 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f359e700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67f415b040 0x7f67f40c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67f2d9d700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67f41f2b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67e8004000 tx=0x7f67e8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.734+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8006d70 con 0x7f67dc003a30 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.735+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8007020 con 0x7f67dc003a30 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.735+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f40c3eb0 con 0x7f67dc003a30 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.735+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80073d0 con 0x7f67dc003a30 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.735+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f40c4e50 con 0x7f67dc003a30 2023-06-08T03:49:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.735+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f4073fa0 con 0x7f67dc003a30 2023-06-08T03:49:11.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.736+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67e8007530 con 0x7f67dc003a30 2023-06-08T03:49:11.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.736+0000 7f67db7fe700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f67e006ace0 0x7f67e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:11.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.737+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f67e808acd0 con 0x7f67dc003a30 2023-06-08T03:49:11.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.737+0000 7f67f259c700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f67e006ace0 0x7f67e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:11.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.737+0000 7f67f259c700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f67e006ace0 0x7f67e006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f67f415a9a0 tx=0x7f67e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:11.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.741+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67e8055c80 con 0x7f67dc003a30 2023-06-08T03:49:11.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.937+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67f40ca4d0 con 0x7f67dc003a30 2023-06-08T03:49:11.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.937+0000 7f67db7fe700 1 -- 172.21.15.43:0/3516136182 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67e80592a0 con 0x7f67dc003a30 2023-06-08T03:49:11.942 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:11.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f67e006ace0 msgr2=0x7f67e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f67e006ace0 0x7f67e006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f67f415a9a0 tx=0x7f67e4009040 comp rx=0 tx=0).stop 2023-06-08T03:49:11.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 msgr2=0x7f67f41f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:11.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67f41f2b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67e8004000 tx=0x7f67e8001120 comp rx=0 tx=0).stop 2023-06-08T03:49:11.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 shutdown_connections 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f67e006ace0 0x7f67e006d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67dc003a30 0x7f67f41f2b50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67f415b040 0x7f67f40c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 --2- 172.21.15.43:0/3516136182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67f415abd0 0x7f67f40c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 >> 172.21.15.43:0/3516136182 conn(0x7f67f406aec0 msgr2=0x7f67f40cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 shutdown_connections 2023-06-08T03:49:11.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:11.940+0000 7f67f9230700 1 -- 172.21.15.43:0/3516136182 wait complete. 2023-06-08T03:49:11.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:12.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.079+0000 7fde0f8ec700 1 Processor -- start 2023-06-08T03:49:12.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.079+0000 7fde0f8ec700 1 -- start start 2023-06-08T03:49:12.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0f8ec700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde080ce040 0x7fde0815a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0f8ec700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde080ae0e0 0x7fde0815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0f8ec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde0815e7f0 0x7fde08070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0f8ec700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0815dad0 con 0x7fde080ae0e0 2023-06-08T03:49:12.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0f8ec700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0815adc0 con 0x7fde080ce040 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0f8ec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815b0a0 con 0x7fde0815e7f0 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde080ae0e0 0x7fde0815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde080ae0e0 0x7fde0815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58816/0 (socket says 172.21.15.43:58816) 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 -- 172.21.15.43:0/85850354 learned_addr learned my addr 172.21.15.43:0/85850354 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0d688700 1 --2- 172.21.15.43:0/85850354 >> v2:172.21.15.135:3300/0 conn(0x7fde080ce040 0x7fde0815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0de89700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde0815e7f0 0x7fde08070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 -- 172.21.15.43:0/85850354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde0815e7f0 msgr2=0x7fde08070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde0815e7f0 0x7fde08070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 -- 172.21.15.43:0/85850354 >> v2:172.21.15.135:3300/0 conn(0x7fde080ce040 msgr2=0x7fde0815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 --2- 172.21.15.43:0/85850354 >> v2:172.21.15.135:3300/0 conn(0x7fde080ce040 0x7fde0815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0ce87700 1 -- 172.21.15.43:0/85850354 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0815b380 con 0x7fde080ae0e0 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0de89700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde0815e7f0 0x7fde08070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.080+0000 7fde0d688700 1 --2- 172.21.15.43:0/85850354 >> v2:172.21.15.135:3300/0 conn(0x7fde080ce040 0x7fde0815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0ce87700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ae0e0 0x7fde0815e2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fde08065c50 tx=0x7fde04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31575ea9f8b3110d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fddfffff700 1 -- 172.21.15.43:0/85850354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400b870 con 0x7fde080ae0e0 2023-06-08T03:49:12.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fddfffff700 1 -- 172.21.15.43:0/85850354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0400b9d0 con 0x7fde080ae0e0 2023-06-08T03:49:12.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fddfffff700 1 -- 172.21.15.43:0/85850354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400bd60 con 0x7fde080ae0e0 2023-06-08T03:49:12.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 -- 172.21.15.43:0/85850354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ae0e0 msgr2=0x7fde0815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ae0e0 0x7fde0815e2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fde08065c50 tx=0x7fde04009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 -- 172.21.15.43:0/85850354 shutdown_connections 2023-06-08T03:49:12.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde0815e7f0 0x7fde08070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/85850354 >> v2:172.21.15.135:3300/0 conn(0x7fde080ce040 0x7fde0815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/85850354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ae0e0 0x7fde0815e2b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 -- 172.21.15.43:0/85850354 >> 172.21.15.43:0/85850354 conn(0x7fde080cee30 msgr2=0x7fde080cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 -- 172.21.15.43:0/85850354 shutdown_connections 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.081+0000 7fde0f8ec700 1 -- 172.21.15.43:0/85850354 wait complete. 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.083+0000 7fde0f8ec700 1 Processor -- start 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.083+0000 7fde0f8ec700 1 -- start start 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0f8ec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde080ae0e0 0x7fde080c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0f8ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 0x7fde080b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0f8ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0815e7f0 0x7fde080b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0f8ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08154880 con 0x7fde080ce040 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0f8ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08157c60 con 0x7fde0815e7f0 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0f8ec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080b4b30 con 0x7fde080ae0e0 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0ce87700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 0x7fde080b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0ce87700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 0x7fde080b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58822/0 (socket says 172.21.15.43:58822) 2023-06-08T03:49:12.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0ce87700 1 -- 172.21.15.43:0/1324355423 learned_addr learned my addr 172.21.15.43:0/1324355423 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0d688700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde080ae0e0 0x7fde080c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.084+0000 7fde0de89700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0815e7f0 0x7fde080b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0ce87700 1 -- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde080ae0e0 msgr2=0x7fde080c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0ce87700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde080ae0e0 0x7fde080c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0ce87700 1 -- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0815e7f0 msgr2=0x7fde080b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0ce87700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0815e7f0 0x7fde080b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0ce87700 1 -- 172.21.15.43:0/1324355423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04009550 con 0x7fde080ce040 2023-06-08T03:49:12.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0d688700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde080ae0e0 0x7fde080c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0ce87700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 0x7fde080b2aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde080705f0 tx=0x7fde04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04004540 con 0x7fde080ce040 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde040036a0 con 0x7fde080ce040 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde080c5390 con 0x7fde080ce040 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04003a50 con 0x7fde080ce040 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.085+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde08154b40 con 0x7fde080ce040 2023-06-08T03:49:12.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.086+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde080cb6b0 con 0x7fde080ce040 2023-06-08T03:49:12.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.087+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde04021070 con 0x7fde080ce040 2023-06-08T03:49:12.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.087+0000 7fddfdffb700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddec06ace0 0x7fddec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.087+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde0408ae50 con 0x7fde080ce040 2023-06-08T03:49:12.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.087+0000 7fde0d688700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddec06ace0 0x7fddec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.088+0000 7fde0d688700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddec06ace0 0x7fddec06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fddf8003930 tx=0x7fddf8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.091+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde04055ca0 con 0x7fde080ce040 2023-06-08T03:49:12.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.285+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde080c9530 con 0x7fde080ce040 2023-06-08T03:49:12.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.285+0000 7fddfdffb700 1 -- 172.21.15.43:0/1324355423 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde040150a0 con 0x7fde080ce040 2023-06-08T03:49:12.290 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:12.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddec06ace0 msgr2=0x7fddec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddec06ace0 0x7fddec06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fddf8003930 tx=0x7fddf8008040 comp rx=0 tx=0).stop 2023-06-08T03:49:12.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 msgr2=0x7fde080b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 0x7fde080b2aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde080705f0 tx=0x7fde04004750 comp rx=0 tx=0).stop 2023-06-08T03:49:12.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 shutdown_connections 2023-06-08T03:49:12.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddec06ace0 0x7fddec06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0815e7f0 0x7fde080b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde080ae0e0 0x7fde080c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 --2- 172.21.15.43:0/1324355423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde080ce040 0x7fde080b2aa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 >> 172.21.15.43:0/1324355423 conn(0x7fde080cee30 msgr2=0x7fde0806a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:12.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 shutdown_connections 2023-06-08T03:49:12.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.287+0000 7fde0f8ec700 1 -- 172.21.15.43:0/1324355423 wait complete. 2023-06-08T03:49:12.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:12.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.426+0000 7f272d12e700 1 Processor -- start 2023-06-08T03:49:12.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.426+0000 7f272d12e700 1 -- start start 2023-06-08T03:49:12.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272d12e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f27280b60a0 0x7f27280cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272d12e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f272815e340 0x7f27280cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272d12e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280cda20 con 0x7f27280cf5b0 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272d12e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280b6470 con 0x7f272815e340 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272d12e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272815e7a0 con 0x7f27280b60a0 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272659c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f27280cf5b0 0x7f272815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53732/0 (socket says 172.21.15.43:53732) 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272759e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f272815e340 0x7f27280cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.427+0000 7f272659c700 1 -- 172.21.15.43:0/3271265695 learned_addr learned my addr 172.21.15.43:0/3271265695 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f2725d9b700 1 -- 172.21.15.43:0/3271265695 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292793071 0 0) 0x7f27280cda20 con 0x7f27280cf5b0 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f2725d9b700 1 -- 172.21.15.43:0/3271265695 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27100035b0 con 0x7f27280cf5b0 2023-06-08T03:49:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272759e700 1 -- 172.21.15.43:0/3271265695 >> v2:172.21.15.135:3300/0 conn(0x7f27280b60a0 msgr2=0x7f27280cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272759e700 1 --2- 172.21.15.43:0/3271265695 >> v2:172.21.15.135:3300/0 conn(0x7f27280b60a0 0x7f27280cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272759e700 1 -- 172.21.15.43:0/3271265695 >> v1:172.21.15.43:6789/0 conn(0x7f27280cf5b0 legacy=0x7f272815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272759e700 1 -- 172.21.15.43:0/3271265695 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272815a520 con 0x7f272815e340 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272759e700 1 --2- 172.21.15.43:0/3271265695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfb00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f272806f5e0 tx=0x7f272000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc1e88b6a0ffd58 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f2725d9b700 1 -- 172.21.15.43:0/3271265695 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000e070 con 0x7f272815e340 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f2725d9b700 1 -- 172.21.15.43:0/3271265695 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272000bb20 con 0x7f272815e340 2023-06-08T03:49:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f2725d9b700 1 -- 172.21.15.43:0/3271265695 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720012430 con 0x7f272815e340 2023-06-08T03:49:12.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272d12e700 1 -- 172.21.15.43:0/3271265695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 msgr2=0x7f27280cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.428+0000 7f272d12e700 1 --2- 172.21.15.43:0/3271265695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfb00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f272806f5e0 tx=0x7f272000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.429+0000 7f272d12e700 1 -- 172.21.15.43:0/3271265695 shutdown_connections 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.429+0000 7f272d12e700 1 --2- 172.21.15.43:0/3271265695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfb00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.429+0000 7f272d12e700 1 --2- 172.21.15.43:0/3271265695 >> v2:172.21.15.135:3300/0 conn(0x7f27280b60a0 0x7f27280cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.429+0000 7f272d12e700 1 -- 172.21.15.43:0/3271265695 >> 172.21.15.43:0/3271265695 conn(0x7f2728069db0 msgr2=0x7f272806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.429+0000 7f272d12e700 1 -- 172.21.15.43:0/3271265695 shutdown_connections 2023-06-08T03:49:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.429+0000 7f272d12e700 1 -- 172.21.15.43:0/3271265695 wait complete. 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.430+0000 7f272d12e700 1 Processor -- start 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.430+0000 7f272d12e700 1 -- start start 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272d12e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27280b60a0 0x7f27281ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272d12e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27280cf5b0 0x7f272815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272d12e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272d12e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27281ef840 con 0x7f272815e340 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272d12e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272815d5e0 con 0x7f27280b60a0 2023-06-08T03:49:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272d12e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272815a710 con 0x7f27280cf5b0 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58838/0 (socket says 172.21.15.43:58838) 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 -- 172.21.15.43:0/2457528220 learned_addr learned my addr 172.21.15.43:0/2457528220 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272659c700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27280cf5b0 0x7f272815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f2726d9d700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27280b60a0 0x7f27281ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 -- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27280cf5b0 msgr2=0x7f272815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27280cf5b0 0x7f272815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 -- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27280b60a0 msgr2=0x7f27281ef300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27280b60a0 0x7f27281ef300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.431+0000 7f272759e700 1 -- 172.21.15.43:0/2457528220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720009a70 con 0x7f272815e340 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.432+0000 7f272759e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2720014040 tx=0x7f2720004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.432+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720012430 con 0x7f272815e340 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.432+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720020070 con 0x7f272815e340 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.432+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272815a9f0 con 0x7f272815e340 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.432+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720003ea0 con 0x7f272815e340 2023-06-08T03:49:12.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.432+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272815afb0 con 0x7f272815e340 2023-06-08T03:49:12.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.433+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272814f370 con 0x7f272815e340 2023-06-08T03:49:12.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.433+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2720004040 con 0x7f272815e340 2023-06-08T03:49:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.434+0000 7f270f7fe700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f271406ace0 0x7f271406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.434+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2720022070 con 0x7f272815e340 2023-06-08T03:49:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.434+0000 7f2726d9d700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f271406ace0 0x7f271406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.434+0000 7f2726d9d700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f271406ace0 0x7f271406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f271c009970 tx=0x7f271c009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.438+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27200565e0 con 0x7f272815e340 2023-06-08T03:49:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.636+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2728073fa0 con 0x7f272815e340 2023-06-08T03:49:12.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.636+0000 7f270f7fe700 1 -- 172.21.15.43:0/2457528220 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2720059c00 con 0x7f272815e340 2023-06-08T03:49:12.641 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:12.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.638+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f271406ace0 msgr2=0x7f271406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.638+0000 7f272d12e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f271406ace0 0x7f271406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f271c009970 tx=0x7f271c009110 comp rx=0 tx=0).stop 2023-06-08T03:49:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.638+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 msgr2=0x7f27280cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.638+0000 7f272d12e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2720014040 tx=0x7f2720004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 shutdown_connections 2023-06-08T03:49:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f271406ace0 0x7f271406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f272815e340 0x7f27280cfab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27280b60a0 0x7f27281ef300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 --2- 172.21.15.43:0/2457528220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27280cf5b0 0x7f272815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 >> 172.21.15.43:0/2457528220 conn(0x7f2728069db0 msgr2=0x7f27280b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:12.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 shutdown_connections 2023-06-08T03:49:12.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.639+0000 7f272d12e700 1 -- 172.21.15.43:0/2457528220 wait complete. 2023-06-08T03:49:12.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:12.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.777+0000 7fd898cf0700 1 Processor -- start 2023-06-08T03:49:12.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.777+0000 7fd898cf0700 1 -- start start 2023-06-08T03:49:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd898cf0700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89415c590 0x7fd8940af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd898cf0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd89406a4c0 0x7fd8940b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd898cf0700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8940af050 con 0x7fd8940ccba0 2023-06-08T03:49:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd898cf0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8940afae0 con 0x7fd89406a4c0 2023-06-08T03:49:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd898cf0700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940ccff0 con 0x7fd89415c590 2023-06-08T03:49:12.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd891d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd8940ccba0 0x7fd894069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53748/0 (socket says 172.21.15.43:53748) 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd891d9b700 1 -- 172.21.15.43:0/4221281954 learned_addr learned my addr 172.21.15.43:0/4221281954 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89259c700 1 --2- 172.21.15.43:0/4221281954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89415c590 0x7fd8940af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd892d9d700 1 --2- 172.21.15.43:0/4221281954 >> v2:172.21.15.135:3300/0 conn(0x7fd89406a4c0 0x7fd8940b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89159a700 1 -- 172.21.15.43:0/4221281954 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573737724 0 0) 0x7fd8940af050 con 0x7fd8940ccba0 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89159a700 1 -- 172.21.15.43:0/4221281954 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c0035b0 con 0x7fd8940ccba0 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89259c700 1 -- 172.21.15.43:0/4221281954 >> v2:172.21.15.135:3300/0 conn(0x7fd89406a4c0 msgr2=0x7fd8940b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89259c700 1 --2- 172.21.15.43:0/4221281954 >> v2:172.21.15.135:3300/0 conn(0x7fd89406a4c0 0x7fd8940b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89259c700 1 -- 172.21.15.43:0/4221281954 >> v1:172.21.15.43:6789/0 conn(0x7fd8940ccba0 legacy=0x7fd894069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd89259c700 1 -- 172.21.15.43:0/4221281954 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8940af800 con 0x7fd89415c590 2023-06-08T03:49:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.778+0000 7fd892d9d700 1 --2- 172.21.15.43:0/4221281954 >> v2:172.21.15.135:3300/0 conn(0x7fd89406a4c0 0x7fd8940b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd89259c700 1 --2- 172.21.15.43:0/4221281954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89415c590 0x7fd8940af220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd884009820 tx=0x7fd884009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=803dcf1bb2db3f89 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd89159a700 1 -- 172.21.15.43:0/4221281954 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884005e30 con 0x7fd89415c590 2023-06-08T03:49:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd89159a700 1 -- 172.21.15.43:0/4221281954 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884006030 con 0x7fd89415c590 2023-06-08T03:49:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd89159a700 1 -- 172.21.15.43:0/4221281954 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8840063c0 con 0x7fd89415c590 2023-06-08T03:49:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 -- 172.21.15.43:0/4221281954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89415c590 msgr2=0x7fd8940af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 --2- 172.21.15.43:0/4221281954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89415c590 0x7fd8940af220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd884009820 tx=0x7fd884009b30 comp rx=0 tx=0).stop 2023-06-08T03:49:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 -- 172.21.15.43:0/4221281954 shutdown_connections 2023-06-08T03:49:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 --2- 172.21.15.43:0/4221281954 >> v2:172.21.15.135:3300/0 conn(0x7fd89406a4c0 0x7fd8940b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 --2- 172.21.15.43:0/4221281954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd89415c590 0x7fd8940af220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 -- 172.21.15.43:0/4221281954 >> 172.21.15.43:0/4221281954 conn(0x7fd89406b7e0 msgr2=0x7fd8940cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.779+0000 7fd898cf0700 1 -- 172.21.15.43:0/4221281954 shutdown_connections 2023-06-08T03:49:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.780+0000 7fd898cf0700 1 -- 172.21.15.43:0/4221281954 wait complete. 2023-06-08T03:49:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.781+0000 7fd898cf0700 1 Processor -- start 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.781+0000 7fd898cf0700 1 -- start start 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89406a4c0 0x7fd8940c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8940ccba0 0x7fd8940c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 0x7fd89414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941f57b0 con 0x7fd89415c590 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c98d0 con 0x7fd89406a4c0 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c6de0 con 0x7fd8940ccba0 2023-06-08T03:49:12.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 0x7fd89414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 0x7fd89414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58852/0 (socket says 172.21.15.43:58852) 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 -- 172.21.15.43:0/1897101775 learned_addr learned my addr 172.21.15.43:0/1897101775 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd891d9b700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8940ccba0 0x7fd8940c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd89259c700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89406a4c0 0x7fd8940c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 -- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8940ccba0 msgr2=0x7fd8940c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8940ccba0 0x7fd8940c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 -- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89406a4c0 msgr2=0x7fd8940c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89406a4c0 0x7fd8940c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 -- 172.21.15.43:0/1897101775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009a70 con 0x7fd89415c590 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd892d9d700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 0x7fd89414dab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00efc0 tx=0x7fd88c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00ca90 con 0x7fd89415c590 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c00f040 con 0x7fd89415c590 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd884009430 con 0x7fd89415c590 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00ce50 con 0x7fd89415c590 2023-06-08T03:49:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.782+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8941f5ce0 con 0x7fd89415c590 2023-06-08T03:49:12.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.783+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8940b0ca0 con 0x7fd89415c590 2023-06-08T03:49:12.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.784+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd88c014480 con 0x7fd89415c590 2023-06-08T03:49:12.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.784+0000 7fd882ffd700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd87406ace0 0x7fd87406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:12.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.784+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd88c089cd0 con 0x7fd89415c590 2023-06-08T03:49:12.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.784+0000 7fd89259c700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd87406ace0 0x7fd87406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:12.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.785+0000 7fd89259c700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd87406ace0 0x7fd87406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd884009b70 tx=0x7fd884008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:12.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:12.789+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd88c054b20 con 0x7fd89415c590 2023-06-08T03:49:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.032+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd894073fa0 con 0x7fd89415c590 2023-06-08T03:49:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.032+0000 7fd882ffd700 1 -- 172.21.15.43:0/1897101775 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd88c058140 con 0x7fd89415c590 2023-06-08T03:49:13.036 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:13.037 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd87406ace0 msgr2=0x7fd87406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd87406ace0 0x7fd87406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd884009b70 tx=0x7fd884008070 comp rx=0 tx=0).stop 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 msgr2=0x7fd89414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 0x7fd89414dab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00efc0 tx=0x7fd88c00c3a0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 shutdown_connections 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd87406ace0 0x7fd87406d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd89415c590 0x7fd89414dab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd89406a4c0 0x7fd8940c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 --2- 172.21.15.43:0/1897101775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8940ccba0 0x7fd8940c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.034+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 >> 172.21.15.43:0/1897101775 conn(0x7fd89406b7e0 msgr2=0x7fd894069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.035+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 shutdown_connections 2023-06-08T03:49:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.035+0000 7fd898cf0700 1 -- 172.21.15.43:0/1897101775 wait complete. 2023-06-08T03:49:13.041 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:13.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.171+0000 7f1f78692700 1 Processor -- start 2023-06-08T03:49:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.171+0000 7f1f78692700 1 -- start start 2023-06-08T03:49:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f78692700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f70069db0 0x7f1f7006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f78692700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1f700ae080 0x7f1f700af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f78692700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f700acbe0 con 0x7f1f700d0380 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f78692700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f700ac2d0 con 0x7f1f70069db0 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f78692700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7006a6c0 con 0x7f1f700ae080 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f70069db0 0x7f1f7006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f70069db0 0x7f1f7006a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58856/0 (socket says 172.21.15.43:58856) 2023-06-08T03:49:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 -- 172.21.15.43:0/3723092009 learned_addr learned my addr 172.21.15.43:0/3723092009 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f76c2f700 1 --2- 172.21.15.43:0/3723092009 >> v2:172.21.15.135:3300/0 conn(0x7f1f700ae080 0x7f1f700af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 -- 172.21.15.43:0/3723092009 >> v2:172.21.15.135:3300/0 conn(0x7f1f700ae080 msgr2=0x7f1f700af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 --2- 172.21.15.43:0/3723092009 >> v2:172.21.15.135:3300/0 conn(0x7f1f700ae080 0x7f1f700af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 -- 172.21.15.43:0/3723092009 >> v1:172.21.15.135:6789/0 conn(0x7f1f700d0380 legacy=0x7f1f700aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 -- 172.21.15.43:0/3723092009 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700b0860 con 0x7f1f70069db0 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.172+0000 7f1f7642e700 1 --2- 172.21.15.43:0/3723092009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f7006a180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f7006d010 tx=0x7f1f6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6470df40cb0acb1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f7542c700 1 -- 172.21.15.43:0/3723092009 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c005e30 con 0x7f1f70069db0 2023-06-08T03:49:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f7542c700 1 -- 172.21.15.43:0/3723092009 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c004030 con 0x7f1f70069db0 2023-06-08T03:49:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f7542c700 1 -- 172.21.15.43:0/3723092009 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0043e0 con 0x7f1f70069db0 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 -- 172.21.15.43:0/3723092009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 msgr2=0x7f1f7006a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 --2- 172.21.15.43:0/3723092009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f7006a180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f7006d010 tx=0x7f1f6c009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 -- 172.21.15.43:0/3723092009 shutdown_connections 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 --2- 172.21.15.43:0/3723092009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f7006a180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 --2- 172.21.15.43:0/3723092009 >> v2:172.21.15.135:3300/0 conn(0x7f1f700ae080 0x7f1f700af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 -- 172.21.15.43:0/3723092009 >> 172.21.15.43:0/3723092009 conn(0x7f1f7006b7e0 msgr2=0x7f1f700cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 -- 172.21.15.43:0/3723092009 shutdown_connections 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.173+0000 7f1f78692700 1 -- 172.21.15.43:0/3723092009 wait complete. 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 Processor -- start 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 -- start start 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f70152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f700ae080 0x7f1f700c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f700d0380 0x7f1f700c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700cec20 con 0x7f1f70069db0 2023-06-08T03:49:13.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700b2670 con 0x7f1f700d0380 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f78692700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700b2950 con 0x7f1f700ae080 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.175+0000 7f1f7642e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f70152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f70152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58862/0 (socket says 172.21.15.43:58862) 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 -- 172.21.15.43:0/3769655393 learned_addr learned my addr 172.21.15.43:0/3769655393 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f75c2d700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f700ae080 0x7f1f700c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f76c2f700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f700d0380 0x7f1f700c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 -- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f700ae080 msgr2=0x7f1f700c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f700ae080 0x7f1f700c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 -- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f700d0380 msgr2=0x7f1f700c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f700d0380 0x7f1f700c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 -- 172.21.15.43:0/3769655393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c009500 con 0x7f1f70069db0 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f7642e700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f70152140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009c10 tx=0x7f1f6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c003c30 con 0x7f1f70069db0 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c003d90 con 0x7f1f70069db0 2023-06-08T03:49:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f700b2c30 con 0x7f1f70069db0 2023-06-08T03:49:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c01c640 con 0x7f1f70069db0 2023-06-08T03:49:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.176+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f700c37f0 con 0x7f1f70069db0 2023-06-08T03:49:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.177+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f700ac570 con 0x7f1f70069db0 2023-06-08T03:49:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.178+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f6c01c7a0 con 0x7f1f70069db0 2023-06-08T03:49:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.178+0000 7f1f66ffd700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1f5406ace0 0x7f1f5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.178+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f6c08a840 con 0x7f1f70069db0 2023-06-08T03:49:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.178+0000 7f1f75c2d700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1f5406ace0 0x7f1f5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.179+0000 7f1f75c2d700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1f5406ace0 0x7f1f5406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f60007fd0 tx=0x7f1f60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.182+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f6c055770 con 0x7f1f70069db0 2023-06-08T03:49:13.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.382+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f700b3150 con 0x7f1f70069db0 2023-06-08T03:49:13.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.383+0000 7f1f66ffd700 1 -- 172.21.15.43:0/3769655393 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f1f700b3150 con 0x7f1f70069db0 2023-06-08T03:49:13.388 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:13.388 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:13.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1f5406ace0 msgr2=0x7f1f5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1f5406ace0 0x7f1f5406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f60007fd0 tx=0x7f1f60009040 comp rx=0 tx=0).stop 2023-06-08T03:49:13.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 msgr2=0x7f1f70152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f70152140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009c10 tx=0x7f1f6c004750 comp rx=0 tx=0).stop 2023-06-08T03:49:13.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 shutdown_connections 2023-06-08T03:49:13.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1f5406ace0 0x7f1f5406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f70069db0 0x7f1f70152140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f700d0380 0x7f1f700c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 --2- 172.21.15.43:0/3769655393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f700ae080 0x7f1f700c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 >> 172.21.15.43:0/3769655393 conn(0x7f1f7006b7e0 msgr2=0x7f1f700aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:13.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 shutdown_connections 2023-06-08T03:49:13.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.385+0000 7f1f78692700 1 -- 172.21.15.43:0/3769655393 wait complete. 2023-06-08T03:49:13.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:13.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:13.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.525+0000 7fc2f9d1a700 1 Processor -- start 2023-06-08T03:49:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f9d1a700 1 -- start start 2023-06-08T03:49:13.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f9d1a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2f40cd930 0x7fc2f40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f9d1a700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f406f480 con 0x7fc2f4159380 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f9d1a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f406f760 con 0x7fc2f40b1dc0 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f9d1a700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f40b10d0 con 0x7fc2f40cd930 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f37fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc2f4159380 0x7fc2f40cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53774/0 (socket says 172.21.15.43:53774) 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.526+0000 7fc2f37fe700 1 -- 172.21.15.43:0/4093358979 learned_addr learned my addr 172.21.15.43:0/4093358979 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f2ffd700 1 --2- 172.21.15.43:0/4093358979 >> v2:172.21.15.135:3300/0 conn(0x7fc2f40cd930 0x7fc2f40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282041701 0 0) 0x7fc2f406f480 con 0x7fc2f4159380 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e00035b0 con 0x7fc2f4159380 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2407166870 0 0) 0x7fc2e00035b0 con 0x7fc2f4159380 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 >> v2:172.21.15.135:3300/0 conn(0x7fc2f40cd930 msgr2=0x7fc2f40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 --2- 172.21.15.43:0/4093358979 >> v2:172.21.15.135:3300/0 conn(0x7fc2f40cd930 0x7fc2f40716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 >> v1:172.21.15.135:6789/0 conn(0x7fc2f40b1dc0 legacy=0x7fc2f40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40b12e0 con 0x7fc2f4159380 2023-06-08T03:49:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7fc2e40019f0 con 0x7fc2f4159380 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 >> v1:172.21.15.43:6789/0 conn(0x7fc2f4159380 legacy=0x7fc2f40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0003a00 0x7fc2e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0004850 0x7fc2e0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40b10d0 con 0x7fc2e0005200 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e000c110 con 0x7fc2e0003a00 2023-06-08T03:49:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e000c2d0 con 0x7fc2e0004850 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f3fff700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f2ffd700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0004850 0x7fc2e0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.527+0000 7fc2f37fe700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0003a00 0x7fc2e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 -- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0004850 msgr2=0x7fc2e0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0004850 0x7fc2e0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 -- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0003a00 msgr2=0x7fc2e0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0003a00 0x7fc2e0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 -- 172.21.15.43:0/4093358979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00035b0 con 0x7fc2e0005200 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f2ffd700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0004850 0x7fc2e0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 -- 172.21.15.43:0/4093358979 reap_dead start 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f3fff700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2e000ba10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0017c0 tx=0x7fc2e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1eb3db22e95a56 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0052d0 con 0x7fc2e0005200 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec005430 con 0x7fc2e0005200 2023-06-08T03:49:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f27fc700 1 -- 172.21.15.43:0/4093358979 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0038c0 con 0x7fc2e0005200 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/4093358979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 msgr2=0x7fc2e000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2e000ba10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0017c0 tx=0x7fc2e0005880 comp rx=0 tx=0).stop 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/4093358979 shutdown_connections 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/4093358979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2e000ba10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/4093358979 >> 172.21.15.43:0/4093358979 conn(0x7fc2f406aec0 msgr2=0x7fc2f406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/4093358979 shutdown_connections 2023-06-08T03:49:13.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.528+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/4093358979 wait complete. 2023-06-08T03:49:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.530+0000 7fc2f9d1a700 1 Processor -- start 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.530+0000 7fc2f9d1a700 1 -- start start 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2f4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f40c7340 0x7fc2f41dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2f4156fb0 0x7fc2f4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4157990 con 0x7fc2e0005200 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c81a0 con 0x7fc2f40c7340 2023-06-08T03:49:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41519d0 con 0x7fc2f4156fb0 2023-06-08T03:49:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2f4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2f4151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58882/0 (socket says 172.21.15.43:58882) 2023-06-08T03:49:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 -- 172.21.15.43:0/2453252417 learned_addr learned my addr 172.21.15.43:0/2453252417 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f2ffd700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f40c7340 0x7fc2f41dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f3fff700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2f4156fb0 0x7fc2f4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 -- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2f4156fb0 msgr2=0x7fc2f4157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2f4156fb0 0x7fc2f4157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 -- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f40c7340 msgr2=0x7fc2f41dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f40c7340 0x7fc2f41dfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 -- 172.21.15.43:0/2453252417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f41e0010 con 0x7fc2e0005200 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f37fe700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2f4151490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a310 tx=0x7fc2e400a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40133f0 con 0x7fc2e0005200 2023-06-08T03:49:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4013550 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f40c7900 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.531+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4013900 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.532+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f40c7ec0 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.532+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4073fa0 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.533+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2e4013a60 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.533+0000 7fc2ebfff700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2d406ad30 0x7fc2d406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.533+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2e408a3c0 con 0x7fc2e0005200 2023-06-08T03:49:13.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.534+0000 7fc2f2ffd700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2d406ad30 0x7fc2d406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.534+0000 7fc2f2ffd700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2d406ad30 0x7fc2d406d1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2f41df9b0 tx=0x7fc2dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.538+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2e4055160 con 0x7fc2e0005200 2023-06-08T03:49:13.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.733+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2f40714a0 con 0x7fc2e0005200 2023-06-08T03:49:13.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.733+0000 7fc2ebfff700 1 -- 172.21.15.43:0/2453252417 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2e4058780 con 0x7fc2e0005200 2023-06-08T03:49:13.738 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:13.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2d406ad30 msgr2=0x7fc2d406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2d406ad30 0x7fc2d406d1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2f41df9b0 tx=0x7fc2dc008040 comp rx=0 tx=0).stop 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 msgr2=0x7fc2f4151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2f4151490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a310 tx=0x7fc2e400a6d0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 shutdown_connections 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2d406ad30 0x7fc2d406d1e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0005200 0x7fc2f4151490 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2f4156fb0 0x7fc2f4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 --2- 172.21.15.43:0/2453252417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f40c7340 0x7fc2f41dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 >> 172.21.15.43:0/2453252417 conn(0x7fc2f406aec0 msgr2=0x7fc2f40af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:13.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.735+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 shutdown_connections 2023-06-08T03:49:13.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.736+0000 7fc2f9d1a700 1 -- 172.21.15.43:0/2453252417 wait complete. 2023-06-08T03:49:13.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:13.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.875+0000 7fcfcc62b700 1 Processor -- start 2023-06-08T03:49:13.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.875+0000 7fcfcc62b700 1 -- start start 2023-06-08T03:49:13.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfcc62b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfc40cd930 0x7fcfc40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfcc62b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcfc40b1dc0 0x7fcfc40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfcc62b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc406f480 con 0x7fcfc4159380 2023-06-08T03:49:13.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfcc62b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc40b10d0 con 0x7fcfc40cd930 2023-06-08T03:49:13.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfcc62b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc406f760 con 0x7fcfc40b1dc0 2023-06-08T03:49:13.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfc9bc6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfc40cd930 0x7fcfc40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfca3c7700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcfc4159380 0x7fcfc40cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53794/0 (socket says 172.21.15.43:53794) 2023-06-08T03:49:13.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfca3c7700 1 -- 172.21.15.43:0/2958670434 learned_addr learned my addr 172.21.15.43:0/2958670434 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:13.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfcabc8700 1 --2- 172.21.15.43:0/2958670434 >> v2:172.21.15.135:3300/0 conn(0x7fcfc40b1dc0 0x7fcfc40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfc9bc6700 1 -- 172.21.15.43:0/2958670434 >> v2:172.21.15.135:3300/0 conn(0x7fcfc40b1dc0 msgr2=0x7fcfc40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfc9bc6700 1 --2- 172.21.15.43:0/2958670434 >> v2:172.21.15.135:3300/0 conn(0x7fcfc40b1dc0 0x7fcfc40ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfc9bc6700 1 -- 172.21.15.43:0/2958670434 >> v1:172.21.15.43:6789/0 conn(0x7fcfc4159380 legacy=0x7fcfc40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfc93c5700 1 -- 172.21.15.43:0/2958670434 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438546812 0 0) 0x7fcfc406f480 con 0x7fcfc4159380 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.876+0000 7fcfc9bc6700 1 -- 172.21.15.43:0/2958670434 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc40b12e0 con 0x7fcfc40cd930 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfc9bc6700 1 --2- 172.21.15.43:0/2958670434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc40cd930 0x7fcfc40716c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcfc415cc20 tx=0x7fcfc0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b92821c5100f60 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfc93c5700 1 -- 172.21.15.43:0/2958670434 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0011830 con 0x7fcfc40cd930 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfc93c5700 1 -- 172.21.15.43:0/2958670434 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0011990 con 0x7fcfc40cd930 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfc93c5700 1 -- 172.21.15.43:0/2958670434 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0011d20 con 0x7fcfc40cd930 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2958670434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc40cd930 msgr2=0x7fcfc40716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2958670434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc40cd930 0x7fcfc40716c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcfc415cc20 tx=0x7fcfc0009b20 comp rx=0 tx=0).stop 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2958670434 shutdown_connections 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2958670434 >> v2:172.21.15.135:3300/0 conn(0x7fcfc40b1dc0 0x7fcfc40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2958670434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc40cd930 0x7fcfc40716c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2958670434 >> 172.21.15.43:0/2958670434 conn(0x7fcfc406aec0 msgr2=0x7fcfc406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:13.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2958670434 shutdown_connections 2023-06-08T03:49:13.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.877+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2958670434 wait complete. 2023-06-08T03:49:13.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 Processor -- start 2023-06-08T03:49:13.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 -- start start 2023-06-08T03:49:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfc40b1dc0 0x7fcfc41f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc40cd930 0x7fcfc41f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 0x7fcfc40ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c6ea0 con 0x7fcfc4159380 2023-06-08T03:49:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c7460 con 0x7fcfc40cd930 2023-06-08T03:49:13.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.879+0000 7fcfcc62b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40cad90 con 0x7fcfc40b1dc0 2023-06-08T03:49:13.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 0x7fcfc40ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 0x7fcfc40ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58900/0 (socket says 172.21.15.43:58900) 2023-06-08T03:49:13.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 -- 172.21.15.43:0/2614365832 learned_addr learned my addr 172.21.15.43:0/2614365832 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:13.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfc9bc6700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc40cd930 0x7fcfc41f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfca3c7700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfc40b1dc0 0x7fcfc41f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 -- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfc40b1dc0 msgr2=0x7fcfc41f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfc40b1dc0 0x7fcfc41f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 -- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc40cd930 msgr2=0x7fcfc41f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc40cd930 0x7fcfc41f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 -- 172.21.15.43:0/2614365832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00094a0 con 0x7fcfc4159380 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfc9bc6700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc40cd930 0x7fcfc41f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcabc8700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 0x7fcfc40ca540 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00cd70 tx=0x7fcfbc00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc003a20 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc003b80 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc40cb070 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc004020 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.880+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc40caa80 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.881+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc40cb2b0 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.882+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfbc004180 con 0x7fcfc4159380 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.882+0000 7fcfbaffd700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa806ace0 0x7fcfa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:13.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.882+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfbc012070 con 0x7fcfc4159380 2023-06-08T03:49:13.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.883+0000 7fcfca3c7700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa806ace0 0x7fcfa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:13.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.883+0000 7fcfca3c7700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa806ace0 0x7fcfa806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4000f60 tx=0x7fcfb4007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:13.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:13.887+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcfbc054e10 con 0x7fcfc4159380 2023-06-08T03:49:14.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.084+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfc40c75d0 con 0x7fcfc4159380 2023-06-08T03:49:14.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.085+0000 7fcfbaffd700 1 -- 172.21.15.43:0/2614365832 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfbc058430 con 0x7fcfc4159380 2023-06-08T03:49:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa806ace0 msgr2=0x7fcfa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa806ace0 0x7fcfa806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4000f60 tx=0x7fcfb4007c90 comp rx=0 tx=0).stop 2023-06-08T03:49:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 msgr2=0x7fcfc40ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 0x7fcfc40ca540 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00cd70 tx=0x7fcfbc00a570 comp rx=0 tx=0).stop 2023-06-08T03:49:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 shutdown_connections 2023-06-08T03:49:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa806ace0 0x7fcfa806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4159380 0x7fcfc40ca540 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfc40b1dc0 0x7fcfc41f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 --2- 172.21.15.43:0/2614365832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc40cd930 0x7fcfc41f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 >> 172.21.15.43:0/2614365832 conn(0x7fcfc406aec0 msgr2=0x7fcfc4157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 shutdown_connections 2023-06-08T03:49:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.087+0000 7fcfcc62b700 1 -- 172.21.15.43:0/2614365832 wait complete. 2023-06-08T03:49:14.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.226+0000 7f50a895f700 1 Processor -- start 2023-06-08T03:49:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.226+0000 7f50a895f700 1 -- start start 2023-06-08T03:49:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a895f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f50a4069db0 0x7f50a40c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a895f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50a415a400 0x7f50a406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a895f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a40ccc00 0x7f50a40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a895f700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a40720f0 con 0x7f50a415a400 2023-06-08T03:49:14.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a895f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a40ca1e0 con 0x7f50a4069db0 2023-06-08T03:49:14.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a895f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a406a6c0 con 0x7f50a40ccc00 2023-06-08T03:49:14.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50a415a400 0x7f50a406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50a415a400 0x7f50a406a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58906/0 (socket says 172.21.15.43:58906) 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 -- 172.21.15.43:0/1195192547 learned_addr learned my addr 172.21.15.43:0/1195192547 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a259c700 1 --2- 172.21.15.43:0/1195192547 >> v2:172.21.15.135:3300/0 conn(0x7f50a4069db0 0x7f50a40c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a2d9d700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a40ccc00 0x7f50a40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 -- 172.21.15.43:0/1195192547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a40ccc00 msgr2=0x7f50a40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a40ccc00 0x7f50a40b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 -- 172.21.15.43:0/1195192547 >> v2:172.21.15.135:3300/0 conn(0x7f50a4069db0 msgr2=0x7f50a40c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:14.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 --2- 172.21.15.43:0/1195192547 >> v2:172.21.15.135:3300/0 conn(0x7f50a4069db0 0x7f50a40c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 -- 172.21.15.43:0/1195192547 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40cb960 con 0x7f50a415a400 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a2d9d700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a40ccc00 0x7f50a40b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a259c700 1 --2- 172.21.15.43:0/1195192547 >> v2:172.21.15.135:3300/0 conn(0x7f50a4069db0 0x7f50a40c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.227+0000 7f50a1d9b700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a415a400 0x7f50a406a180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f50a4066830 tx=0x7f5098009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9940879e523acd0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a159a700 1 -- 172.21.15.43:0/1195192547 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800b870 con 0x7f50a415a400 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a159a700 1 -- 172.21.15.43:0/1195192547 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509800b9d0 con 0x7f50a415a400 2023-06-08T03:49:14.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a159a700 1 -- 172.21.15.43:0/1195192547 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800bd60 con 0x7f50a415a400 2023-06-08T03:49:14.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 -- 172.21.15.43:0/1195192547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a415a400 msgr2=0x7f50a406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a415a400 0x7f50a406a180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f50a4066830 tx=0x7f5098009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 -- 172.21.15.43:0/1195192547 shutdown_connections 2023-06-08T03:49:14.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a40ccc00 0x7f50a40b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 --2- 172.21.15.43:0/1195192547 >> v2:172.21.15.135:3300/0 conn(0x7f50a4069db0 0x7f50a40c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 --2- 172.21.15.43:0/1195192547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a415a400 0x7f50a406a180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 -- 172.21.15.43:0/1195192547 >> 172.21.15.43:0/1195192547 conn(0x7f50a406aec0 msgr2=0x7f50a406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 -- 172.21.15.43:0/1195192547 shutdown_connections 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.228+0000 7f50a895f700 1 -- 172.21.15.43:0/1195192547 wait complete. 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 Processor -- start 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 -- start start 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a4069db0 0x7f50a40c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 0x7f50a4151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a415a400 0x7f50a40b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a415cc50 con 0x7f50a40ccc00 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a415bd30 con 0x7f50a4069db0 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.230+0000 7f50a895f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c4ca0 con 0x7f50a415a400 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 0x7f50a4151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 0x7f50a4151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58912/0 (socket says 172.21.15.43:58912) 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 -- 172.21.15.43:0/4257521386 learned_addr learned my addr 172.21.15.43:0/4257521386 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a259c700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a4069db0 0x7f50a40c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a2d9d700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a415a400 0x7f50a40b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 -- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a415a400 msgr2=0x7f50a40b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a415a400 0x7f50a40b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 -- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a4069db0 msgr2=0x7f50a40c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a4069db0 0x7f50a40c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 -- 172.21.15.43:0/4257521386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098009550 con 0x7f50a40ccc00 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a259c700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a4069db0 0x7f50a40c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a2d9d700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a415a400 0x7f50a40b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:14.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a1d9b700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 0x7f50a4151b80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5098000c00 tx=0x7f5098004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098004540 con 0x7f50a40ccc00 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50980036a0 con 0x7f50a40ccc00 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a415bfd0 con 0x7f50a40ccc00 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098003a50 con 0x7f50a40ccc00 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.231+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a415c590 con 0x7f50a40ccc00 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.232+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a4073fa0 con 0x7f50a40ccc00 2023-06-08T03:49:14.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.233+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5098021070 con 0x7f50a40ccc00 2023-06-08T03:49:14.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.233+0000 7f5092ffd700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f508406ace0 0x7f508406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.233+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f509808ae10 con 0x7f50a40ccc00 2023-06-08T03:49:14.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.233+0000 7f50a259c700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f508406ace0 0x7f508406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.234+0000 7f50a259c700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f508406ace0 0x7f508406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5094003950 tx=0x7f5094008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.238+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5098055c60 con 0x7f50a40ccc00 2023-06-08T03:49:14.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.436+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50a40b51c0 con 0x7f50a40ccc00 2023-06-08T03:49:14.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.436+0000 7f5092ffd700 1 -- 172.21.15.43:0/4257521386 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5098015020 con 0x7f50a40ccc00 2023-06-08T03:49:14.441 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:14.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f508406ace0 msgr2=0x7f508406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f508406ace0 0x7f508406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5094003950 tx=0x7f5094008040 comp rx=0 tx=0).stop 2023-06-08T03:49:14.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 msgr2=0x7f50a4151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 0x7f50a4151b80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5098000c00 tx=0x7f5098004750 comp rx=0 tx=0).stop 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 shutdown_connections 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f508406ace0 0x7f508406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50a415a400 0x7f50a40b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a4069db0 0x7f50a40c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 --2- 172.21.15.43:0/4257521386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a40ccc00 0x7f50a4151b80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 >> 172.21.15.43:0/4257521386 conn(0x7f50a406aec0 msgr2=0x7f50a40af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 shutdown_connections 2023-06-08T03:49:14.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.439+0000 7f50a895f700 1 -- 172.21.15.43:0/4257521386 wait complete. 2023-06-08T03:49:14.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.578+0000 7f1a8578f700 1 Processor -- start 2023-06-08T03:49:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.578+0000 7f1a8578f700 1 -- start start 2023-06-08T03:49:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a8578f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a800b43f0 0x7f1a800b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a8578f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a800d1650 0x7f1a800b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a8578f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015c750 con 0x7f1a800ccb00 2023-06-08T03:49:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a8578f700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800ccfc0 con 0x7f1a800b43f0 2023-06-08T03:49:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a8578f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800b5240 con 0x7f1a800d1650 2023-06-08T03:49:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a800b43f0 0x7f1a800b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a800b43f0 0x7f1a800b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58918/0 (socket says 172.21.15.43:58918) 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 -- 172.21.15.43:0/3124807312 learned_addr learned my addr 172.21.15.43:0/3124807312 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7f7fe700 1 --2- 172.21.15.43:0/3124807312 >> v2:172.21.15.135:3300/0 conn(0x7f1a800d1650 0x7f1a800b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 -- 172.21.15.43:0/3124807312 >> v2:172.21.15.135:3300/0 conn(0x7f1a800d1650 msgr2=0x7f1a800b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 --2- 172.21.15.43:0/3124807312 >> v2:172.21.15.135:3300/0 conn(0x7f1a800d1650 0x7f1a800b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 -- 172.21.15.43:0/3124807312 >> v1:172.21.15.135:6789/0 conn(0x7f1a800ccb00 legacy=0x7f1a8015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.579+0000 7f1a7effd700 1 -- 172.21.15.43:0/3124807312 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800cf740 con 0x7f1a800b43f0 2023-06-08T03:49:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a7effd700 1 --2- 172.21.15.43:0/3124807312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800b43f0 0x7f1a800b47c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a800b1a70 tx=0x7f1a74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641be04e33d86f7a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a7dffb700 1 -- 172.21.15.43:0/3124807312 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400b870 con 0x7f1a800b43f0 2023-06-08T03:49:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a7dffb700 1 -- 172.21.15.43:0/3124807312 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400b9d0 con 0x7f1a800b43f0 2023-06-08T03:49:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a7dffb700 1 -- 172.21.15.43:0/3124807312 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400bd60 con 0x7f1a800b43f0 2023-06-08T03:49:14.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 -- 172.21.15.43:0/3124807312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800b43f0 msgr2=0x7f1a800b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 --2- 172.21.15.43:0/3124807312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800b43f0 0x7f1a800b47c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a800b1a70 tx=0x7f1a74009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 -- 172.21.15.43:0/3124807312 shutdown_connections 2023-06-08T03:49:14.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 --2- 172.21.15.43:0/3124807312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800b43f0 0x7f1a800b47c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 --2- 172.21.15.43:0/3124807312 >> v2:172.21.15.135:3300/0 conn(0x7f1a800d1650 0x7f1a800b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 -- 172.21.15.43:0/3124807312 >> 172.21.15.43:0/3124807312 conn(0x7f1a80072120 msgr2=0x7f1a8006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 -- 172.21.15.43:0/3124807312 shutdown_connections 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.580+0000 7f1a8578f700 1 -- 172.21.15.43:0/3124807312 wait complete. 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.582+0000 7f1a8578f700 1 Processor -- start 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.582+0000 7f1a8578f700 1 -- start start 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a8578f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a800b43f0 0x7f1a8015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a8578f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a800ccb00 0x7f1a80152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a8578f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 0x7f1a801e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a8578f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015ee60 con 0x7f1a800d1650 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a8578f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015e290 con 0x7f1a800b43f0 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a8578f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015e530 con 0x7f1a800ccb00 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 0x7f1a801e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 0x7f1a801e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58928/0 (socket says 172.21.15.43:58928) 2023-06-08T03:49:14.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a7f7fe700 1 -- 172.21.15.43:0/1056386857 learned_addr learned my addr 172.21.15.43:0/1056386857 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.583+0000 7f1a7effd700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a800b43f0 0x7f1a8015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7e7fc700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a800ccb00 0x7f1a80152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7f7fe700 1 -- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a800ccb00 msgr2=0x7f1a80152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7f7fe700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a800ccb00 0x7f1a80152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7f7fe700 1 -- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a800b43f0 msgr2=0x7f1a8015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7f7fe700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a800b43f0 0x7f1a8015f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7f7fe700 1 -- 172.21.15.43:0/1056386857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009550 con 0x7f1a800d1650 2023-06-08T03:49:14.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7e7fc700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a800ccb00 0x7f1a80152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:14.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a7f7fe700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 0x7f1a801e6b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a78007e60 tx=0x7f1a7800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800ede0 con 0x7f1a800d1650 2023-06-08T03:49:14.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a78014420 con 0x7f1a800d1650 2023-06-08T03:49:14.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8015e810 con 0x7f1a800d1650 2023-06-08T03:49:14.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780147d0 con 0x7f1a800d1650 2023-06-08T03:49:14.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.584+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8015f830 con 0x7f1a800d1650 2023-06-08T03:49:14.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.585+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8015efd0 con 0x7f1a800d1650 2023-06-08T03:49:14.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.585+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a78014930 con 0x7f1a800d1650 2023-06-08T03:49:14.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.586+0000 7f1a677fe700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a6c06ace0 0x7f1a6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.586+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a78089f50 con 0x7f1a800d1650 2023-06-08T03:49:14.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.586+0000 7f1a7effd700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a6c06ace0 0x7f1a6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.586+0000 7f1a7effd700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a6c06ace0 0x7f1a6c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a74000c00 tx=0x7f1a74008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.590+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a78054dc0 con 0x7f1a800d1650 2023-06-08T03:49:14.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.788+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a80073fa0 con 0x7f1a800d1650 2023-06-08T03:49:14.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.789+0000 7f1a677fe700 1 -- 172.21.15.43:0/1056386857 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a780583e0 con 0x7f1a800d1650 2023-06-08T03:49:14.793 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:14.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a6c06ace0 msgr2=0x7f1a6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a6c06ace0 0x7f1a6c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a74000c00 tx=0x7f1a74008030 comp rx=0 tx=0).stop 2023-06-08T03:49:14.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 msgr2=0x7f1a801e6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 0x7f1a801e6b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a78007e60 tx=0x7f1a7800e3c0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 shutdown_connections 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1a6c06ace0 0x7f1a6c06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a800d1650 0x7f1a801e6b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a800b43f0 0x7f1a8015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 --2- 172.21.15.43:0/1056386857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a800ccb00 0x7f1a80152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 >> 172.21.15.43:0/1056386857 conn(0x7f1a80072120 msgr2=0x7f1a800b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:14.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 shutdown_connections 2023-06-08T03:49:14.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.791+0000 7f1a8578f700 1 -- 172.21.15.43:0/1056386857 wait complete. 2023-06-08T03:49:14.807 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:14.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.930+0000 7f11359f3700 1 Processor -- start 2023-06-08T03:49:14.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.930+0000 7f11359f3700 1 -- start start 2023-06-08T03:49:14.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f11359f3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 0x7f11300b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f11359f3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 0x7f11300b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f11359f3700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113015c750 con 0x7f113015fdf0 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f11359f3700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11300ccfc0 con 0x7f11300ccb00 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f11359f3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300b5240 con 0x7f11300b43f0 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112e7fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 0x7f11300b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112effd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 0x7f11300b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112e7fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 0x7f11300b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40550/0 (socket says 172.21.15.43:40550) 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112e7fc700 1 -- 172.21.15.43:0/159340048 learned_addr learned my addr 172.21.15.43:0/159340048 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:14.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112effd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 0x7f11300b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52388/0 (socket says 172.21.15.43:52388) 2023-06-08T03:49:14.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112effd700 1 -- 172.21.15.43:0/159340048 >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 msgr2=0x7f11300b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:14.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112effd700 1 --2- 172.21.15.43:0/159340048 >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 0x7f11300b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.931+0000 7f112effd700 1 -- 172.21.15.43:0/159340048 >> v1:172.21.15.135:6789/0 conn(0x7f113015fdf0 legacy=0x7f1130160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f112effd700 1 -- 172.21.15.43:0/159340048 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300cf740 con 0x7f11300b43f0 2023-06-08T03:49:14.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f112e7fc700 1 --2- 172.21.15.43:0/159340048 >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 0x7f11300b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f112effd700 1 --2- 172.21.15.43:0/159340048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 0x7f11300b47c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1124009840 tx=0x7f1124009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4a37a5bbf3cb6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f112dffb700 1 -- 172.21.15.43:0/159340048 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124011830 con 0x7f11300b43f0 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f112dffb700 1 -- 172.21.15.43:0/159340048 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1124011990 con 0x7f11300b43f0 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f112dffb700 1 -- 172.21.15.43:0/159340048 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124011d20 con 0x7f11300b43f0 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 -- 172.21.15.43:0/159340048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 msgr2=0x7f11300b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 --2- 172.21.15.43:0/159340048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 0x7f11300b47c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1124009840 tx=0x7f1124009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:14.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 -- 172.21.15.43:0/159340048 shutdown_connections 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 --2- 172.21.15.43:0/159340048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300b43f0 0x7f11300b47c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 --2- 172.21.15.43:0/159340048 >> v2:172.21.15.135:3300/0 conn(0x7f11300ccb00 0x7f11300b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 -- 172.21.15.43:0/159340048 >> 172.21.15.43:0/159340048 conn(0x7f1130072120 msgr2=0x7f113006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.932+0000 7f11359f3700 1 -- 172.21.15.43:0/159340048 shutdown_connections 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.933+0000 7f11359f3700 1 -- 172.21.15.43:0/159340048 wait complete. 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.934+0000 7f11359f3700 1 Processor -- start 2023-06-08T03:49:14.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.934+0000 7f11359f3700 1 -- start start 2023-06-08T03:49:14.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.934+0000 7f11359f3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300b43f0 0x7f1130145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300ccb00 0x7f11300d1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 0x7f11300cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300d1bd0 con 0x7f113015fdf0 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300cc8f0 con 0x7f11300b43f0 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301f22c0 con 0x7f11300ccb00 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 0x7f11300cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 0x7f11300cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58942/0 (socket says 172.21.15.43:58942) 2023-06-08T03:49:14.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 -- 172.21.15.43:0/3188461040 learned_addr learned my addr 172.21.15.43:0/3188461040 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112e7fc700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300ccb00 0x7f11300d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112effd700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300b43f0 0x7f1130145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 -- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300ccb00 msgr2=0x7f11300d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300ccb00 0x7f11300d1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 -- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300b43f0 msgr2=0x7f1130145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300b43f0 0x7f1130145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:14.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 -- 172.21.15.43:0/3188461040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120009550 con 0x7f113015fdf0 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112e7fc700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300ccb00 0x7f11300d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112effd700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300b43f0 0x7f1130145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f112f7fe700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 0x7f11300cc3b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f112800cc50 tx=0x7f112800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800ad80 con 0x7f113015fdf0 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800ce50 con 0x7f113015fdf0 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128003c40 con 0x7f113015fdf0 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11240094a0 con 0x7f113015fdf0 2023-06-08T03:49:14.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.935+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11300d2130 con 0x7f113015fdf0 2023-06-08T03:49:14.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.936+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1130073fa0 con 0x7f113015fdf0 2023-06-08T03:49:14.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.937+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11280050d0 con 0x7f113015fdf0 2023-06-08T03:49:14.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.937+0000 7f1117fff700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f111c06ad10 0x7f111c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:14.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.937+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f11280897d0 con 0x7f113015fdf0 2023-06-08T03:49:14.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.937+0000 7f112effd700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f111c06ad10 0x7f111c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:14.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.938+0000 7f112effd700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f111c06ad10 0x7f111c06d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1124000c00 tx=0x7f112401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:14.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:14.942+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1128054460 con 0x7f113015fdf0 2023-06-08T03:49:15.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.136+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f113015c730 con 0x7f113015fdf0 2023-06-08T03:49:15.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.137+0000 7f1117fff700 1 -- 172.21.15.43:0/3188461040 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1128057a80 con 0x7f113015fdf0 2023-06-08T03:49:15.141 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:15.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f111c06ad10 msgr2=0x7f111c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f111c06ad10 0x7f111c06d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1124000c00 tx=0x7f112401c040 comp rx=0 tx=0).stop 2023-06-08T03:49:15.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 msgr2=0x7f11300cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 0x7f11300cc3b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f112800cc50 tx=0x7f112800a340 comp rx=0 tx=0).stop 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 shutdown_connections 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f111c06ad10 0x7f111c06d1c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113015fdf0 0x7f11300cc3b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300b43f0 0x7f1130145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 --2- 172.21.15.43:0/3188461040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11300ccb00 0x7f11300d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 >> 172.21.15.43:0/3188461040 conn(0x7f1130072120 msgr2=0x7f11300b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:15.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 shutdown_connections 2023-06-08T03:49:15.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.139+0000 7f11359f3700 1 -- 172.21.15.43:0/3188461040 wait complete. 2023-06-08T03:49:15.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:15.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.275+0000 7f39350aa700 1 Processor -- start 2023-06-08T03:49:15.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.275+0000 7f39350aa700 1 -- start start 2023-06-08T03:49:15.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.275+0000 7f39350aa700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f393015c590 0x7f39300af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.275+0000 7f39350aa700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f393006a4c0 0x7f39300b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.275+0000 7f39350aa700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300af050 con 0x7f39300ccba0 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.275+0000 7f39350aa700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300afae0 con 0x7f393006a4c0 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f39350aa700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300af800 con 0x7f393015c590 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f393006a4c0 0x7f39300b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f393006a4c0 0x7f39300b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58946/0 (socket says 172.21.15.43:58946) 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 -- 172.21.15.43:0/1023858998 learned_addr learned my addr 172.21.15.43:0/1023858998 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:15.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392ed9d700 1 --2- 172.21.15.43:0/1023858998 >> v2:172.21.15.135:3300/0 conn(0x7f393015c590 0x7f39300af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 -- 172.21.15.43:0/1023858998 >> v2:172.21.15.135:3300/0 conn(0x7f393015c590 msgr2=0x7f39300af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:15.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 --2- 172.21.15.43:0/1023858998 >> v2:172.21.15.135:3300/0 conn(0x7f393015c590 0x7f39300af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 -- 172.21.15.43:0/1023858998 >> v1:172.21.15.135:6789/0 conn(0x7f39300ccba0 legacy=0x7f3930069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:15.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 -- 172.21.15.43:0/1023858998 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300cc0c0 con 0x7f393006a4c0 2023-06-08T03:49:15.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392f59e700 1 --2- 172.21.15.43:0/1023858998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39300b06d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f393006fcd0 tx=0x7f392800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c919eba06763b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:15.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392dd9b700 1 -- 172.21.15.43:0/1023858998 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800e070 con 0x7f393006a4c0 2023-06-08T03:49:15.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392dd9b700 1 -- 172.21.15.43:0/1023858998 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928003a20 con 0x7f393006a4c0 2023-06-08T03:49:15.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.276+0000 7f392dd9b700 1 -- 172.21.15.43:0/1023858998 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928003dd0 con 0x7f393006a4c0 2023-06-08T03:49:15.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 -- 172.21.15.43:0/1023858998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 msgr2=0x7f39300b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 --2- 172.21.15.43:0/1023858998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39300b06d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f393006fcd0 tx=0x7f392800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:15.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 -- 172.21.15.43:0/1023858998 shutdown_connections 2023-06-08T03:49:15.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 --2- 172.21.15.43:0/1023858998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39300b06d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 --2- 172.21.15.43:0/1023858998 >> v2:172.21.15.135:3300/0 conn(0x7f393015c590 0x7f39300af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 -- 172.21.15.43:0/1023858998 >> 172.21.15.43:0/1023858998 conn(0x7f393006b7e0 msgr2=0x7f39300cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:15.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 -- 172.21.15.43:0/1023858998 shutdown_connections 2023-06-08T03:49:15.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.277+0000 7f39350aa700 1 -- 172.21.15.43:0/1023858998 wait complete. 2023-06-08T03:49:15.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.278+0000 7f39350aa700 1 Processor -- start 2023-06-08T03:49:15.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.278+0000 7f39350aa700 1 -- start start 2023-06-08T03:49:15.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f39350aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39301f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f39350aa700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39300ccba0 0x7f39300b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f39350aa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393015c590 0x7f39300b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f39350aa700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3930156450 con 0x7f393006a4c0 2023-06-08T03:49:15.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f39350aa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39300b3880 con 0x7f393015c590 2023-06-08T03:49:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f39350aa700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300b2a10 con 0x7f39300ccba0 2023-06-08T03:49:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f392ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39301f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f392ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39301f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58950/0 (socket says 172.21.15.43:58950) 2023-06-08T03:49:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.279+0000 7f392ed9d700 1 -- 172.21.15.43:0/1191559736 learned_addr learned my addr 172.21.15.43:0/1191559736 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392f59e700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393015c590 0x7f39300b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392ed9d700 1 -- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39300ccba0 msgr2=0x7f39300b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392e59c700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39300ccba0 0x7f39300b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392ed9d700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39300ccba0 0x7f39300b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392ed9d700 1 -- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393015c590 msgr2=0x7f39300b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392ed9d700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393015c590 0x7f39300b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392ed9d700 1 -- 172.21.15.43:0/1191559736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009b30 con 0x7f393006a4c0 2023-06-08T03:49:15.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f392ed9d700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39301f2580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f392000d7d0 tx=0x7f392000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200125f0 con 0x7f393006a4c0 2023-06-08T03:49:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920012750 con 0x7f393006a4c0 2023-06-08T03:49:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39300b2c70 con 0x7f393006a4c0 2023-06-08T03:49:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920012b00 con 0x7f393006a4c0 2023-06-08T03:49:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.280+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39300b3230 con 0x7f393006a4c0 2023-06-08T03:49:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.281+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39300cd9d0 con 0x7f393006a4c0 2023-06-08T03:49:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.281+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3920012c60 con 0x7f393006a4c0 2023-06-08T03:49:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.282+0000 7f39177fe700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f391c06ace0 0x7f391c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.282+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3920089850 con 0x7f393006a4c0 2023-06-08T03:49:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.282+0000 7f392e59c700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f391c06ace0 0x7f391c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.283+0000 7f392e59c700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f391c06ace0 0x7f391c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f39300b55d0 tx=0x7f3924009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:15.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.287+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f39200546a0 con 0x7f393006a4c0 2023-06-08T03:49:15.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.527+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3930073fa0 con 0x7f393006a4c0 2023-06-08T03:49:15.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.528+0000 7f39177fe700 1 -- 172.21.15.43:0/1191559736 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f3920057cc0 con 0x7f393006a4c0 2023-06-08T03:49:15.532 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:15.532 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f391c06ace0 msgr2=0x7f391c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f391c06ace0 0x7f391c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f39300b55d0 tx=0x7f3924009040 comp rx=0 tx=0).stop 2023-06-08T03:49:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 msgr2=0x7f39301f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39301f2580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f392000d7d0 tx=0x7f392000db90 comp rx=0 tx=0).stop 2023-06-08T03:49:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 shutdown_connections 2023-06-08T03:49:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f391c06ace0 0x7f391c06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f393006a4c0 0x7f39301f2580 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393015c590 0x7f39300b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 --2- 172.21.15.43:0/1191559736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39300ccba0 0x7f39300b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 >> 172.21.15.43:0/1191559736 conn(0x7f393006b7e0 msgr2=0x7f3930069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 shutdown_connections 2023-06-08T03:49:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.530+0000 7f39350aa700 1 -- 172.21.15.43:0/1191559736 wait complete. 2023-06-08T03:49:15.536 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:15.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:15.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.666+0000 7f0d59728700 1 Processor -- start 2023-06-08T03:49:15.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.666+0000 7f0d59728700 1 -- start start 2023-06-08T03:49:15.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d59728700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0d540b80d0 0x7f0d541606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d59728700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b5000 0x7f0d540cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d59728700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d540cf1d0 con 0x7f0d540cfba0 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d59728700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d540ccfc0 con 0x7f0d540b80d0 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d59728700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540cd790 con 0x7f0d540b5000 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0d540b80d0 0x7f0d541606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0d540b80d0 0x7f0d541606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58958/0 (socket says 172.21.15.43:58958) 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 -- 172.21.15.43:0/4288277301 learned_addr learned my addr 172.21.15.43:0/4288277301 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:15.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d527fc700 1 --2- 172.21.15.43:0/4288277301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b5000 0x7f0d540cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 -- 172.21.15.43:0/4288277301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b5000 msgr2=0x7f0d540cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 --2- 172.21.15.43:0/4288277301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b5000 0x7f0d540cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 -- 172.21.15.43:0/4288277301 >> v1:172.21.15.135:6789/0 conn(0x7f0d540cfba0 legacy=0x7f0d540b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.667+0000 7f0d52ffd700 1 -- 172.21.15.43:0/4288277301 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54160c30 con 0x7f0d540b80d0 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d52ffd700 1 --2- 172.21.15.43:0/4288277301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540b80d0 0x7f0d541606f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d480098f0 tx=0x7f0d48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a719f5a41636a600 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d51ffb700 1 -- 172.21.15.43:0/4288277301 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800b8a0 con 0x7f0d540b80d0 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d51ffb700 1 -- 172.21.15.43:0/4288277301 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4800ba00 con 0x7f0d540b80d0 2023-06-08T03:49:15.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d51ffb700 1 -- 172.21.15.43:0/4288277301 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800bd90 con 0x7f0d540b80d0 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 -- 172.21.15.43:0/4288277301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540b80d0 msgr2=0x7f0d541606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 --2- 172.21.15.43:0/4288277301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540b80d0 0x7f0d541606f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d480098f0 tx=0x7f0d48009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 -- 172.21.15.43:0/4288277301 shutdown_connections 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 --2- 172.21.15.43:0/4288277301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540b80d0 0x7f0d541606f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 --2- 172.21.15.43:0/4288277301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b5000 0x7f0d540cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 -- 172.21.15.43:0/4288277301 >> 172.21.15.43:0/4288277301 conn(0x7f0d54072120 msgr2=0x7f0d5406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:15.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 -- 172.21.15.43:0/4288277301 shutdown_connections 2023-06-08T03:49:15.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.668+0000 7f0d59728700 1 -- 172.21.15.43:0/4288277301 wait complete. 2023-06-08T03:49:15.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 Processor -- start 2023-06-08T03:49:15.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 -- start start 2023-06-08T03:49:15.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d540b5000 0x7f0d541f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b80d0 0x7f0d541593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 0x7f0d5415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d541e85b0 con 0x7f0d540cfba0 2023-06-08T03:49:15.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540caa80 con 0x7f0d540b5000 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.670+0000 7f0d59728700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540cad60 con 0x7f0d540b80d0 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 0x7f0d5415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 0x7f0d5415c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58968/0 (socket says 172.21.15.43:58968) 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 -- 172.21.15.43:0/1420197938 learned_addr learned my addr 172.21.15.43:0/1420197938 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d52ffd700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d540b5000 0x7f0d541f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d527fc700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b80d0 0x7f0d541593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 -- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b80d0 msgr2=0x7f0d541593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b80d0 0x7f0d541593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 -- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d540b5000 msgr2=0x7f0d541f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d540b5000 0x7f0d541f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 -- 172.21.15.43:0/1420197938 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009550 con 0x7f0d540cfba0 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d537fe700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 0x7f0d5415c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00cc50 tx=0x7f0d4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003c00 con 0x7f0d540cfba0 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c003d60 con 0x7f0d540cfba0 2023-06-08T03:49:15.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d540cb040 con 0x7f0d540cfba0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00aab0 con 0x7f0d540cfba0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.671+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54159aa0 con 0x7f0d540cfba0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.672+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d540cb560 con 0x7f0d540cfba0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.673+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d4c00ac10 con 0x7f0d540cfba0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.673+0000 7f0d3b7fe700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d4006ace0 0x7f0d4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.673+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d4c089690 con 0x7f0d540cfba0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.673+0000 7f0d52ffd700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d4006ace0 0x7f0d4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:15.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.674+0000 7f0d52ffd700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d4006ace0 0x7f0d4006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009c40 tx=0x7f0d48008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:15.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.677+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d540cb560 con 0x7f0d540cfba0 2023-06-08T03:49:15.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.880+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d540cb560 con 0x7f0d540cfba0 2023-06-08T03:49:15.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.881+0000 7f0d3b7fe700 1 -- 172.21.15.43:0/1420197938 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f0d540cb560 con 0x7f0d540cfba0 2023-06-08T03:49:15.885 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:15.886 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:15.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d4006ace0 msgr2=0x7f0d4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d4006ace0 0x7f0d4006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009c40 tx=0x7f0d48008030 comp rx=0 tx=0).stop 2023-06-08T03:49:15.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 msgr2=0x7f0d5415c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:15.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 0x7f0d5415c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00cc50 tx=0x7f0d4c00cf60 comp rx=0 tx=0).stop 2023-06-08T03:49:15.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 shutdown_connections 2023-06-08T03:49:15.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d4006ace0 0x7f0d4006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d540cfba0 0x7f0d5415c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d540b5000 0x7f0d541f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 --2- 172.21.15.43:0/1420197938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d540b80d0 0x7f0d541593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:15.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 >> 172.21.15.43:0/1420197938 conn(0x7f0d54072120 msgr2=0x7f0d540b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:15.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 shutdown_connections 2023-06-08T03:49:15.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:15.883+0000 7f0d59728700 1 -- 172.21.15.43:0/1420197938 wait complete. 2023-06-08T03:49:15.900 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:16.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.023+0000 7efe870a8700 1 Processor -- start 2023-06-08T03:49:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.023+0000 7efe870a8700 1 -- start start 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.024+0000 7efe870a8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe800c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.024+0000 7efe870a8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 0x7efe800cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.024+0000 7efe870a8700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800c8ba0 con 0x7efe800701b0 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.024+0000 7efe870a8700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800c8e80 con 0x7efe800cebf0 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.024+0000 7efe870a8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c9160 con 0x7efe80158840 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe800c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe85645700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 0x7efe800cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe85645700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 0x7efe800cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40590/0 (socket says 172.21.15.43:40590) 2023-06-08T03:49:16.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe85645700 1 -- 172.21.15.43:0/374284839 learned_addr learned my addr 172.21.15.43:0/374284839 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe800c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52430/0 (socket says 172.21.15.43:52430) 2023-06-08T03:49:16.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 -- 172.21.15.43:0/374284839 >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 msgr2=0x7efe800cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 --2- 172.21.15.43:0/374284839 >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 0x7efe800cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 -- 172.21.15.43:0/374284839 >> v1:172.21.15.135:6789/0 conn(0x7efe800701b0 legacy=0x7efe800ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 -- 172.21.15.43:0/374284839 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800ccb60 con 0x7efe80158840 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe85645700 1 --2- 172.21.15.43:0/374284839 >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 0x7efe800cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.025+0000 7efe84e44700 1 --2- 172.21.15.43:0/374284839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe800c9570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe7400bae0 tx=0x7efe7400bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953d26e8ee98defa server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe7f7fe700 1 -- 172.21.15.43:0/374284839 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400dc70 con 0x7efe80158840 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe7f7fe700 1 -- 172.21.15.43:0/374284839 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7400ddd0 con 0x7efe80158840 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe7f7fe700 1 -- 172.21.15.43:0/374284839 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74010690 con 0x7efe80158840 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 -- 172.21.15.43:0/374284839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 msgr2=0x7efe800c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 --2- 172.21.15.43:0/374284839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe800c9570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe7400bae0 tx=0x7efe7400bdf0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 -- 172.21.15.43:0/374284839 shutdown_connections 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 --2- 172.21.15.43:0/374284839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe800c9570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 --2- 172.21.15.43:0/374284839 >> v2:172.21.15.135:3300/0 conn(0x7efe800cebf0 0x7efe800cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 -- 172.21.15.43:0/374284839 >> 172.21.15.43:0/374284839 conn(0x7efe8006aa40 msgr2=0x7efe800b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 -- 172.21.15.43:0/374284839 shutdown_connections 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.026+0000 7efe870a8700 1 -- 172.21.15.43:0/374284839 wait complete. 2023-06-08T03:49:16.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.027+0000 7efe870a8700 1 Processor -- start 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.027+0000 7efe870a8700 1 -- start start 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe870a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe800701b0 0x7efe8014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe870a8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 0x7efe800712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe870a8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe80071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe870a8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b1ba0 con 0x7efe800cebf0 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe870a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8014f1c0 con 0x7efe800701b0 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe870a8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c7040 con 0x7efe80158840 2023-06-08T03:49:16.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.028+0000 7efe7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 0x7efe800712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 0x7efe800712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58978/0 (socket says 172.21.15.43:58978) 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 -- 172.21.15.43:0/3981650494 learned_addr learned my addr 172.21.15.43:0/3981650494 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe85645700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe80071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe84e44700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe800701b0 0x7efe8014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 -- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 msgr2=0x7efe80071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe80071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 -- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe800701b0 msgr2=0x7efe8014ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe800701b0 0x7efe8014ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 -- 172.21.15.43:0/3981650494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009b30 con 0x7efe800cebf0 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7ffff700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 0x7efe800712c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c4e0 tx=0x7efe6c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0052d0 con 0x7efe800cebf0 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c005430 con 0x7efe800cebf0 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7400b740 con 0x7efe800cebf0 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0038c0 con 0x7efe800cebf0 2023-06-08T03:49:16.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.029+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe800c64e0 con 0x7efe800cebf0 2023-06-08T03:49:16.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.030+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe80073fa0 con 0x7efe800cebf0 2023-06-08T03:49:16.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.031+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe6c003a20 con 0x7efe800cebf0 2023-06-08T03:49:16.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.031+0000 7efe7d7fa700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efe6406ace0 0x7efe6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.031+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe6c088ac0 con 0x7efe800cebf0 2023-06-08T03:49:16.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.031+0000 7efe84e44700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efe6406ace0 0x7efe6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.032+0000 7efe84e44700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efe6406ace0 0x7efe6406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe7400be30 tx=0x7efe7401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.035+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe6c053890 con 0x7efe800cebf0 2023-06-08T03:49:16.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.276+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe800c5240 con 0x7efe800cebf0 2023-06-08T03:49:16.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.277+0000 7efe7d7fa700 1 -- 172.21.15.43:0/3981650494 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7efe6c056eb0 con 0x7efe800cebf0 2023-06-08T03:49:16.281 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:16.281 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efe6406ace0 msgr2=0x7efe6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efe6406ace0 0x7efe6406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe7400be30 tx=0x7efe7401c040 comp rx=0 tx=0).stop 2023-06-08T03:49:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 msgr2=0x7efe800712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 0x7efe800712c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c4e0 tx=0x7efe6c00c7f0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 shutdown_connections 2023-06-08T03:49:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efe6406ace0 0x7efe6406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe80158840 0x7efe80071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe800701b0 0x7efe8014ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 --2- 172.21.15.43:0/3981650494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe800cebf0 0x7efe800712c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 >> 172.21.15.43:0/3981650494 conn(0x7efe8006aa40 msgr2=0x7efe800cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 shutdown_connections 2023-06-08T03:49:16.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.279+0000 7efe870a8700 1 -- 172.21.15.43:0/3981650494 wait complete. 2023-06-08T03:49:16.285 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:16.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-08T03:48:46.681077+0000', 'modified': '2023-06-08T03:49:03.764330+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6837/2399698877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6835', 'nonce': 2399698877}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 2399698877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-08T03:49:16.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-08T03:49:16.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-08T03:49:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.824+0000 7fc615264700 1 Processor -- start 2023-06-08T03:49:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.824+0000 7fc615264700 1 -- start start 2023-06-08T03:49:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc615264700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100b43f0 0x7fc6100b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc615264700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6100cd430 0x7fc6100d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc615264700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6100cf690 con 0x7fc6100ccfc0 2023-06-08T03:49:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc615264700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6100d0180 con 0x7fc6100cd430 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc615264700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100d0770 con 0x7fc6100b43f0 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6100cd430 0x7fc6100d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6100cd430 0x7fc6100d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58986/0 (socket says 172.21.15.43:58986) 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 -- 172.21.15.43:0/1836820776 learned_addr learned my addr 172.21.15.43:0/1836820776 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60effd700 1 --2- 172.21.15.43:0/1836820776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100b43f0 0x7fc6100b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 -- 172.21.15.43:0/1836820776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100b43f0 msgr2=0x7fc6100b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/1836820776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100b43f0 0x7fc6100b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 -- 172.21.15.43:0/1836820776 >> v1:172.21.15.135:6789/0 conn(0x7fc6100ccfc0 legacy=0x7fc6100d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 -- 172.21.15.43:0/1836820776 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100b4d00 con 0x7fc6100cd430 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/1836820776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100cd430 0x7fc6100d1310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc608009e50 tx=0x7fc60800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dcb7f023ee49a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.825+0000 7fc60dffb700 1 -- 172.21.15.43:0/1836820776 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800e070 con 0x7fc6100cd430 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc60dffb700 1 -- 172.21.15.43:0/1836820776 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800b9c0 con 0x7fc6100cd430 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc60dffb700 1 -- 172.21.15.43:0/1836820776 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800bd70 con 0x7fc6100cd430 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 -- 172.21.15.43:0/1836820776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100cd430 msgr2=0x7fc6100d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 --2- 172.21.15.43:0/1836820776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100cd430 0x7fc6100d1310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc608009e50 tx=0x7fc60800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:16.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 -- 172.21.15.43:0/1836820776 shutdown_connections 2023-06-08T03:49:16.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 --2- 172.21.15.43:0/1836820776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100cd430 0x7fc6100d1310 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 --2- 172.21.15.43:0/1836820776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100b43f0 0x7fc6100b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 -- 172.21.15.43:0/1836820776 >> 172.21.15.43:0/1836820776 conn(0x7fc61006afb0 msgr2=0x7fc61006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 -- 172.21.15.43:0/1836820776 shutdown_connections 2023-06-08T03:49:16.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.826+0000 7fc615264700 1 -- 172.21.15.43:0/1836820776 wait complete. 2023-06-08T03:49:16.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.827+0000 7fc615264700 1 Processor -- start 2023-06-08T03:49:16.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.827+0000 7fc615264700 1 -- start start 2023-06-08T03:49:16.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc615264700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6100b43f0 0x7fc6100c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc615264700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 0x7fc610155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc615264700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100cd430 0x7fc6100c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc615264700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101e6b00 con 0x7fc6100ccfc0 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc615264700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101e75f0 con 0x7fc6100b43f0 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc615264700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101e6d50 con 0x7fc6100cd430 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 0x7fc610155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 0x7fc610155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58992/0 (socket says 172.21.15.43:58992) 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.828+0000 7fc60e7fc700 1 -- 172.21.15.43:0/1091792795 learned_addr learned my addr 172.21.15.43:0/1091792795 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60effd700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6100b43f0 0x7fc6100c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100cd430 0x7fc6100c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60e7fc700 1 -- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100cd430 msgr2=0x7fc6100c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100cd430 0x7fc6100c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60e7fc700 1 -- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6100b43f0 msgr2=0x7fc6100c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6100b43f0 0x7fc6100c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60e7fc700 1 -- 172.21.15.43:0/1091792795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608009b30 con 0x7fc6100ccfc0 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 0x7fc610155b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c510 tx=0x7fc60400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc5f77fe700 1 -- 172.21.15.43:0/1091792795 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040052d0 con 0x7fc6100ccfc0 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc5f77fe700 1 -- 172.21.15.43:0/1091792795 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604005430 con 0x7fc6100ccfc0 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc5f77fe700 1 -- 172.21.15.43:0/1091792795 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040038c0 con 0x7fc6100ccfc0 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6101e7030 con 0x7fc6100ccfc0 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.829+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc610156d80 con 0x7fc6100ccfc0 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.830+0000 7fc5f77fe700 1 -- 172.21.15.43:0/1091792795 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc604003a20 con 0x7fc6100ccfc0 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.831+0000 7fc5f77fe700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5fc06ace0 0x7fc5fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.831+0000 7fc5f77fe700 1 -- 172.21.15.43:0/1091792795 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc604088c00 con 0x7fc6100ccfc0 2023-06-08T03:49:16.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.831+0000 7fc60effd700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5fc06ace0 0x7fc5fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.832+0000 7fc60effd700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5fc06ace0 0x7fc5fc06d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc600006fd0 tx=0x7fc600008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.833+0000 7fc6213e9b80 1 Processor -- start 2023-06-08T03:49:16.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.833+0000 7fc6213e9b80 1 -- start start 2023-06-08T03:49:16.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c27310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c2bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c750e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62b313b0 con 0x559e62c2b6c0 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62b32c60 con 0x559e62c74c70 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e62b85570 con 0x559e62c2b2f0 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c2bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c2bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59000/0 (socket says 172.21.15.43:59000) 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 -- 172.21.15.43:0/2883582210 learned_addr learned my addr 172.21.15.43:0/2883582210 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60effd700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c27310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 -- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 msgr2=0x559e62c27310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c27310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 -- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 msgr2=0x559e62c750e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c750e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 -- 172.21.15.43:0/2883582210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e629acd90 con 0x559e62c2b6c0 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60effd700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c27310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.834+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c2bb30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc60405f530 tx=0x7fc604057320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca05e28d68da5a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc5f4ff9700 1 -- 172.21.15.43:0/2883582210 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604055ab0 con 0x559e62c2b6c0 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc5f4ff9700 1 -- 172.21.15.43:0/2883582210 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60405f5d0 con 0x559e62c2b6c0 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc5f4ff9700 1 -- 172.21.15.43:0/2883582210 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604058b00 con 0x559e62c2b6c0 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 -- 172.21.15.43:0/2883582210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 msgr2=0x559e62c2bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c2bb30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc60405f530 tx=0x7fc604057320 comp rx=0 tx=0).stop 2023-06-08T03:49:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 -- 172.21.15.43:0/2883582210 shutdown_connections 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c27310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/2883582210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c2bb30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 -- 172.21.15.43:0/2883582210 >> 172.21.15.43:0/2883582210 conn(0x559e62c29ce0 msgr2=0x559e62c724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 -- 172.21.15.43:0/2883582210 shutdown_connections 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.835+0000 7fc6213e9b80 1 -- 172.21.15.43:0/2883582210 wait complete. 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.836+0000 7fc6213e9b80 1 -- start start 2023-06-08T03:49:16.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.836+0000 7fc6213e9b80 1 Processor -- start 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c71910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c73930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62b7ea00 con 0x559e62c2b6c0 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62b1ea70 con 0x559e62c74c70 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e62b1e770 con 0x559e62c2b2f0 2023-06-08T03:49:16.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc6213e9b80 10 client.0 _ll_register_callbacks cb 0x559e62b1c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c71910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c71910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59006/0 (socket says 172.21.15.43:59006) 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3904282874 learned_addr learned my addr 172.21.15.43:0/3904282874 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60effd700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c73930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 msgr2=0x559e62c579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 msgr2=0x559e62c73930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c73930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3904282874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc610156d80 con 0x559e62c2b6c0 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c71910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc60405f530 tx=0x7fc604001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5359970af031a646 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.837+0000 7fc5edffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc5edffb700 1 -- 172.21.15.43:0/3904282874 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604058b00 con 0x559e62c2b6c0 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc5edffb700 1 -- 172.21.15.43:0/3904282874 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc604058c60 con 0x559e62c2b6c0 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e62c1f850 con 0x559e62c2b6c0 2023-06-08T03:49:16.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc5edffb700 1 -- 172.21.15.43:0/3904282874 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc604058e40 con 0x559e62c2b6c0 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 10 client.4836 fetch_fsmap learned FSMap version 9 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x559e62995c10 con 0x559e62c2b6c0 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc5edffb700 1 -- 172.21.15.43:0/3904282874 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e62c1f850 con 0x559e62c2b6c0 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc5edffb700 1 -- 172.21.15.43:0/3904282874 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fc60405b160 con 0x559e62c2b6c0 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 10 client.4836 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-08T03:49:16.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 20 client.4836 populate_metadata read hostname 'smithi043' 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c85430 0x559e62c85800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 4 client.4836 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 --> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e62b779e0 con 0x559e62c85430 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.838+0000 7fc60effd700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c85430 0x559e62c85800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc5edffb700 10 client.4836 ms_handle_connect on v2:172.21.15.135:6835/2399698877 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc60effd700 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c85430 0x559e62c85800 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f3e00af42476986 server_cookie=2d99d4d56661784a in_seq=0 out_seq=0 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc5edffb700 1 -- 172.21.15.43:0/3904282874 <== mds.0 v2:172.21.15.135:6835/2399698877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559e62b779e0 con 0x559e62c85430 2023-06-08T03:49:16.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc5edffb700 10 client.4836 handle_command_reply: tid=0 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 client.4836 shutdown 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 msgr2=0x559e62c71910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c71910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc60405f530 tx=0x7fc604001120 comp rx=0 tx=0).stop 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 shutdown_connections 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c85430 0x559e62c85800 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c73930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc5edffb700 0 client.4836 ms_handle_reset on v2:172.21.15.135:6835/2399698877 2023-06-08T03:49:16.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.839+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3904282874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c71910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.840+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 >> 172.21.15.43:0/3904282874 conn(0x559e62c29ce0 msgr2=0x559e62c27500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.840+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 shutdown_connections 2023-06-08T03:49:16.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.840+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3904282874 wait complete. 2023-06-08T03:49:16.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.840+0000 7fc6213e9b80 20 client.4836 trim_cache size 0 max 16384 2023-06-08T03:49:16.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.857+0000 7fc6213e9b80 1 Processor -- start 2023-06-08T03:49:16.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 -- start start 2023-06-08T03:49:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c4e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c4ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62a028d0 con 0x559e62c2b6c0 2023-06-08T03:49:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62c21e90 con 0x559e62c74c70 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e62c762f0 con 0x559e62c2b2f0 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c4e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc60e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c4e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59014/0 (socket says 172.21.15.43:59014) 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.858+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3565001233 learned_addr learned my addr 172.21.15.43:0/3565001233 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 msgr2=0x559e62c579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c4ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 msgr2=0x559e62c4ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c4ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60e7fc700 1 -- 172.21.15.43:0/3565001233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e629d3200 con 0x559e62c2b6c0 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c4ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c4e8c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc604086dc0 tx=0x7fc604084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12d23d5506665bd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc5f57fa700 1 -- 172.21.15.43:0/3565001233 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400e040 con 0x559e62c2b6c0 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc5f57fa700 1 -- 172.21.15.43:0/3565001233 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60400ce40 con 0x559e62c2b6c0 2023-06-08T03:49:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc5f57fa700 1 -- 172.21.15.43:0/3565001233 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604058b00 con 0x559e62c2b6c0 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3565001233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 msgr2=0x559e62c4e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c4e8c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc604086dc0 tx=0x7fc604084000 comp rx=0 tx=0).stop 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3565001233 shutdown_connections 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c4ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b2f0 0x559e62c579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/3565001233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b6c0 0x559e62c4e8c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3565001233 >> 172.21.15.43:0/3565001233 conn(0x559e62c29ce0 msgr2=0x559e62c5b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3565001233 shutdown_connections 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.859+0000 7fc6213e9b80 1 -- 172.21.15.43:0/3565001233 wait complete. 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.860+0000 7fc6213e9b80 1 -- start start 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.860+0000 7fc6213e9b80 1 Processor -- start 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 0x559e62c67f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b6c0 0x559e62c684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c6fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62cd8d90 con 0x559e62c2b2f0 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e62cd8f30 con 0x559e62c74c70 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e62c81a90 con 0x559e62c2b6c0 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc6213e9b80 10 client.0 _ll_register_callbacks cb 0x559e62b1c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 0x559e62c67f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 0x559e62c67f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59018/0 (socket says 172.21.15.43:59018) 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 -- 172.21.15.43:0/1617106281 learned_addr learned my addr 172.21.15.43:0/1617106281 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 -- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b6c0 msgr2=0x559e62c684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c6fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b6c0 0x559e62c684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b6c0 0x559e62c684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 -- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 msgr2=0x559e62c6fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c6fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 -- 172.21.15.43:0/1617106281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e62995c10 con 0x559e62c2b2f0 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60f7fe700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b6c0 0x559e62c684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc60effd700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 0x559e62c67f60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc60000fb40 tx=0x7fc6000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80b5b7e031dbcfd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.861+0000 7fc5edffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc5edffb700 1 -- 172.21.15.43:0/1617106281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600028040 con 0x559e62c2b2f0 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc5edffb700 1 -- 172.21.15.43:0/1617106281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc600014d40 con 0x559e62c2b2f0 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc60405f5d0 con 0x559e62c2b2f0 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc5edffb700 1 -- 172.21.15.43:0/1617106281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc600023440 con 0x559e62c2b2f0 2023-06-08T03:49:16.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 10 client.4842 fetch_fsmap learned FSMap version 9 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x559e629ab260 con 0x559e62c2b2f0 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc5edffb700 1 -- 172.21.15.43:0/1617106281 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60405f5d0 con 0x559e62c2b2f0 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc5edffb700 1 -- 172.21.15.43:0/1617106281 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fc6000235a0 con 0x559e62c2b2f0 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 10 client.4842 fetch_fsmap finished waiting for FSMap version 9 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 10 client.4842 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 20 client.4842 populate_metadata read hostname 'smithi043' 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c702a0 0x559e62c70670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:16.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 4 client.4842 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 --> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e62b3a000 con 0x559e62c702a0 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.862+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c702a0 0x559e62c70670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc5edffb700 10 client.4842 ms_handle_connect on v2:172.21.15.135:6835/2399698877 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc60e7fc700 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c702a0 0x559e62c70670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2377bbbe8796e6 server_cookie=ba2fd6f04cd3ff31 in_seq=0 out_seq=0 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc5edffb700 1 -- 172.21.15.43:0/1617106281 <== mds.0 v2:172.21.15.135:6835/2399698877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x559e62b3a000 con 0x559e62c702a0 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc5edffb700 10 client.4842 handle_command_reply: tid=0 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 client.4842 shutdown 2023-06-08T03:49:16.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 msgr2=0x559e62c67f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 0x559e62c67f60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc60000fb40 tx=0x7fc6000047c0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 shutdown_connections 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:6835/2399698877,v1:172.21.15.135:6837/2399698877] conn(0x559e62c702a0 0x559e62c70670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559e62c2b2f0 0x559e62c67f60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc5edffb700 0 client.4842 ms_handle_reset on v2:172.21.15.135:6835/2399698877 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e62c74c70 0x559e62c6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 --2- 172.21.15.43:0/1617106281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e62c2b6c0 0x559e62c684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 >> 172.21.15.43:0/1617106281 conn(0x559e62c29ce0 msgr2=0x559e62c72180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 shutdown_connections 2023-06-08T03:49:16.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 1 -- 172.21.15.43:0/1617106281 wait complete. 2023-06-08T03:49:16.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.863+0000 7fc6213e9b80 20 client.4842 trim_cache size 0 max 16384 2023-06-08T03:49:16.877 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-06-08T03:49:16.877 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "5ca92cbd-c0c8-4573-b70a-f139aab8d7d6", 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4279, 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 30.17823503, 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 9, 2023-06-08T03:49:16.878 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 25, 2023-06-08T03:49:16.879 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 25, 2023-06-08T03:49:16.879 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 35.574778391000002 2023-06-08T03:49:16.879 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-06-08T03:49:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5fc06ace0 msgr2=0x7fc5fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5fc06ace0 0x7fc5fc06d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc600006fd0 tx=0x7fc600008040 comp rx=0 tx=0).stop 2023-06-08T03:49:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 msgr2=0x7fc610155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 0x7fc610155b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c510 tx=0x7fc60400c8d0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 shutdown_connections 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc5fc06ace0 0x7fc5fc06d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6100cd430 0x7fc6100c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6100b43f0 0x7fc6100c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 --2- 172.21.15.43:0/1091792795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6100ccfc0 0x7fc610155b80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 >> 172.21.15.43:0/1091792795 conn(0x7fc61006afb0 msgr2=0x7fc6100cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 shutdown_connections 2023-06-08T03:49:16.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:16.864+0000 7fc615264700 1 -- 172.21.15.43:0/1091792795 wait complete. 2023-06-08T03:49:16.882 INFO:teuthology.run_tasks:Running task kclient... 2023-06-08T03:49:16.893 INFO:tasks.kclient:Mounting kernel clients... 2023-06-08T03:49:16.894 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-08T03:49:16.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:16.894 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-06-08T03:49:16.911 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-08T03:49:16.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:16.912 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-08T03:49:16.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:16.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2023-06-08T03:49:17.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.090 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-06-08T03:49:17.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2023-06-08T03:49:17.179 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2023-06-08T03:49:17.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:49:17.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.181 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-06-08T03:49:17.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-06-08T03:49:17.276 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-06-08T03:49:17.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:49:17.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.279 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-06-08T03:49:17.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-06-08T03:49:17.408 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-06-08T03:49:17.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:49:17.410 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-08T03:49:17.410 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T03:49:17.410 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-08T03:49:17.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T03:49:17.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.532+0000 7f45a677c700 1 Processor -- start 2023-06-08T03:49:17.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.532+0000 7f45a677c700 1 -- start start 2023-06-08T03:49:17.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a677c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:17.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a677c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45a00cebf0 0x7f45a00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:17.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a677c700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a00c8ba0 con 0x7f45a00701b0 2023-06-08T03:49:17.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a677c700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a00c8e80 con 0x7f45a00cebf0 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a677c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c9160 con 0x7f45a0158840 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a4d19700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45a00cebf0 0x7f45a00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a4d19700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45a00cebf0 0x7f45a00cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59026/0 (socket says 172.21.15.43:59026) 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f459f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f45a00701b0 0x7f45a00ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53930/0 (socket says 172.21.15.43:53930) 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f45a4d19700 1 -- 172.21.15.43:0/505050497 learned_addr learned my addr 172.21.15.43:0/505050497 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.533+0000 7f459ffff700 1 --2- 172.21.15.43:0/505050497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a4d19700 1 -- 172.21.15.43:0/505050497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 msgr2=0x7f45a00c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:17.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a4d19700 1 --2- 172.21.15.43:0/505050497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a4d19700 1 -- 172.21.15.43:0/505050497 >> v1:172.21.15.43:6789/0 conn(0x7f45a00701b0 legacy=0x7f45a00ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f459effd700 1 -- 172.21.15.43:0/505050497 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195389345 0 0) 0x7f45a00c8ba0 con 0x7f45a00701b0 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a4d19700 1 -- 172.21.15.43:0/505050497 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a00ccb60 con 0x7f45a00cebf0 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a4d19700 1 --2- 172.21.15.43:0/505050497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00cd360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f459800d150 tx=0x7f459800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba779e7b1cd6045 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f459effd700 1 -- 172.21.15.43:0/505050497 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598010070 con 0x7f45a00cebf0 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f459effd700 1 -- 172.21.15.43:0/505050497 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800ddc0 con 0x7f45a00cebf0 2023-06-08T03:49:17.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f459effd700 1 -- 172.21.15.43:0/505050497 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800b310 con 0x7f45a00cebf0 2023-06-08T03:49:17.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a677c700 1 -- 172.21.15.43:0/505050497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 msgr2=0x7f45a00cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a677c700 1 --2- 172.21.15.43:0/505050497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00cd360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f459800d150 tx=0x7f459800d460 comp rx=0 tx=0).stop 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a677c700 1 -- 172.21.15.43:0/505050497 shutdown_connections 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a677c700 1 --2- 172.21.15.43:0/505050497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00cd360 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a677c700 1 --2- 172.21.15.43:0/505050497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.534+0000 7f45a677c700 1 -- 172.21.15.43:0/505050497 >> 172.21.15.43:0/505050497 conn(0x7f45a006aa40 msgr2=0x7f45a00b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.535+0000 7f45a677c700 1 -- 172.21.15.43:0/505050497 shutdown_connections 2023-06-08T03:49:17.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.535+0000 7f45a677c700 1 -- 172.21.15.43:0/505050497 wait complete. 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.536+0000 7f45a677c700 1 Processor -- start 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.536+0000 7f45a677c700 1 -- start start 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00701b0 0x7f45a014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a014af80 con 0x7f45a00cebf0 2023-06-08T03:49:17.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c2e90 con 0x7f45a00701b0 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c3170 con 0x7f45a0158840 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59034/0 (socket says 172.21.15.43:59034) 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 -- 172.21.15.43:0/3672194390 learned_addr learned my addr 172.21.15.43:0/3672194390 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a4d19700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459ffff700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00701b0 0x7f45a014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 -- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 msgr2=0x7f45a00afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:17.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 -- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00701b0 msgr2=0x7f45a014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00701b0 0x7f45a014aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 -- 172.21.15.43:0/3672194390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459800bd40 con 0x7f45a00cebf0 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459ffff700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00701b0 0x7f45a014aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a4d19700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459f7fe700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00af850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f459000c540 tx=0x7f459000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590004c80 con 0x7f45a00cebf0 2023-06-08T03:49:17.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590004de0 con 0x7f45a00cebf0 2023-06-08T03:49:17.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a00c3450 con 0x7f45a00cebf0 2023-06-08T03:49:17.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590007310 con 0x7f45a00cebf0 2023-06-08T03:49:17.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a00c3a10 con 0x7f45a00cebf0 2023-06-08T03:49:17.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.538+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a00c3c30 con 0x7f45a00cebf0 2023-06-08T03:49:17.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.539+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4590007470 con 0x7f45a00cebf0 2023-06-08T03:49:17.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.539+0000 7f459cff9700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f458006ad10 0x7f458006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:17.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.539+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45900894d0 con 0x7f45a00cebf0 2023-06-08T03:49:17.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.540+0000 7f459ffff700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f458006ad10 0x7f458006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:17.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.540+0000 7f459ffff700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f458006ad10 0x7f458006d1c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4588006fd0 tx=0x7f4588008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:17.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.544+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4590054290 con 0x7f45a00cebf0 2023-06-08T03:49:17.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.788+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45a0073fa0 con 0x7f45a00cebf0 2023-06-08T03:49:17.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.789+0000 7f459cff9700 1 -- 172.21.15.43:0/3672194390 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f45900578b0 con 0x7f45a00cebf0 2023-06-08T03:49:17.793 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-08T03:49:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f458006ad10 msgr2=0x7f458006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f458006ad10 0x7f458006d1c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4588006fd0 tx=0x7f4588008040 comp rx=0 tx=0).stop 2023-06-08T03:49:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 msgr2=0x7f45a00af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00af850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f459000c540 tx=0x7f459000c900 comp rx=0 tx=0).stop 2023-06-08T03:49:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 shutdown_connections 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f458006ad10 0x7f458006d1c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a0158840 0x7f45a00afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00701b0 0x7f45a014aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 --2- 172.21.15.43:0/3672194390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45a00cebf0 0x7f45a00af850 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 >> 172.21.15.43:0/3672194390 conn(0x7f45a006aa40 msgr2=0x7f45a0071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 shutdown_connections 2023-06-08T03:49:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:17.791+0000 7f45a677c700 1 -- 172.21.15.43:0/3672194390 wait complete. 2023-06-08T03:49:17.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T03:49:17.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T03:49:17.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2023-06-08T03:49:17.807 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-08T03:49:17.808 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-08T03:49:17.808 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T03:49:17.808 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T03:49:17.808 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T03:49:17.808 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-08T03:49:17.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.809 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2023-06-08T03:49:17.826 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:17.826 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:17.826 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:17.826 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T03:49:17.827 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:17.828 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T03:49:17.828 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42427sec preferred_lft 42427sec 2023-06-08T03:49:17.828 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-06-08T03:49:17.828 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:17.828 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:17.828 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:17.829 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-08T03:49:17.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.829 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:17.829 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:17.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2023-06-08T03:49:17.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2023-06-08T03:49:17.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2023-06-08T03:49:17.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-08T03:49:17.830 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:17.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.944 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T03:49:17.971 INFO:teuthology.orchestra.run.smithi043.stdout:1 2023-06-08T03:49:17.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:17.973 DEBUG:teuthology.orchestra.run.smithi043:> route 2023-06-08T03:49:18.031 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2023-06-08T03:49:18.032 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T03:49:18.032 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T03:49:18.032 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T03:49:18.032 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T03:49:18.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.033 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:18.033 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:18.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T03:49:18.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T03:49:18.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T03:49:18.034 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:18.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.139 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-06-08T03:49:18.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.156 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2023-06-08T03:49:18.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.213 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:18.213 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:18.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-08T03:49:18.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-08T03:49:18.214 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:18.307 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-08T03:49:18.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.308 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:18.309 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:18.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-08T03:49:18.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-08T03:49:18.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-08T03:49:18.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-08T03:49:18.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-08T03:49:18.310 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:18.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.523 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:18.523 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:18.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2023-06-08T03:49:18.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2023-06-08T03:49:18.524 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:18.638 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:18.639 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-08T03:49:18.662 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-08T03:49:18.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:18.663 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-08T03:49:18.719 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-08T03:49:18.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:18.806 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:18.806 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:18.935 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:18.936 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:18.970 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:18.970 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:18.970 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:18.970 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:18.970 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:18.970 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:18.971 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:18.971 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:18.971 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-06-08T03:49:18.971 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-06-08T03:49:18.971 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=5ca92cbd-c0c8-4573-b70a-f139aab8d7d6" will pass to kernel 2023-06-08T03:49:18.976 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T03:49:18.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:18.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-08T03:49:19.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.014 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:19.086 INFO:teuthology.orchestra.run.smithi043.stdout:client4854 2023-06-08T03:49:19.087 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:19.087 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:19.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.144 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:19.216 INFO:teuthology.orchestra.run.smithi043.stdout:client4854 2023-06-08T03:49:19.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.217 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:19.289 INFO:teuthology.orchestra.run.smithi043.stdout:client4854 2023-06-08T03:49:19.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.291 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.client4854/status') 2023-06-08T03:49:19.370 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4854 (3)192.168.0.1:0/777795251 2023-06-08T03:49:19.371 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2023-06-08T03:49:19.371 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2023-06-08T03:49:19.371 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2023-06-08T03:49:19.371 INFO:teuthology.orchestra.run.smithi043.stderr:68 bytes copied, 2.5326e-05 s, 2.7 MB/s 2023-06-08T03:49:19.372 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-06-08T03:49:19.373 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T03:49:19.373 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-08T03:49:19.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T03:49:19.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.533+0000 7f6217acd700 1 Processor -- start 2023-06-08T03:49:19.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6217acd700 1 -- start start 2023-06-08T03:49:19.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6217acd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62100ceab0 0x7f62100cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:19.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6217acd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f621015a6a0 0x7f621015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6217acd700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100cd770 con 0x7f6210157d30 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6217acd700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6210158100 con 0x7f62100ceab0 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6217acd700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621015b020 con 0x7f621015a6a0 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.534+0000 7f6215068700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62100ceab0 0x7f62100cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62100ceab0 0x7f62100cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59046/0 (socket says 172.21.15.43:59046) 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 -- 172.21.15.43:0/2940456046 learned_addr learned my addr 172.21.15.43:0/2940456046 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:19.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f621606a700 1 --2- 172.21.15.43:0/2940456046 >> v2:172.21.15.135:3300/0 conn(0x7f621015a6a0 0x7f621015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:19.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 -- 172.21.15.43:0/2940456046 >> v2:172.21.15.135:3300/0 conn(0x7f621015a6a0 msgr2=0x7f621015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:19.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 --2- 172.21.15.43:0/2940456046 >> v2:172.21.15.135:3300/0 conn(0x7f621015a6a0 0x7f621015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 -- 172.21.15.43:0/2940456046 >> v1:172.21.15.135:6789/0 conn(0x7f6210157d30 legacy=0x7f62100ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:19.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 -- 172.21.15.43:0/2940456046 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621015b2d0 con 0x7f62100ceab0 2023-06-08T03:49:19.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f621606a700 1 --2- 172.21.15.43:0/2940456046 >> v2:172.21.15.135:3300/0 conn(0x7f621015a6a0 0x7f621015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:19.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6215068700 1 --2- 172.21.15.43:0/2940456046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100cdc00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f62100af9b0 tx=0x7f620c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156c8d7cbdc97d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:19.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6214867700 1 -- 172.21.15.43:0/2940456046 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00b870 con 0x7f62100ceab0 2023-06-08T03:49:19.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6214867700 1 -- 172.21.15.43:0/2940456046 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00b9d0 con 0x7f62100ceab0 2023-06-08T03:49:19.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.535+0000 7f6214867700 1 -- 172.21.15.43:0/2940456046 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00bd60 con 0x7f62100ceab0 2023-06-08T03:49:19.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 -- 172.21.15.43:0/2940456046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 msgr2=0x7f62100cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:19.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 --2- 172.21.15.43:0/2940456046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100cdc00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f62100af9b0 tx=0x7f620c009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 -- 172.21.15.43:0/2940456046 shutdown_connections 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 --2- 172.21.15.43:0/2940456046 >> v2:172.21.15.135:3300/0 conn(0x7f621015a6a0 0x7f621015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 --2- 172.21.15.43:0/2940456046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100cdc00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 -- 172.21.15.43:0/2940456046 >> 172.21.15.43:0/2940456046 conn(0x7f621006a6d0 msgr2=0x7f6210099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 -- 172.21.15.43:0/2940456046 shutdown_connections 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.536+0000 7f6217acd700 1 -- 172.21.15.43:0/2940456046 wait complete. 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.537+0000 7f6217acd700 1 Processor -- start 2023-06-08T03:49:19.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.537+0000 7f6217acd700 1 -- start start 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6217acd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6217acd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6210157d30 0x7f621006b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6217acd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621015a6a0 0x7f621006be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6217acd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100b4530 con 0x7f62100ceab0 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6217acd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621006aec0 con 0x7f6210157d30 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6217acd700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621006b440 con 0x7f621015a6a0 2023-06-08T03:49:19.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59052/0 (socket says 172.21.15.43:59052) 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 -- 172.21.15.43:0/4184325273 learned_addr learned my addr 172.21.15.43:0/4184325273 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215068700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6210157d30 0x7f621006b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f621606a700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621015a6a0 0x7f621006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 -- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621015a6a0 msgr2=0x7f621006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621015a6a0 0x7f621006be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 -- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6210157d30 msgr2=0x7f621006b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6210157d30 0x7f621006b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 -- 172.21.15.43:0/4184325273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009550 con 0x7f62100ceab0 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215068700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6210157d30 0x7f621006b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.538+0000 7f6215869700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100b3600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f620400c500 tx=0x7f620400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.539+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62040052d0 con 0x7f62100ceab0 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.539+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204005430 con 0x7f62100ceab0 2023-06-08T03:49:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.539+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100b3f70 con 0x7f62100ceab0 2023-06-08T03:49:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.539+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62040038f0 con 0x7f62100ceab0 2023-06-08T03:49:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.539+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621006b0d0 con 0x7f62100ceab0 2023-06-08T03:49:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.540+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62100ce700 con 0x7f62100ceab0 2023-06-08T03:49:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.540+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6204003a50 con 0x7f62100ceab0 2023-06-08T03:49:19.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.541+0000 7f62027fc700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f61f406ace0 0x7f61f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:19.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.541+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6204088cf0 con 0x7f62100ceab0 2023-06-08T03:49:19.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.541+0000 7f6215068700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f61f406ace0 0x7f61f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:19.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.541+0000 7f6215068700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f61f406ace0 0x7f61f406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f620c000c00 tx=0x7f620c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:19.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.545+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6204053aa0 con 0x7f62100ceab0 2023-06-08T03:49:19.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.788+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f621006b260 con 0x7f62100ceab0 2023-06-08T03:49:19.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.788+0000 7f62027fc700 1 -- 172.21.15.43:0/4184325273 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6204017070 con 0x7f62100ceab0 2023-06-08T03:49:19.792 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-08T03:49:19.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f61f406ace0 msgr2=0x7f61f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:19.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f61f406ace0 0x7f61f406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f620c000c00 tx=0x7f620c008030 comp rx=0 tx=0).stop 2023-06-08T03:49:19.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 msgr2=0x7f62100b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:19.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100b3600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f620400c500 tx=0x7f620400c8c0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 shutdown_connections 2023-06-08T03:49:19.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f61f406ace0 0x7f61f406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62100ceab0 0x7f62100b3600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f621015a6a0 0x7f621006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 --2- 172.21.15.43:0/4184325273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6210157d30 0x7f621006b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:19.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 >> 172.21.15.43:0/4184325273 conn(0x7f621006a6d0 msgr2=0x7f6210158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:19.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 shutdown_connections 2023-06-08T03:49:19.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:19.790+0000 7f6217acd700 1 -- 172.21.15.43:0/4184325273 wait complete. 2023-06-08T03:49:19.805 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T03:49:19.805 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T03:49:19.806 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2023-06-08T03:49:19.806 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-08T03:49:19.806 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-08T03:49:19.806 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T03:49:19.806 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T03:49:19.806 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T03:49:19.807 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-08T03:49:19.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.807 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2023-06-08T03:49:19.824 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:19.825 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:19.825 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:19.825 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:19.825 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:19.826 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42425sec preferred_lft 42425sec 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:49:19.827 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 92:f0:b7:39:93:75 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::a052:77ff:fe3b:8b55/64 scope link 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 92:f0:b7:39:93:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::90f0:b7ff:fe39:9375/64 scope link 2023-06-08T03:49:19.828 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:19.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.829 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T03:49:19.890 INFO:teuthology.orchestra.run.smithi043.stdout:1 2023-06-08T03:49:19.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.893 DEBUG:teuthology.orchestra.run.smithi043:> route 2023-06-08T03:49:19.951 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2023-06-08T03:49:19.952 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T03:49:19.952 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T03:49:19.952 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T03:49:19.952 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T03:49:19.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:19.953 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:19.953 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:19.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T03:49:19.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T03:49:19.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T03:49:19.954 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:20.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.059 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-06-08T03:49:20.075 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-08T03:49:20.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.076 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2023-06-08T03:49:20.132 INFO:teuthology.orchestra.run.smithi043.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-08T03:49:20.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.133 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:20.134 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:20.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-08T03:49:20.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-08T03:49:20.134 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:20.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.227 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-08T03:49:20.264 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:20.264 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:20.264 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:20.264 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.264 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether ca:58:22:3c:e1:8e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::c858:22ff:fe3c:e18e/64 scope link tentative 2023-06-08T03:49:20.265 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-08T03:49:20.360 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:20.360 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether ca:58:22:3c:e1:8e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T03:49:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.362 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::c858:22ff:fe3c:e18e/64 scope link tentative 2023-06-08T03:49:20.362 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:20.371 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-08T03:49:20.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.372 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:20.372 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:20.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-08T03:49:20.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-08T03:49:20.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-08T03:49:20.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-08T03:49:20.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-08T03:49:20.373 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:20.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.618 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:49:20.618 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:49:20.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.1 up 2023-06-08T03:49:20.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.1 master ceph-brx 2023-06-08T03:49:20.619 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:49:20.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:20.734 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-08T03:49:20.757 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-08T03:49:20.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:20.758 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-08T03:49:20.813 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-06-08T03:49:20.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:20.814 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:20.900 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:20.900 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:20.929 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:20.929 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:20.929 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:20.929 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 2@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:20.930 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:20.930 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:20.930 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:20.930 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:21.003 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:21.004 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:21.004 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:21.004 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 2@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:21.005 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:21.005 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:21.005 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:21.006 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:21.006 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-06-08T03:49:21.006 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-06-08T03:49:21.007 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=5ca92cbd-c0c8-4573-b70a-f139aab8d7d6" will pass to kernel 2023-06-08T03:49:21.008 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T03:49:21.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-08T03:49:21.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.037 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:21.109 INFO:teuthology.orchestra.run.smithi043.stdout:client4616 2023-06-08T03:49:21.110 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:21.110 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:21.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.168 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:21.240 INFO:teuthology.orchestra.run.smithi043.stdout:client4616 2023-06-08T03:49:21.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.242 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:21.314 INFO:teuthology.orchestra.run.smithi043.stdout:client4616 2023-06-08T03:49:21.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.315 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.client4616/status') 2023-06-08T03:49:21.395 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4616 (3)172.21.15.43:0/1884721670 2023-06-08T03:49:21.395 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2023-06-08T03:49:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2023-06-08T03:49:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2023-06-08T03:49:21.397 INFO:teuthology.orchestra.run.smithi043.stderr:70 bytes copied, 2.295e-05 s, 3.1 MB/s 2023-06-08T03:49:21.397 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-06-08T03:49:21.397 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T03:49:21.397 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-08T03:49:21.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T03:49:21.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.558+0000 7f237ecec700 1 Processor -- start 2023-06-08T03:49:21.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.558+0000 7f237ecec700 1 -- start start 2023-06-08T03:49:21.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.558+0000 7f237ecec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 0x7f23780caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.558+0000 7f237ecec700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23780ccb30 con 0x7f2378070a50 2023-06-08T03:49:21.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.558+0000 7f237ecec700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23780c8f70 con 0x7f237815c430 2023-06-08T03:49:21.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.558+0000 7f237ecec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c8c40 con 0x7f23780cdb50 2023-06-08T03:49:21.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f237d289700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2378070a50 0x7f23780c9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53970/0 (socket says 172.21.15.43:53970) 2023-06-08T03:49:21.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f237d289700 1 -- 172.21.15.43:0/37722813 learned_addr learned my addr 172.21.15.43:0/37722813 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:21.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f2377fff700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 0x7f23780caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118637679 0 0) 0x7f23780ccb30 con 0x7f2378070a50 2023-06-08T03:49:21.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23680057c0 con 0x7f2378070a50 2023-06-08T03:49:21.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177770439 0 0) 0x7f23680057c0 con 0x7f2378070a50 2023-06-08T03:49:21.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 msgr2=0x7f23780caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:21.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 0x7f23780caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 >> v1:172.21.15.135:6789/0 conn(0x7f237815c430 legacy=0x7f23780ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237815c800 con 0x7f2378070a50 2023-06-08T03:49:21.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f23700019f0 con 0x7f2378070a50 2023-06-08T03:49:21.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 >> v1:172.21.15.43:6789/0 conn(0x7f2378070a50 legacy=0x7f23780c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2368006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 0x7f2368006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2368006fa0 0x7f2368007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c8c40 con 0x7f2368005c40 2023-06-08T03:49:21.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236800dc20 con 0x7f2368006fa0 2023-06-08T03:49:21.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236800ddb0 con 0x7f23780cdb50 2023-06-08T03:49:21.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f237ca88700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2368006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f2377fff700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 0x7f2368006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.559+0000 7f237d289700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2368006fa0 0x7f2368007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ca88700 1 -- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 msgr2=0x7f2368006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:21.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ca88700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780cdb50 0x7f2368006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ca88700 1 -- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2368006fa0 msgr2=0x7f2368007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:21.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ca88700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2368006fa0 0x7f2368007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ca88700 1 -- 172.21.15.43:0/37722813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680057c0 con 0x7f2368005c40 2023-06-08T03:49:21.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ca88700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2368006010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f236c0018d0 tx=0x7f2368007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdbc61a0de9a213 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:21.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00c690 con 0x7f2368005c40 2023-06-08T03:49:21.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00c810 con 0x7f2368005c40 2023-06-08T03:49:21.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f23777fe700 1 -- 172.21.15.43:0/37722813 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cbc0 con 0x7f2368005c40 2023-06-08T03:49:21.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ecec700 1 -- 172.21.15.43:0/37722813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 msgr2=0x7f2368006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ecec700 1 --2- 172.21.15.43:0/37722813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2368006010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f236c0018d0 tx=0x7f2368007a90 comp rx=0 tx=0).stop 2023-06-08T03:49:21.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237d289700 1 -- 172.21.15.43:0/37722813 reap_dead start 2023-06-08T03:49:21.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ecec700 1 -- 172.21.15.43:0/37722813 shutdown_connections 2023-06-08T03:49:21.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.560+0000 7f237ecec700 1 -- 172.21.15.43:0/37722813 >> 172.21.15.43:0/37722813 conn(0x7f237806aa40 msgr2=0x7f23780b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:21.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.561+0000 7f237ecec700 1 -- 172.21.15.43:0/37722813 shutdown_connections 2023-06-08T03:49:21.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.561+0000 7f237ecec700 1 -- 172.21.15.43:0/37722813 wait complete. 2023-06-08T03:49:21.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.562+0000 7f237ecec700 1 Processor -- start 2023-06-08T03:49:21.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.562+0000 7f237ecec700 1 -- start start 2023-06-08T03:49:21.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2378152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23780b2f80 0x7f23780c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780c48a0 0x7f23780b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378152d40 con 0x7f2368005c40 2023-06-08T03:49:21.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780b3410 con 0x7f23780b2f80 2023-06-08T03:49:21.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780b36f0 con 0x7f23780c48a0 2023-06-08T03:49:21.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2378152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2378152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59074/0 (socket says 172.21.15.43:59074) 2023-06-08T03:49:21.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 -- 172.21.15.43:0/3254216547 learned_addr learned my addr 172.21.15.43:0/3254216547 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:21.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237d289700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780c48a0 0x7f23780b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 -- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780c48a0 msgr2=0x7f23780b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f2377fff700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23780b2f80 0x7f23780c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780c48a0 0x7f23780b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 -- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23780b2f80 msgr2=0x7f23780c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23780b2f80 0x7f23780c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 -- 172.21.15.43:0/3254216547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780b39d0 con 0x7f2368005c40 2023-06-08T03:49:21.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ca88700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2378152800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2368007a10 tx=0x7f236c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:21.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cb80 con 0x7f2368005c40 2023-06-08T03:49:21.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c021070 con 0x7f2368005c40 2023-06-08T03:49:21.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cee0 con 0x7f2368005c40 2023-06-08T03:49:21.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23780b3cb0 con 0x7f2368005c40 2023-06-08T03:49:21.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.563+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23780b1900 con 0x7f2368005c40 2023-06-08T03:49:21.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.564+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2378073fa0 con 0x7f2368005c40 2023-06-08T03:49:21.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.565+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f236c023030 con 0x7f2368005c40 2023-06-08T03:49:21.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.566+0000 7f23757fa700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f235c06ace0 0x7f235c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:21.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.566+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f236c08acc0 con 0x7f2368005c40 2023-06-08T03:49:21.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.566+0000 7f2377fff700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f235c06ace0 0x7f235c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:21.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.566+0000 7f2377fff700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f235c06ace0 0x7f235c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f23780cdf20 tx=0x7f2364008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:21.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.569+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f236c055bf0 con 0x7f2368005c40 2023-06-08T03:49:21.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.812+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23780b0ae0 con 0x7f2368005c40 2023-06-08T03:49:21.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.812+0000 7f23757fa700 1 -- 172.21.15.43:0/3254216547 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f236c059210 con 0x7f2368005c40 2023-06-08T03:49:21.815 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-08T03:49:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f235c06ace0 msgr2=0x7f235c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f235c06ace0 0x7f235c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f23780cdf20 tx=0x7f2364008040 comp rx=0 tx=0).stop 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 msgr2=0x7f2378152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2378152800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2368007a10 tx=0x7f236c001230 comp rx=0 tx=0).stop 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 shutdown_connections 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f235c06ace0 0x7f235c06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2368005c40 0x7f2378152800 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780c48a0 0x7f23780b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 --2- 172.21.15.43:0/3254216547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23780b2f80 0x7f23780c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 >> 172.21.15.43:0/3254216547 conn(0x7f237806aa40 msgr2=0x7f23780ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 shutdown_connections 2023-06-08T03:49:21.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:21.814+0000 7f237ecec700 1 -- 172.21.15.43:0/3254216547 wait complete. 2023-06-08T03:49:21.829 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T03:49:21.829 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T03:49:21.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-06-08T03:49:21.830 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-08T03:49:21.830 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-08T03:49:21.830 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T03:49:21.830 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T03:49:21.831 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T03:49:21.831 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-08T03:49:21.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.831 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-06-08T03:49:21.852 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:21.853 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:21.854 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-08T03:49:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42437sec preferred_lft 42437sec 2023-06-08T03:49:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::61ca:6672:fd:21fb/64 scope link noprefixroute 2023-06-08T03:49:21.855 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:21.855 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-08T03:49:21.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:21.856 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:21.856 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:21.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2023-06-08T03:49:21.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2023-06-08T03:49:21.857 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2023-06-08T03:49:21.857 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-08T03:49:21.857 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:22.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.038 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T03:49:22.067 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-06-08T03:49:22.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.069 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-06-08T03:49:22.140 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-06-08T03:49:22.141 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T03:49:22.141 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-08T03:49:22.141 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-08T03:49:22.142 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T03:49:22.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.143 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:22.143 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:22.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-08T03:49:22.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-08T03:49:22.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-08T03:49:22.144 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:22.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.395 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-06-08T03:49:22.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.411 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-06-08T03:49:22.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.467 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:22.468 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:22.468 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-08T03:49:22.468 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-08T03:49:22.468 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:22.560 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-08T03:49:22.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.561 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:22.561 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:22.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-08T03:49:22.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-08T03:49:22.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-08T03:49:22.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-08T03:49:22.563 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-08T03:49:22.563 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:22.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.784 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:22.785 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:22.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-06-08T03:49:22.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2023-06-08T03:49:22.785 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:22.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:22.883 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-08T03:49:22.903 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-08T03:49:22.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:22.904 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-08T03:49:22.959 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-06-08T03:49:22.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:22.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:23.060 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:23.061 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:23.181 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:23.181 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:23.181 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:23.181 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 1@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:23.181 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:23.182 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:23.182 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:23.182 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:23.207 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:23.207 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:23.207 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:23.207 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 1@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-06-08T03:49:23.208 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=5ca92cbd-c0c8-4573-b70a-f139aab8d7d6" will pass to kernel 2023-06-08T03:49:23.211 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T03:49:23.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:23.211 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-08T03:49:23.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:23.243 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:23.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:49:23.296 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:49:23.314 INFO:teuthology.orchestra.run.smithi135.stdout:client4869 2023-06-08T03:49:23.315 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:23.315 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:23.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:23.372 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:23.443 INFO:teuthology.orchestra.run.smithi135.stdout:client4869 2023-06-08T03:49:23.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:23.444 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:23.515 INFO:teuthology.orchestra.run.smithi135.stdout:client4869 2023-06-08T03:49:23.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:23.515 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.client4869/status') 2023-06-08T03:49:23.594 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4869 (3)172.21.15.135:0/1757780643 2023-06-08T03:49:23.594 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2023-06-08T03:49:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2023-06-08T03:49:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2023-06-08T03:49:23.595 INFO:teuthology.orchestra.run.smithi135.stderr:71 bytes copied, 2.3998e-05 s, 3.0 MB/s 2023-06-08T03:49:23.595 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-06-08T03:49:23.596 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T03:49:23.596 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-08T03:49:23.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T03:49:23.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.731+0000 7fd83f00b700 1 Processor -- start 2023-06-08T03:49:23.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.731+0000 7fd83f00b700 1 -- start start 2023-06-08T03:49:23.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83f00b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd83806b4b0 0x7fd838145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:23.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83f00b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83f00b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8380d16e0 con 0x7fd838145cd0 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83f00b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8380cd050 con 0x7fd83806b4b0 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83f00b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380cc1d0 con 0x7fd8380d0e70 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd837fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd838145cd0 0x7fd8380d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53988/0 (socket says 172.21.15.43:53988) 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd837fff700 1 -- 172.21.15.43:0/314922314 learned_addr learned my addr 172.21.15.43:0/314922314 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83cda7700 1 --2- 172.21.15.43:0/314922314 >> v2:172.21.15.135:3300/0 conn(0x7fd83806b4b0 0x7fd838145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.732+0000 7fd83d5a8700 1 --2- 172.21.15.43:0/314922314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd8377fe700 1 -- 172.21.15.43:0/314922314 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110655849 0 0) 0x7fd824001110 con 0x7fd838145cd0 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd8377fe700 1 -- 172.21.15.43:0/314922314 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8280035b0 con 0x7fd838145cd0 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd83d5a8700 1 -- 172.21.15.43:0/314922314 >> v2:172.21.15.135:3300/0 conn(0x7fd83806b4b0 msgr2=0x7fd838145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd83d5a8700 1 --2- 172.21.15.43:0/314922314 >> v2:172.21.15.135:3300/0 conn(0x7fd83806b4b0 0x7fd838145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd83d5a8700 1 -- 172.21.15.43:0/314922314 >> v1:172.21.15.43:6789/0 conn(0x7fd838145cd0 legacy=0x7fd8380d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd83d5a8700 1 -- 172.21.15.43:0/314922314 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380cd2a0 con 0x7fd8380d0e70 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd83cda7700 1 --2- 172.21.15.43:0/314922314 >> v2:172.21.15.135:3300/0 conn(0x7fd83806b4b0 0x7fd838145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:23.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd83d5a8700 1 --2- 172.21.15.43:0/314922314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380caf20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd830009d90 tx=0x7fd83000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807c65c74c0c8fdc server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:23.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd8377fe700 1 -- 172.21.15.43:0/314922314 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000e070 con 0x7fd8380d0e70 2023-06-08T03:49:23.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd8377fe700 1 -- 172.21.15.43:0/314922314 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000bb20 con 0x7fd8380d0e70 2023-06-08T03:49:23.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.733+0000 7fd8377fe700 1 -- 172.21.15.43:0/314922314 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830012430 con 0x7fd8380d0e70 2023-06-08T03:49:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 -- 172.21.15.43:0/314922314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 msgr2=0x7fd8380caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 --2- 172.21.15.43:0/314922314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380caf20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd830009d90 tx=0x7fd83000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 -- 172.21.15.43:0/314922314 shutdown_connections 2023-06-08T03:49:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 --2- 172.21.15.43:0/314922314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380caf20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 --2- 172.21.15.43:0/314922314 >> v2:172.21.15.135:3300/0 conn(0x7fd83806b4b0 0x7fd838145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 -- 172.21.15.43:0/314922314 >> 172.21.15.43:0/314922314 conn(0x7fd83806a6d0 msgr2=0x7fd838099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 -- 172.21.15.43:0/314922314 shutdown_connections 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.734+0000 7fd83f00b700 1 -- 172.21.15.43:0/314922314 wait complete. 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.735+0000 7fd83f00b700 1 Processor -- start 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.735+0000 7fd83f00b700 1 -- start start 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83f00b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 0x7fd838156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83f00b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83f00b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd838145cd0 0x7fd8380cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83f00b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381572a0 con 0x7fd83806b4b0 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83f00b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83815c9d0 con 0x7fd838145cd0 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83f00b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380c66f0 con 0x7fd8380d0e70 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 0x7fd838156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 0x7fd838156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59088/0 (socket says 172.21.15.43:59088) 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 -- 172.21.15.43:0/1532242973 learned_addr learned my addr 172.21.15.43:0/1532242973 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83d5a8700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd838145cd0 0x7fd8380cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:23.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd837fff700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 -- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 msgr2=0x7fd8380c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 -- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd838145cd0 msgr2=0x7fd8380cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd838145cd0 0x7fd8380cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.736+0000 7fd83cda7700 1 -- 172.21.15.43:0/1532242973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009430 con 0x7fd83806b4b0 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.737+0000 7fd83cda7700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 0x7fd838156d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00ebe0 tx=0x7fd82c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:23.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.737+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c009740 con 0x7fd83806b4b0 2023-06-08T03:49:23.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.737+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c005a20 con 0x7fd83806b4b0 2023-06-08T03:49:23.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.737+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c005db0 con 0x7fd83806b4b0 2023-06-08T03:49:23.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.737+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd830009a70 con 0x7fd83806b4b0 2023-06-08T03:49:23.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.737+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8380c6cb0 con 0x7fd83806b4b0 2023-06-08T03:49:23.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.738+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83806ffc0 con 0x7fd83806b4b0 2023-06-08T03:49:23.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.739+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd82c00c850 con 0x7fd83806b4b0 2023-06-08T03:49:23.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.739+0000 7fd8357fa700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd81c06ad10 0x7fd81c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:23.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.739+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd82c089830 con 0x7fd83806b4b0 2023-06-08T03:49:23.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.739+0000 7fd837fff700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd81c06ad10 0x7fd81c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:23.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.740+0000 7fd837fff700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd81c06ad10 0x7fd81c06d1c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd824007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:23.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.745+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd82c054680 con 0x7fd83806b4b0 2023-06-08T03:49:23.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.985+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8380ce550 con 0x7fd83806b4b0 2023-06-08T03:49:23.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.985+0000 7fd8357fa700 1 -- 172.21.15.43:0/1532242973 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd82c020070 con 0x7fd83806b4b0 2023-06-08T03:49:23.989 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-08T03:49:23.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd81c06ad10 msgr2=0x7fd81c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:23.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd81c06ad10 0x7fd81c06d1c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd824007c40 comp rx=0 tx=0).stop 2023-06-08T03:49:23.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 msgr2=0x7fd838156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:23.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 0x7fd838156d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00ebe0 tx=0x7fd82c00eef0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 shutdown_connections 2023-06-08T03:49:23.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd81c06ad10 0x7fd81c06d1c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd83806b4b0 0x7fd838156d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd838145cd0 0x7fd8380cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 --2- 172.21.15.43:0/1532242973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8380d0e70 0x7fd8380c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:23.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 >> 172.21.15.43:0/1532242973 conn(0x7fd83806a6d0 msgr2=0x7fd8380af070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:23.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 shutdown_connections 2023-06-08T03:49:23.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:23.987+0000 7fd83f00b700 1 -- 172.21.15.43:0/1532242973 wait complete. 2023-06-08T03:49:24.002 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T03:49:24.003 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T03:49:24.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-06-08T03:49:24.003 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-08T03:49:24.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-08T03:49:24.003 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T03:49:24.004 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T03:49:24.004 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T03:49:24.004 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-08T03:49:24.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.005 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-06-08T03:49:24.022 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:24.023 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:24.023 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:24.023 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.023 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:24.023 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.023 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T03:49:24.024 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42435sec preferred_lft 42435sec 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::61ca:6672:fd:21fb/64 scope link noprefixroute 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 46:32:24:5c:c6:14 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:49:24.025 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::5456:dff:fe73:1a62/64 scope link 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 46:32:24:5c:c6:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::4432:24ff:fe5c:c614/64 scope link 2023-06-08T03:49:24.026 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.027 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T03:49:24.089 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-06-08T03:49:24.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.091 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-06-08T03:49:24.149 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-06-08T03:49:24.149 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T03:49:24.150 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-08T03:49:24.150 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-08T03:49:24.150 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T03:49:24.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.151 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:24.151 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:24.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-08T03:49:24.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-08T03:49:24.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-08T03:49:24.152 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:24.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.254 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-06-08T03:49:24.270 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-08T03:49:24.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.271 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-06-08T03:49:24.327 INFO:teuthology.orchestra.run.smithi135.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-08T03:49:24.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.328 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:24.328 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:24.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-08T03:49:24.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-08T03:49:24.329 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:24.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-08T03:49:24.455 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:24.456 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:24.456 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:24.456 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.456 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:24.456 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.456 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:49:24.457 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 8e:20:8f:d9:a4:5d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T03:49:24.457 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T03:49:24.457 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.457 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::8c20:8fff:fed9:a45d/64 scope link tentative 2023-06-08T03:49:24.457 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-08T03:49:24.547 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:49:24.547 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:49:24.547 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:49:24.547 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 8e:20:8f:d9:a4:5d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::8c20:8fff:fed9:a45d/64 scope link tentative 2023-06-08T03:49:24.549 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:49:24.560 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-08T03:49:24.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.561 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:24.561 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:24.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-08T03:49:24.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-08T03:49:24.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-08T03:49:24.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-08T03:49:24.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-08T03:49:24.562 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:24.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:24.816 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-06-08T03:49:24.816 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-06-08T03:49:24.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.1 up 2023-06-08T03:49:24.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.1 master ceph-brx 2023-06-08T03:49:24.817 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-06-08T03:49:24.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:24.926 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-08T03:49:24.945 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-08T03:49:24.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:49:24.946 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-08T03:49:25.002 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-06-08T03:49:25.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:25.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:25.112 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:25.112 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:25.112 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:25.112 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 3@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:25.112 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:25.113 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:25.113 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:25.113 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:25.160 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:49:25.160 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:49:25.160 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 3@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-06-08T03:49:25.161 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-06-08T03:49:25.162 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=5ca92cbd-c0c8-4573-b70a-f139aab8d7d6" will pass to kernel 2023-06-08T03:49:25.167 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T03:49:25.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:25.167 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-08T03:49:25.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:25.194 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:25.265 INFO:teuthology.orchestra.run.smithi135.stdout:client4804 2023-06-08T03:49:25.266 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:25.266 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:25.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:25.325 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:25.395 INFO:teuthology.orchestra.run.smithi135.stdout:client4804 2023-06-08T03:49:25.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:25.396 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:49:25.466 INFO:teuthology.orchestra.run.smithi135.stdout:client4804 2023-06-08T03:49:25.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:25.468 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.client4804/status') 2023-06-08T03:49:25.547 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4804 (3)192.168.0.2:0/2466555332 2023-06-08T03:49:25.547 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2023-06-08T03:49:25.548 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2023-06-08T03:49:25.548 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2023-06-08T03:49:25.548 INFO:teuthology.orchestra.run.smithi135.stderr:69 bytes copied, 3.7557e-05 s, 1.8 MB/s 2023-06-08T03:49:25.549 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-08T03:49:25.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:25.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.702+0000 7fdf22160700 1 Processor -- start 2023-06-08T03:49:25.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.702+0000 7fdf22160700 1 -- start start 2023-06-08T03:49:25.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf22160700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15e440 0x7fdf1c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:25.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf22160700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c157ed0 con 0x7fdf1c0709a0 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf22160700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c15b3d0 con 0x7fdf1c15af50 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf22160700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15da30 con 0x7fdf1c15e440 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf1b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdf1c0709a0 0x7fdf1c0caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54000/0 (socket says 172.21.15.43:54000) 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf1b7fe700 1 -- 172.21.15.43:0/1972462874 learned_addr learned my addr 172.21.15.43:0/1972462874 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.703+0000 7fdf1bfff700 1 --2- 172.21.15.43:0/1972462874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15e440 0x7fdf1c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232174224 0 0) 0x7fdf1c157ed0 con 0x7fdf1c0709a0 2023-06-08T03:49:25.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf080035b0 con 0x7fdf1c0709a0 2023-06-08T03:49:25.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143753537 0 0) 0x7fdf1c15b3d0 con 0x7fdf1c15af50 2023-06-08T03:49:25.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf1c157ed0 con 0x7fdf1c15af50 2023-06-08T03:49:25.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1bfff700 1 -- 172.21.15.43:0/1972462874 >> v1:172.21.15.135:6789/0 conn(0x7fdf1c15af50 legacy=0x7fdf1c070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1bfff700 1 -- 172.21.15.43:0/1972462874 >> v1:172.21.15.43:6789/0 conn(0x7fdf1c0709a0 legacy=0x7fdf1c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1bfff700 1 -- 172.21.15.43:0/1972462874 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c0cb2e0 con 0x7fdf1c15e440 2023-06-08T03:49:25.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1bfff700 1 --2- 172.21.15.43:0/1972462874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15e440 0x7fdf1c15b600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009dc0 tx=0x7fdf1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b1c94167642139 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400e070 con 0x7fdf1c15e440 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1400bb20 con 0x7fdf1c15e440 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.704+0000 7fdf1a7fc700 1 -- 172.21.15.43:0/1972462874 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14012430 con 0x7fdf1c15e440 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 -- 172.21.15.43:0/1972462874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15e440 msgr2=0x7fdf1c15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 --2- 172.21.15.43:0/1972462874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15e440 0x7fdf1c15b600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009dc0 tx=0x7fdf1400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 -- 172.21.15.43:0/1972462874 shutdown_connections 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 --2- 172.21.15.43:0/1972462874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15e440 0x7fdf1c15b600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 -- 172.21.15.43:0/1972462874 >> 172.21.15.43:0/1972462874 conn(0x7fdf1c0ceed0 msgr2=0x7fdf1c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:25.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 -- 172.21.15.43:0/1972462874 shutdown_connections 2023-06-08T03:49:25.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.705+0000 7fdf22160700 1 -- 172.21.15.43:0/1972462874 wait complete. 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.706+0000 7fdf22160700 1 Processor -- start 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.706+0000 7fdf22160700 1 -- start start 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf22160700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0709a0 0x7fdf1c151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf22160700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15af50 0x7fdf1c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf22160700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 0x7fdf1c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf22160700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c3580 con 0x7fdf1c15e440 2023-06-08T03:49:25.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf22160700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c06cb90 con 0x7fdf1c0709a0 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf22160700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c06ce70 con 0x7fdf1c15af50 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 0x7fdf1c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 0x7fdf1c1563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59106/0 (socket says 172.21.15.43:59106) 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf1b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0709a0 0x7fdf1c151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf1bfff700 1 -- 172.21.15.43:0/342942971 learned_addr learned my addr 172.21.15.43:0/342942971 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf1affd700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15af50 0x7fdf1c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:25.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.707+0000 7fdf1bfff700 1 -- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15af50 msgr2=0x7fdf1c06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf1bfff700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15af50 0x7fdf1c06e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf1bfff700 1 -- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0709a0 msgr2=0x7fdf1c151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf1bfff700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0709a0 0x7fdf1c151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf1bfff700 1 -- 172.21.15.43:0/342942971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009a70 con 0x7fdf1c15e440 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf1bfff700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 0x7fdf1c1563a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400b370 tx=0x7fdf14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1401b810 con 0x7fdf1c15e440 2023-06-08T03:49:25.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14020070 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1401bbb0 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c06d150 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.708+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c151b60 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.709+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c0c3780 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.709+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf1401bd10 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.710+0000 7fdf13fff700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdefc06ace0 0x7fdefc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.710+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf14022070 con 0x7fdf1c15e440 2023-06-08T03:49:25.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.710+0000 7fdf1b7fe700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdefc06ace0 0x7fdefc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:25.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.711+0000 7fdf1b7fe700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdefc06ace0 0x7fdefc06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c007fd0 tx=0x7fdf0c007e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:25.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.714+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf1c0c3780 con 0x7fdf1c15e440 2023-06-08T03:49:25.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.913+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf1c0c3780 con 0x7fdf1c15e440 2023-06-08T03:49:25.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.915+0000 7fdf13fff700 1 -- 172.21.15.43:0/342942971 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fdf1c0c3780 con 0x7fdf1c15e440 2023-06-08T03:49:25.918 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:25.918 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:25.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdefc06ace0 msgr2=0x7fdefc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdefc06ace0 0x7fdefc06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c007fd0 tx=0x7fdf0c007e00 comp rx=0 tx=0).stop 2023-06-08T03:49:25.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 msgr2=0x7fdf1c1563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:25.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 0x7fdf1c1563a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400b370 tx=0x7fdf14004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 shutdown_connections 2023-06-08T03:49:25.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdefc06ace0 0x7fdefc06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf1c15e440 0x7fdf1c1563a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0709a0 0x7fdf1c151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 --2- 172.21.15.43:0/342942971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c15af50 0x7fdf1c06e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:25.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 >> 172.21.15.43:0/342942971 conn(0x7fdf1c0ceed0 msgr2=0x7fdf1c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:25.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 shutdown_connections 2023-06-08T03:49:25.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:25.917+0000 7fdf22160700 1 -- 172.21.15.43:0/342942971 wait complete. 2023-06-08T03:49:25.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:25.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:26.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.058+0000 7ff797613700 1 Processor -- start 2023-06-08T03:49:26.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 -- start start 2023-06-08T03:49:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7900b60a0 0x7ff7900cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7900cf5b0 0x7ff79015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff7900ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900b6470 con 0x7ff7900b60a0 2023-06-08T03:49:26.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900cda20 con 0x7ff7900cf5b0 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.059+0000 7ff797613700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79015a520 con 0x7ff79015e170 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7900b60a0 0x7ff7900cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7900b60a0 0x7ff7900cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59110/0 (socket says 172.21.15.43:59110) 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 -- 172.21.15.43:0/3042981681 learned_addr learned my addr 172.21.15.43:0/3042981681 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff794bae700 1 --2- 172.21.15.43:0/3042981681 >> v2:172.21.15.135:3300/0 conn(0x7ff7900cf5b0 0x7ff79015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff795bb0700 1 --2- 172.21.15.43:0/3042981681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff7900ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 -- 172.21.15.43:0/3042981681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 msgr2=0x7ff7900ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:26.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 --2- 172.21.15.43:0/3042981681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff7900ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 -- 172.21.15.43:0/3042981681 >> v2:172.21.15.135:3300/0 conn(0x7ff7900cf5b0 msgr2=0x7ff79015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 --2- 172.21.15.43:0/3042981681 >> v2:172.21.15.135:3300/0 conn(0x7ff7900cf5b0 0x7ff79015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 -- 172.21.15.43:0/3042981681 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79015ea40 con 0x7ff7900b60a0 2023-06-08T03:49:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff794bae700 1 --2- 172.21.15.43:0/3042981681 >> v2:172.21.15.135:3300/0 conn(0x7ff7900cf5b0 0x7ff79015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:26.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff7953af700 1 --2- 172.21.15.43:0/3042981681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7900cad90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff7900cbd90 tx=0x7ff78c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfa010ee4d3e70 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff783fff700 1 -- 172.21.15.43:0/3042981681 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00b870 con 0x7ff7900b60a0 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff783fff700 1 -- 172.21.15.43:0/3042981681 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00b9d0 con 0x7ff7900b60a0 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.060+0000 7ff783fff700 1 -- 172.21.15.43:0/3042981681 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00bd60 con 0x7ff7900b60a0 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 -- 172.21.15.43:0/3042981681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 msgr2=0x7ff7900cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 --2- 172.21.15.43:0/3042981681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7900cad90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff7900cbd90 tx=0x7ff78c009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 -- 172.21.15.43:0/3042981681 shutdown_connections 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 --2- 172.21.15.43:0/3042981681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff7900ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 --2- 172.21.15.43:0/3042981681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7900cad90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 --2- 172.21.15.43:0/3042981681 >> v2:172.21.15.135:3300/0 conn(0x7ff7900cf5b0 0x7ff79015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 -- 172.21.15.43:0/3042981681 >> 172.21.15.43:0/3042981681 conn(0x7ff790069db0 msgr2=0x7ff79006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:26.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 -- 172.21.15.43:0/3042981681 shutdown_connections 2023-06-08T03:49:26.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.061+0000 7ff797613700 1 -- 172.21.15.43:0/3042981681 wait complete. 2023-06-08T03:49:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.062+0000 7ff797613700 1 Processor -- start 2023-06-08T03:49:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.063+0000 7ff797613700 1 -- start start 2023-06-08T03:49:26.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.063+0000 7ff797613700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7901f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.063+0000 7ff797613700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7900cf5b0 0x7ff7900acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.063+0000 7ff797613700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff79006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff797613700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7901f62b0 con 0x7ff7900b60a0 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff797613700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900abe60 con 0x7ff7900cf5b0 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff797613700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900ac140 con 0x7ff79015e170 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7901f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff794bae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7900cf5b0 0x7ff7900acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7901f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59116/0 (socket says 172.21.15.43:59116) 2023-06-08T03:49:26.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 -- 172.21.15.43:0/3630751093 learned_addr learned my addr 172.21.15.43:0/3630751093 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:26.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff795bb0700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff79006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 -- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 msgr2=0x7ff79006b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff79006b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 -- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7900cf5b0 msgr2=0x7ff7900acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7900cf5b0 0x7ff7900acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 -- 172.21.15.43:0/3630751093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c009550 con 0x7ff7900b60a0 2023-06-08T03:49:26.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff7953af700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7901f5d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff78c000c00 tx=0x7ff78c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c004310 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c01e070 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7900ac420 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.064+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0036a0 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.065+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7900ac9e0 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.065+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff790073fa0 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.066+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff78c020030 con 0x7ff7900b60a0 2023-06-08T03:49:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.066+0000 7ff781ffb700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff77406ace0 0x7ff77406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.067+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff78c08a5c0 con 0x7ff7900b60a0 2023-06-08T03:49:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.067+0000 7ff794bae700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff77406ace0 0x7ff77406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.067+0000 7ff794bae700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff77406ace0 0x7ff77406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7900d1700 tx=0x7ff784008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.071+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff78c055410 con 0x7ff7900b60a0 2023-06-08T03:49:26.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.268+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7900b2790 con 0x7ff7900b60a0 2023-06-08T03:49:26.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.269+0000 7ff781ffb700 1 -- 172.21.15.43:0/3630751093 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff78c058a30 con 0x7ff7900b60a0 2023-06-08T03:49:26.272 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:26.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff77406ace0 msgr2=0x7ff77406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff77406ace0 0x7ff77406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7900d1700 tx=0x7ff784008040 comp rx=0 tx=0).stop 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 msgr2=0x7ff7901f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7901f5d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff78c000c00 tx=0x7ff78c004750 comp rx=0 tx=0).stop 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 shutdown_connections 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff77406ace0 0x7ff77406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b60a0 0x7ff7901f5d70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff79015e170 0x7ff79006b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 --2- 172.21.15.43:0/3630751093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7900cf5b0 0x7ff7900acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 >> 172.21.15.43:0/3630751093 conn(0x7ff790069db0 msgr2=0x7ff7900b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:26.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 shutdown_connections 2023-06-08T03:49:26.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.271+0000 7ff797613700 1 -- 172.21.15.43:0/3630751093 wait complete. 2023-06-08T03:49:26.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.411+0000 7fcfba8af700 1 Processor -- start 2023-06-08T03:49:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.411+0000 7fcfba8af700 1 -- start start 2023-06-08T03:49:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfba8af700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cd300 0x7fcfb40ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfba8af700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40716e0 con 0x7fcfb41591d0 2023-06-08T03:49:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfba8af700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40ce7e0 con 0x7fcfb40cded0 2023-06-08T03:49:26.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfba8af700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4072280 con 0x7fcfb40cd300 2023-06-08T03:49:26.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb8e4c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcfb41591d0 0x7fcfb4071b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54032/0 (socket says 172.21.15.43:54032) 2023-06-08T03:49:26.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb8e4c700 1 -- 172.21.15.43:0/2569031892 learned_addr learned my addr 172.21.15.43:0/2569031892 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:26.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb37fe700 1 --2- 172.21.15.43:0/2569031892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cd300 0x7fcfb40ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341302863 0 0) 0x7fcfb40716e0 con 0x7fcfb41591d0 2023-06-08T03:49:26.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf9c0035b0 con 0x7fcfb41591d0 2023-06-08T03:49:26.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531025327 0 0) 0x7fcfb40ce7e0 con 0x7fcfb40cded0 2023-06-08T03:49:26.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb40716e0 con 0x7fcfb40cded0 2023-06-08T03:49:26.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb37fe700 1 -- 172.21.15.43:0/2569031892 >> v1:172.21.15.135:6789/0 conn(0x7fcfb40cded0 legacy=0x7fcfb415d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb37fe700 1 -- 172.21.15.43:0/2569031892 >> v1:172.21.15.43:6789/0 conn(0x7fcfb41591d0 legacy=0x7fcfb4071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb37fe700 1 -- 172.21.15.43:0/2569031892 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb406f6b0 con 0x7fcfb40cd300 2023-06-08T03:49:26.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.412+0000 7fcfb37fe700 1 --2- 172.21.15.43:0/2569031892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cd300 0x7fcfb40ce2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009870 tx=0x7fcfa8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899bd232839cf2cb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011830 con 0x7fcfb40cd300 2023-06-08T03:49:26.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8011990 con 0x7fcfb40cd300 2023-06-08T03:49:26.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/2569031892 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8011d00 con 0x7fcfb40cd300 2023-06-08T03:49:26.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 -- 172.21.15.43:0/2569031892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cd300 msgr2=0x7fcfb40ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 --2- 172.21.15.43:0/2569031892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cd300 0x7fcfb40ce2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009870 tx=0x7fcfa8009b80 comp rx=0 tx=0).stop 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 -- 172.21.15.43:0/2569031892 shutdown_connections 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 --2- 172.21.15.43:0/2569031892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cd300 0x7fcfb40ce2a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 -- 172.21.15.43:0/2569031892 >> 172.21.15.43:0/2569031892 conn(0x7fcfb406aec0 msgr2=0x7fcfb406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 -- 172.21.15.43:0/2569031892 shutdown_connections 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.413+0000 7fcfba8af700 1 -- 172.21.15.43:0/2569031892 wait complete. 2023-06-08T03:49:26.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.414+0000 7fcfba8af700 1 Processor -- start 2023-06-08T03:49:26.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 -- start start 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb40cd300 0x7fcfb41f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cded0 0x7fcfb40c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 0x7fcfb40cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41f3400 con 0x7fcfb41591d0 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40c7c10 con 0x7fcfb40cd300 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.415+0000 7fcfba8af700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41f2e40 con 0x7fcfb40cded0 2023-06-08T03:49:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 0x7fcfb40cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 0x7fcfb40cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59134/0 (socket says 172.21.15.43:59134) 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 -- 172.21.15.43:0/1844825480 learned_addr learned my addr 172.21.15.43:0/1844825480 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb37fe700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cded0 0x7fcfb40c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb40cd300 0x7fcfb41f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 -- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cded0 msgr2=0x7fcfb40c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cded0 0x7fcfb40c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 -- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb40cd300 msgr2=0x7fcfb41f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb40cd300 0x7fcfb41f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 -- 172.21.15.43:0/1844825480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80094a0 con 0x7fcfb41591d0 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb8e4c700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 0x7fcfb40cb2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00caf0 tx=0x7fcfac00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00aad0 con 0x7fcfb41591d0 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00ac30 con 0x7fcfb41591d0 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb41f3120 con 0x7fcfb41591d0 2023-06-08T03:49:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac012400 con 0x7fcfb41591d0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.416+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb41f2a10 con 0x7fcfb41591d0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.417+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb40c7d80 con 0x7fcfb41591d0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.418+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfac01b3b0 con 0x7fcfb41591d0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.418+0000 7fcfb0ff9700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa006ace0 0x7fcfa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.418+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfac089530 con 0x7fcfb41591d0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.419+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa006ace0 0x7fcfa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.419+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa006ace0 0x7fcfa006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40016f0 tx=0x7fcfa4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.423+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcfac0542e0 con 0x7fcfb41591d0 2023-06-08T03:49:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.619+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfb4073fa0 con 0x7fcfb41591d0 2023-06-08T03:49:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.620+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/1844825480 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfac057900 con 0x7fcfb41591d0 2023-06-08T03:49:26.624 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:26.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa006ace0 msgr2=0x7fcfa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa006ace0 0x7fcfa006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40016f0 tx=0x7fcfa4009040 comp rx=0 tx=0).stop 2023-06-08T03:49:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 msgr2=0x7fcfb40cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 0x7fcfb40cb2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00caf0 tx=0x7fcfac00ceb0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 shutdown_connections 2023-06-08T03:49:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcfa006ace0 0x7fcfa006d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb41591d0 0x7fcfb40cb2d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb40cd300 0x7fcfb41f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 --2- 172.21.15.43:0/1844825480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfb40cded0 0x7fcfb40c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 >> 172.21.15.43:0/1844825480 conn(0x7fcfb406aec0 msgr2=0x7fcfb406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 shutdown_connections 2023-06-08T03:49:26.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.622+0000 7fcfba8af700 1 -- 172.21.15.43:0/1844825480 wait complete. 2023-06-08T03:49:26.637 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.764+0000 7f0510848700 1 Processor -- start 2023-06-08T03:49:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.764+0000 7f0510848700 1 -- start start 2023-06-08T03:49:26.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f0510848700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f050c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f0510848700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f050c0ccb00 0x7f050c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f0510848700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c15c750 con 0x7f050c15fdf0 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f0510848700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c0ccfc0 con 0x7f050c0ccb00 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f0510848700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0b5240 con 0x7f050c0b43f0 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f050c15fdf0 0x7f050c160250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54046/0 (socket says 172.21.15.43:54046) 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050ad9d700 1 -- 172.21.15.43:0/430068683 learned_addr learned my addr 172.21.15.43:0/430068683 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f0509d9b700 1 --2- 172.21.15.43:0/430068683 >> v2:172.21.15.135:3300/0 conn(0x7f050c0ccb00 0x7f050c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050a59c700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f050c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036625136 0 0) 0x7f0504001490 con 0x7f050c15fdf0 2023-06-08T03:49:26.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f40035b0 con 0x7f050c15fdf0 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3604443992 0 0) 0x7f04f40035b0 con 0x7f050c15fdf0 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 msgr2=0x7f050c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f050c0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 >> v2:172.21.15.135:3300/0 conn(0x7f050c0ccb00 msgr2=0x7f050c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 --2- 172.21.15.43:0/430068683 >> v2:172.21.15.135:3300/0 conn(0x7f050c0ccb00 0x7f050c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0cf740 con 0x7f050c15fdf0 2023-06-08T03:49:26.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f0504001b80 con 0x7f050c15fdf0 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050a59c700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f050c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.765+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 >> v1:172.21.15.43:6789/0 conn(0x7f050c15fdf0 legacy=0x7f050c160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f04f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04f4004d90 0x7f04f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0ccfc0 con 0x7f04f4004d90 2023-06-08T03:49:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0b5240 con 0x7f04f4003a00 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400ba10 con 0x7f050c0b43f0 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f0509d9b700 1 --2- 172.21.15.43:0/430068683 >> v2:172.21.15.135:3300/0 conn(0x7f050c0ccb00 0x7f050c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04f4004d90 0x7f04f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050a59c700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f0509d9b700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f04f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 -- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 msgr2=0x7f04f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f050c0b43f0 0x7f04f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 -- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f4003a00 msgr2=0x7f04f4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 -- 172.21.15.43:0/430068683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0094a0 con 0x7f04f4004d90 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050a59c700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050ad9d700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04f4004d90 0x7f04f4005200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f050400a830 tx=0x7f04f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f625b7027390fcd8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504012600 con 0x7f04f4004d90 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504012780 con 0x7f04f4004d90 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.766+0000 7f050959a700 1 -- 172.21.15.43:0/430068683 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504012b30 con 0x7f04f4004d90 2023-06-08T03:49:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f0510848700 1 -- 172.21.15.43:0/430068683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04f4004d90 msgr2=0x7f04f4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f0510848700 1 --2- 172.21.15.43:0/430068683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04f4004d90 0x7f04f4005200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f050400a830 tx=0x7f04f4005880 comp rx=0 tx=0).stop 2023-06-08T03:49:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f050ad9d700 1 -- 172.21.15.43:0/430068683 reap_dead start 2023-06-08T03:49:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f0510848700 1 -- 172.21.15.43:0/430068683 shutdown_connections 2023-06-08T03:49:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f0510848700 1 -- 172.21.15.43:0/430068683 >> 172.21.15.43:0/430068683 conn(0x7f050c072120 msgr2=0x7f050c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f0510848700 1 -- 172.21.15.43:0/430068683 shutdown_connections 2023-06-08T03:49:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.767+0000 7f0510848700 1 -- 172.21.15.43:0/430068683 wait complete. 2023-06-08T03:49:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.768+0000 7f0510848700 1 Processor -- start 2023-06-08T03:49:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.768+0000 7f0510848700 1 -- start start 2023-06-08T03:49:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0510848700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04f4004d90 0x7f050c0d3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0510848700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 0x7f050c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0510848700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f050c0c7a80 0x7f050c1f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0510848700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c7f00 con 0x7f050c1f2bc0 2023-06-08T03:49:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0510848700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1f2730 con 0x7f050c0c7a80 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0510848700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0d3840 con 0x7f04f4004d90 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 0x7f050c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 0x7f050c0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59152/0 (socket says 172.21.15.43:59152) 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 -- 172.21.15.43:0/2637443620 learned_addr learned my addr 172.21.15.43:0/2637443620 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f050a59c700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04f4004d90 0x7f050c0d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f050ad9d700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f050c0c7a80 0x7f050c1f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 -- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04f4004d90 msgr2=0x7f050c0d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04f4004d90 0x7f050c0d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 -- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f050c0c7a80 msgr2=0x7f050c1f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f050c0c7a80 0x7f050c1f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f0509d9b700 1 -- 172.21.15.43:0/2637443620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c1f1e30 con 0x7f050c1f2bc0 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.769+0000 7f050a59c700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04f4004d90 0x7f050c0d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.770+0000 7f0509d9b700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 0x7f050c0c7540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0500011900 tx=0x7f0500011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.770+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500009780 con 0x7f050c1f2bc0 2023-06-08T03:49:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.770+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000fae0 con 0x7f050c1f2bc0 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.770+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000fe70 con 0x7f050c1f2bc0 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.770+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c1f6140 con 0x7f050c1f2bc0 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.770+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c1f23c0 con 0x7f050c1f2bc0 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.771+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c073fa0 con 0x7f050c1f2bc0 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.771+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0500015460 con 0x7f050c1f2bc0 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.772+0000 7f04faffd700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.772+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f050008a0e0 con 0x7f050c1f2bc0 2023-06-08T03:49:26.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.772+0000 7f050a59c700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:26.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.773+0000 7f050a59c700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f04ec06ace0 0x7f04ec06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f050c0670f0 tx=0x7f04fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:26.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.776+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0500058930 con 0x7f050c1f2bc0 2023-06-08T03:49:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.973+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f050c1f2870 con 0x7f050c1f2bc0 2023-06-08T03:49:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.973+0000 7f04faffd700 1 -- 172.21.15.43:0/2637443620 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0500011ea0 con 0x7f050c1f2bc0 2023-06-08T03:49:26.977 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f04ec06ace0 msgr2=0x7f04ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f04ec06ace0 0x7f04ec06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f050c0670f0 tx=0x7f04fc008040 comp rx=0 tx=0).stop 2023-06-08T03:49:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 msgr2=0x7f050c0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 0x7f050c0c7540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0500011900 tx=0x7f0500011cc0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 shutdown_connections 2023-06-08T03:49:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f050c0c7a80 0x7f050c1f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04f4004d90 0x7f050c0d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 --2- 172.21.15.43:0/2637443620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f050c1f2bc0 0x7f050c0c7540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 >> 172.21.15.43:0/2637443620 conn(0x7f050c072120 msgr2=0x7f050c0b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 shutdown_connections 2023-06-08T03:49:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:26.975+0000 7f0510848700 1 -- 172.21.15.43:0/2637443620 wait complete. 2023-06-08T03:49:26.991 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.116+0000 7f7344160700 1 Processor -- start 2023-06-08T03:49:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.116+0000 7f7344160700 1 -- start start 2023-06-08T03:49:27.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7344160700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 0x7f733c15d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7344160700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f733c1591d0 0x7f733c071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7344160700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733c0716e0 con 0x7f733c0cd300 2023-06-08T03:49:27.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7344160700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c06f4a0 con 0x7f733c1591d0 2023-06-08T03:49:27.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7344160700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c15dad0 con 0x7f733c0cded0 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f73416fb700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f733c0cd300 0x7f733c0ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54062/0 (socket says 172.21.15.43:54062) 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f73416fb700 1 -- 172.21.15.43:0/1186716748 learned_addr learned my addr 172.21.15.43:0/1186716748 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f73426fd700 1 --2- 172.21.15.43:0/1186716748 >> v2:172.21.15.135:3300/0 conn(0x7f733c1591d0 0x7f733c071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7341efc700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 0x7f733c15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59550891 0 0) 0x7f733c0716e0 con 0x7f733c0cd300 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73280035b0 con 0x7f733c0cd300 2023-06-08T03:49:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 514445156 0 0) 0x7f73280035b0 con 0x7f733c0cd300 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 msgr2=0x7f733c15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 0x7f733c15d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 >> v2:172.21.15.135:3300/0 conn(0x7f733c1591d0 msgr2=0x7f733c071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 --2- 172.21.15.43:0/1186716748 >> v2:172.21.15.135:3300/0 conn(0x7f733c1591d0 0x7f733c071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c06f6b0 con 0x7f733c0cd300 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.117+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f732c001670 con 0x7f733c0cd300 2023-06-08T03:49:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 >> v1:172.21.15.43:6789/0 conn(0x7f733c0cd300 legacy=0x7f733c0ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7328003a00 0x7f7328003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 0x7f7328004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7328004d90 0x7f7328005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c06f4a0 con 0x7f7328004d90 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c15dad0 con 0x7f7328003a00 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732800ba10 con 0x7f733c0cded0 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7328004d90 0x7f7328005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7341efc700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7328003a00 0x7f7328003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73416fb700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 0x7f7328004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 -- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 msgr2=0x7f7328004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0cded0 0x7f7328004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 -- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7328003a00 msgr2=0x7f7328003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7328003a00 0x7f7328003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 -- 172.21.15.43:0/1186716748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280035b0 con 0x7f7328004d90 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f73426fd700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7328004d90 0x7f7328005200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7334010480 tx=0x7f7328005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b967261160ee01 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334012430 con 0x7f7328004d90 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334012590 con 0x7f7328004d90 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.118+0000 7f7340efa700 1 -- 172.21.15.43:0/1186716748 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334012920 con 0x7f7328004d90 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f7344160700 1 -- 172.21.15.43:0/1186716748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7328004d90 msgr2=0x7f7328005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f7344160700 1 --2- 172.21.15.43:0/1186716748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7328004d90 0x7f7328005200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7334010480 tx=0x7f7328005880 comp rx=0 tx=0).stop 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f73426fd700 1 -- 172.21.15.43:0/1186716748 reap_dead start 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f7344160700 1 -- 172.21.15.43:0/1186716748 shutdown_connections 2023-06-08T03:49:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f7344160700 1 -- 172.21.15.43:0/1186716748 >> 172.21.15.43:0/1186716748 conn(0x7f733c06aec0 msgr2=0x7f733c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:27.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f7344160700 1 -- 172.21.15.43:0/1186716748 shutdown_connections 2023-06-08T03:49:27.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.119+0000 7f7344160700 1 -- 172.21.15.43:0/1186716748 wait complete. 2023-06-08T03:49:27.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.120+0000 7f7344160700 1 Processor -- start 2023-06-08T03:49:27.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.120+0000 7f7344160700 1 -- start start 2023-06-08T03:49:27.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7344160700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733c14aa30 0x7f733c0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7344160700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 0x7f733c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7344160700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0c88d0 0x7f733c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7344160700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c3e30 con 0x7f733c14ae00 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7344160700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c3220 con 0x7f733c14aa30 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7344160700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c3500 con 0x7f733c0c88d0 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 0x7f733c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 0x7f733c0cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59170/0 (socket says 172.21.15.43:59170) 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 -- 172.21.15.43:0/843321610 learned_addr learned my addr 172.21.15.43:0/843321610 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73426fd700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0c88d0 0x7f733c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f7341efc700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733c14aa30 0x7f733c0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 -- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0c88d0 msgr2=0x7f733c0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0c88d0 0x7f733c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 -- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733c14aa30 msgr2=0x7f733c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733c14aa30 0x7f733c0cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.121+0000 7f73416fb700 1 -- 172.21.15.43:0/843321610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0c37e0 con 0x7f733c14ae00 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.122+0000 7f73416fb700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 0x7f733c0cf7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f732c0017a0 tx=0x7f732c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.122+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00f8d0 con 0x7f733c14ae00 2023-06-08T03:49:27.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.122+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c00fa30 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.122+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c0c3ac0 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.122+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00fde0 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.122+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c0c9460 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.123+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c0c3fa0 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.123+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f732c01d460 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.124+0000 7f73327fc700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f732006ace0 0x7f732006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.124+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f732c0896d0 con 0x7f733c14ae00 2023-06-08T03:49:27.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.124+0000 7f7341efc700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f732006ace0 0x7f732006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.124+0000 7f7341efc700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f732006ace0 0x7f732006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7338009a20 tx=0x7f7338008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.128+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f732c054520 con 0x7f733c14ae00 2023-06-08T03:49:27.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.324+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f733c0c9460 con 0x7f733c14ae00 2023-06-08T03:49:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.325+0000 7f73327fc700 1 -- 172.21.15.43:0/843321610 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f733c0c9460 con 0x7f733c14ae00 2023-06-08T03:49:27.328 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f732006ace0 msgr2=0x7f732006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f732006ace0 0x7f732006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7338009a20 tx=0x7f7338008040 comp rx=0 tx=0).stop 2023-06-08T03:49:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 msgr2=0x7f733c0cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 0x7f733c0cf7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f732c0017a0 tx=0x7f732c007720 comp rx=0 tx=0).stop 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 shutdown_connections 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f732006ace0 0x7f732006d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733c0c88d0 0x7f733c0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733c14aa30 0x7f733c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 --2- 172.21.15.43:0/843321610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f733c14ae00 0x7f733c0cf7a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 >> 172.21.15.43:0/843321610 conn(0x7f733c06aec0 msgr2=0x7f733c0b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 shutdown_connections 2023-06-08T03:49:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.327+0000 7f7344160700 1 -- 172.21.15.43:0/843321610 wait complete. 2023-06-08T03:49:27.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:27.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.467+0000 7f414b2e1700 1 Processor -- start 2023-06-08T03:49:27.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.467+0000 7f414b2e1700 1 -- start start 2023-06-08T03:49:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414b2e1700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41440cd930 0x7f41440716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414b2e1700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414406f480 con 0x7f41440b1dc0 2023-06-08T03:49:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414b2e1700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414406f760 con 0x7f4144159380 2023-06-08T03:49:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414b2e1700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41440b10d0 con 0x7f41440cd930 2023-06-08T03:49:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414987e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f41440b1dc0 0x7f41440ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54084/0 (socket says 172.21.15.43:54084) 2023-06-08T03:49:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414987e700 1 -- 172.21.15.43:0/135410544 learned_addr learned my addr 172.21.15.43:0/135410544 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f414887c700 1 --2- 172.21.15.43:0/135410544 >> v2:172.21.15.135:3300/0 conn(0x7f41440cd930 0x7f41440716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f413bfff700 1 -- 172.21.15.43:0/135410544 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745667494 0 0) 0x7f414406f480 con 0x7f41440b1dc0 2023-06-08T03:49:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.468+0000 7f413bfff700 1 -- 172.21.15.43:0/135410544 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41300035b0 con 0x7f41440b1dc0 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f414887c700 1 -- 172.21.15.43:0/135410544 >> v1:172.21.15.135:6789/0 conn(0x7f4144159380 legacy=0x7f41440cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f414887c700 1 -- 172.21.15.43:0/135410544 >> v1:172.21.15.43:6789/0 conn(0x7f41440b1dc0 legacy=0x7f41440ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f414887c700 1 -- 172.21.15.43:0/135410544 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440b12e0 con 0x7f41440cd930 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f414887c700 1 --2- 172.21.15.43:0/135410544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440cd930 0x7f41440716c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4140009840 tx=0x7f4140009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9138bffe84a91b92 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f413bfff700 1 -- 172.21.15.43:0/135410544 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140011830 con 0x7f41440cd930 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f413bfff700 1 -- 172.21.15.43:0/135410544 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140011990 con 0x7f41440cd930 2023-06-08T03:49:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f413bfff700 1 -- 172.21.15.43:0/135410544 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140011d20 con 0x7f41440cd930 2023-06-08T03:49:27.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f414b2e1700 1 -- 172.21.15.43:0/135410544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440cd930 msgr2=0x7f41440716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.469+0000 7f414b2e1700 1 --2- 172.21.15.43:0/135410544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440cd930 0x7f41440716c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4140009840 tx=0x7f4140009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.470+0000 7f414b2e1700 1 -- 172.21.15.43:0/135410544 shutdown_connections 2023-06-08T03:49:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.470+0000 7f414b2e1700 1 --2- 172.21.15.43:0/135410544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440cd930 0x7f41440716c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.470+0000 7f414b2e1700 1 -- 172.21.15.43:0/135410544 >> 172.21.15.43:0/135410544 conn(0x7f414406aec0 msgr2=0x7f414406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.470+0000 7f414b2e1700 1 -- 172.21.15.43:0/135410544 shutdown_connections 2023-06-08T03:49:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.470+0000 7f414b2e1700 1 -- 172.21.15.43:0/135410544 wait complete. 2023-06-08T03:49:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.471+0000 7f414b2e1700 1 Processor -- start 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.471+0000 7f414b2e1700 1 -- start start 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414b2e1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440b1dc0 0x7f41440cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414b2e1700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41440cd930 0x7f41440c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414b2e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 0x7f41441529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414b2e1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440c6c60 con 0x7f4144159380 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414b2e1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440c7ad0 con 0x7f41440b1dc0 2023-06-08T03:49:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414b2e1700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440c6e50 con 0x7f41440cd930 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414987e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 0x7f41441529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414987e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 0x7f41441529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59186/0 (socket says 172.21.15.43:59186) 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.472+0000 7f414987e700 1 -- 172.21.15.43:0/4138795478 learned_addr learned my addr 172.21.15.43:0/4138795478 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414907d700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440b1dc0 0x7f41440cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414887c700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41440cd930 0x7f41440c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414987e700 1 -- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41440cd930 msgr2=0x7f41440c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414987e700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41440cd930 0x7f41440c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414987e700 1 -- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440b1dc0 msgr2=0x7f41440cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414987e700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440b1dc0 0x7f41440cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414987e700 1 -- 172.21.15.43:0/4138795478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400094a0 con 0x7f4144159380 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414987e700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 0x7f41441529f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f413c00cb40 tx=0x7f413c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00ab50 con 0x7f4144159380 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c00acb0 con 0x7f4144159380 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c012620 con 0x7f4144159380 2023-06-08T03:49:27.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41440c7130 con 0x7f4144159380 2023-06-08T03:49:27.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.473+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41440c76f0 con 0x7f4144159380 2023-06-08T03:49:27.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.474+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4144073fa0 con 0x7f4144159380 2023-06-08T03:49:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.474+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f413c01b3b0 con 0x7f4144159380 2023-06-08T03:49:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.475+0000 7f4139ffb700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f412806ace0 0x7f412806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.475+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f413c0896d0 con 0x7f4144159380 2023-06-08T03:49:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.475+0000 7f414907d700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f412806ace0 0x7f412806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.476+0000 7f414907d700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f412806ace0 0x7f412806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4134000f60 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.479+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f413c054380 con 0x7f4144159380 2023-06-08T03:49:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.675+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41440714a0 con 0x7f4144159380 2023-06-08T03:49:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.675+0000 7f4139ffb700 1 -- 172.21.15.43:0/4138795478 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f413c0579a0 con 0x7f4144159380 2023-06-08T03:49:27.679 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:27.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f412806ace0 msgr2=0x7f412806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f412806ace0 0x7f412806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4134000f60 tx=0x7f4134009040 comp rx=0 tx=0).stop 2023-06-08T03:49:27.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 msgr2=0x7f41441529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 0x7f41441529f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f413c00cb40 tx=0x7f413c00cf00 comp rx=0 tx=0).stop 2023-06-08T03:49:27.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 shutdown_connections 2023-06-08T03:49:27.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f412806ace0 0x7f412806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4144159380 0x7f41441529f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41440b1dc0 0x7f41440cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 --2- 172.21.15.43:0/4138795478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41440cd930 0x7f41440c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 >> 172.21.15.43:0/4138795478 conn(0x7f414406aec0 msgr2=0x7f41441544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:27.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 shutdown_connections 2023-06-08T03:49:27.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.677+0000 7f414b2e1700 1 -- 172.21.15.43:0/4138795478 wait complete. 2023-06-08T03:49:27.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:27.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.814+0000 7f093781d700 1 Processor -- start 2023-06-08T03:49:27.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f093781d700 1 -- start start 2023-06-08T03:49:27.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f093781d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0930158e00 0x7f09300cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f093781d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09300cc7d0 0x7f093015c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f093781d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09300ce770 con 0x7f09300ce1f0 2023-06-08T03:49:27.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f093781d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300ca4a0 con 0x7f0930158e00 2023-06-08T03:49:27.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f093781d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0930071180 con 0x7f09300cc7d0 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.815+0000 7f09355b9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0930158e00 0x7f09300cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0930158e00 0x7f09300cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59190/0 (socket says 172.21.15.43:59190) 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 -- 172.21.15.43:0/3572582119 learned_addr learned my addr 172.21.15.43:0/3572582119 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f0935dba700 1 --2- 172.21.15.43:0/3572582119 >> v2:172.21.15.135:3300/0 conn(0x7f09300cc7d0 0x7f093015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 -- 172.21.15.43:0/3572582119 >> v2:172.21.15.135:3300/0 conn(0x7f09300cc7d0 msgr2=0x7f093015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 --2- 172.21.15.43:0/3572582119 >> v2:172.21.15.135:3300/0 conn(0x7f09300cc7d0 0x7f093015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 -- 172.21.15.43:0/3572582119 >> v1:172.21.15.135:6789/0 conn(0x7f09300ce1f0 legacy=0x7f09300cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 -- 172.21.15.43:0/3572582119 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930071460 con 0x7f0930158e00 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f09355b9700 1 --2- 172.21.15.43:0/3572582119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0930158e00 0x7f09300cdcb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0930071110 tx=0x7f092c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739c918c09be754d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f0923fff700 1 -- 172.21.15.43:0/3572582119 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c004230 con 0x7f0930158e00 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f0923fff700 1 -- 172.21.15.43:0/3572582119 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c004390 con 0x7f0930158e00 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.816+0000 7f0923fff700 1 -- 172.21.15.43:0/3572582119 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c0036a0 con 0x7f0930158e00 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 -- 172.21.15.43:0/3572582119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0930158e00 msgr2=0x7f09300cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 --2- 172.21.15.43:0/3572582119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0930158e00 0x7f09300cdcb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0930071110 tx=0x7f092c009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 -- 172.21.15.43:0/3572582119 shutdown_connections 2023-06-08T03:49:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 --2- 172.21.15.43:0/3572582119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0930158e00 0x7f09300cdcb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 --2- 172.21.15.43:0/3572582119 >> v2:172.21.15.135:3300/0 conn(0x7f09300cc7d0 0x7f093015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 -- 172.21.15.43:0/3572582119 >> 172.21.15.43:0/3572582119 conn(0x7f093006d180 msgr2=0x7f093006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 -- 172.21.15.43:0/3572582119 shutdown_connections 2023-06-08T03:49:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.817+0000 7f093781d700 1 -- 172.21.15.43:0/3572582119 wait complete. 2023-06-08T03:49:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.818+0000 7f093781d700 1 Processor -- start 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.818+0000 7f093781d700 1 -- start start 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f093781d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 0x7f09301489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f093781d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09300ce1f0 0x7f09300af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f093781d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0930158e00 0x7f093015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f093781d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0930148ef0 con 0x7f09300cc7d0 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f093781d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09300af9f0 con 0x7f09300ce1f0 2023-06-08T03:49:27.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f093781d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09300afcd0 con 0x7f0930158e00 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 0x7f09301489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 0x7f09301489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59196/0 (socket says 172.21.15.43:59196) 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 -- 172.21.15.43:0/3381291915 learned_addr learned my addr 172.21.15.43:0/3381291915 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f0934db8700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09300ce1f0 0x7f09300af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f0935dba700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0930158e00 0x7f093015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 -- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0930158e00 msgr2=0x7f093015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0930158e00 0x7f093015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 -- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09300ce1f0 msgr2=0x7f09300af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09300ce1f0 0x7f09300af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 -- 172.21.15.43:0/3381291915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c009550 con 0x7f09300cc7d0 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.819+0000 7f09355b9700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 0x7f09301489b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f092c009130 tx=0x7f092c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.820+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c003d40 con 0x7f09300cc7d0 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.820+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c020070 con 0x7f09300cc7d0 2023-06-08T03:49:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.820+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09300affb0 con 0x7f09300cc7d0 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.820+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c003ea0 con 0x7f09300cc7d0 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.820+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09300b0570 con 0x7f09300cc7d0 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.821+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093006edb0 con 0x7f09300cc7d0 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.821+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f092c022030 con 0x7f09300cc7d0 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.822+0000 7f0921ffb700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f091406ad10 0x7f091406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.822+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f092c08ca20 con 0x7f09300cc7d0 2023-06-08T03:49:27.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.822+0000 7f0934db8700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f091406ad10 0x7f091406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.823+0000 7f0934db8700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f091406ad10 0x7f091406d1c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f09300c2ce0 tx=0x7f0924009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:27.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:27.826+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f092c0577d0 con 0x7f09300cc7d0 2023-06-08T03:49:28.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.024+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0930073fa0 con 0x7f09300cc7d0 2023-06-08T03:49:28.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.025+0000 7f0921ffb700 1 -- 172.21.15.43:0/3381291915 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f092c072e60 con 0x7f09300cc7d0 2023-06-08T03:49:28.029 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:28.029 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:28.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f091406ad10 msgr2=0x7f091406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f091406ad10 0x7f091406d1c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f09300c2ce0 tx=0x7f0924009040 comp rx=0 tx=0).stop 2023-06-08T03:49:28.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 msgr2=0x7f09301489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 0x7f09301489b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f092c009130 tx=0x7f092c004750 comp rx=0 tx=0).stop 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 shutdown_connections 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f091406ad10 0x7f091406d1c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09300cc7d0 0x7f09301489b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0930158e00 0x7f093015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 --2- 172.21.15.43:0/3381291915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09300ce1f0 0x7f09300af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 >> 172.21.15.43:0/3381291915 conn(0x7f093006d180 msgr2=0x7f09300c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:28.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 shutdown_connections 2023-06-08T03:49:28.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.028+0000 7f093781d700 1 -- 172.21.15.43:0/3381291915 wait complete. 2023-06-08T03:49:28.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:28.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.168+0000 7f37cfc32700 1 Processor -- start 2023-06-08T03:49:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.168+0000 7f37cfc32700 1 -- start start 2023-06-08T03:49:28.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cfc32700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 0x7f37c80cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cfc32700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c80cd990 con 0x7f37c8070d50 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cfc32700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c80cdc70 con 0x7f37c8069db0 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cfc32700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8070550 con 0x7f37c80c9500 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37ce1cf700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f37c8070d50 0x7f37c80711d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54112/0 (socket says 172.21.15.43:54112) 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37ce1cf700 1 -- 172.21.15.43:0/1596471710 learned_addr learned my addr 172.21.15.43:0/1596471710 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849144037 0 0) 0x7f37c80cd990 con 0x7f37c8070d50 2023-06-08T03:49:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cd1cd700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 0x7f37c80cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b40046c0 con 0x7f37c8070d50 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138692519 0 0) 0x7f37b40046c0 con 0x7f37c8070d50 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 msgr2=0x7f37c80cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 0x7f37c80cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 >> v1:172.21.15.135:6789/0 conn(0x7f37c8069db0 legacy=0x7f37c806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8070830 con 0x7f37c8070d50 2023-06-08T03:49:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f37c00019f0 con 0x7f37c8070d50 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 >> v1:172.21.15.43:6789/0 conn(0x7f37c8070d50 legacy=0x7f37c80711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37b4004b40 0x7f37b4004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 0x7f37b4005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37b4005ea0 0x7f37b4006310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8070550 con 0x7f37b4004b40 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.169+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b400cbd0 con 0x7f37b4005ea0 2023-06-08T03:49:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b400cd60 con 0x7f37c80c9500 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37b4004b40 0x7f37b4004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd1cd700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 0x7f37b4005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37ce1cf700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37b4005ea0 0x7f37b4006310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 -- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 msgr2=0x7f37b4005960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80c9500 0x7f37b4005960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 -- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37b4005ea0 msgr2=0x7f37b4006310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37b4005ea0 0x7f37b4006310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 -- 172.21.15.43:0/1596471710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40046c0 con 0x7f37b4004b40 2023-06-08T03:49:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37b4004b40 0x7f37b4004f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37c40017c0 tx=0x7f37b4006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f7bf77d899cfe6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40052d0 con 0x7f37b4004b40 2023-06-08T03:49:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c4005430 con 0x7f37b4004b40 2023-06-08T03:49:28.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.170+0000 7f37cc9cc700 1 -- 172.21.15.43:0/1596471710 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40038c0 con 0x7f37b4004b40 2023-06-08T03:49:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37cfc32700 1 -- 172.21.15.43:0/1596471710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37b4004b40 msgr2=0x7f37b4004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37cfc32700 1 --2- 172.21.15.43:0/1596471710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37b4004b40 0x7f37b4004f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37c40017c0 tx=0x7f37b4006990 comp rx=0 tx=0).stop 2023-06-08T03:49:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37ce1cf700 1 -- 172.21.15.43:0/1596471710 reap_dead start 2023-06-08T03:49:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37cfc32700 1 -- 172.21.15.43:0/1596471710 shutdown_connections 2023-06-08T03:49:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37cfc32700 1 -- 172.21.15.43:0/1596471710 >> 172.21.15.43:0/1596471710 conn(0x7f37c80cf220 msgr2=0x7f37c80cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:28.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37cfc32700 1 -- 172.21.15.43:0/1596471710 shutdown_connections 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.171+0000 7f37cfc32700 1 -- 172.21.15.43:0/1596471710 wait complete. 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.173+0000 7f37cfc32700 1 Processor -- start 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.173+0000 7f37cfc32700 1 -- start start 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37b4004b40 0x7f37c80acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 0x7f37c80c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c81f1830 0x7f37c80c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80c5600 con 0x7f37c814ffe0 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80c64d0 con 0x7f37c81f1830 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80c5850 con 0x7f37b4004b40 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 0x7f37c80c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 0x7f37c80c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59218/0 (socket says 172.21.15.43:59218) 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 -- 172.21.15.43:0/496779844 learned_addr learned my addr 172.21.15.43:0/496779844 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37ce1cf700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c81f1830 0x7f37c80c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37b4004b40 0x7f37c80acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 -- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37b4004b40 msgr2=0x7f37c80acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37b4004b40 0x7f37c80acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 -- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c81f1830 msgr2=0x7f37c80c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c81f1830 0x7f37c80c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 -- 172.21.15.43:0/496779844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c80c5b30 con 0x7f37c814ffe0 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37ce1cf700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c81f1830 0x7f37c80c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:28.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cd1cd700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 0x7f37c80c5f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37b8011aa0 tx=0x7f37b8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800f980 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b800fae0 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800fe90 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c80ac300 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.174+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c80ac8c0 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.175+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c8073fa0 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.176+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37b8014440 con 0x7f37c814ffe0 2023-06-08T03:49:28.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.176+0000 7f37be7fc700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f37ac06ace0 0x7f37ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.176+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37b8089df0 con 0x7f37c814ffe0 2023-06-08T03:49:28.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.176+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f37ac06ace0 0x7f37ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.177+0000 7f37cd9ce700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f37ac06ace0 0x7f37ac06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37c4000c00 tx=0x7f37c4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.181+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37b8054d00 con 0x7f37c814ffe0 2023-06-08T03:49:28.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.376+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37c80b44f0 con 0x7f37c814ffe0 2023-06-08T03:49:28.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.377+0000 7f37be7fc700 1 -- 172.21.15.43:0/496779844 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37b80220a0 con 0x7f37c814ffe0 2023-06-08T03:49:28.381 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:28.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f37ac06ace0 msgr2=0x7f37ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f37ac06ace0 0x7f37ac06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37c4000c00 tx=0x7f37c4009030 comp rx=0 tx=0).stop 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 msgr2=0x7f37c80c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 0x7f37c80c5f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f37b8011aa0 tx=0x7f37b8011e60 comp rx=0 tx=0).stop 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 shutdown_connections 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f37ac06ace0 0x7f37ac06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c81f1830 0x7f37c80c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37b4004b40 0x7f37c80acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 --2- 172.21.15.43:0/496779844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c814ffe0 0x7f37c80c5f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 >> 172.21.15.43:0/496779844 conn(0x7f37c80cf220 msgr2=0x7f37c80cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:28.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 shutdown_connections 2023-06-08T03:49:28.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.379+0000 7f37cfc32700 1 -- 172.21.15.43:0/496779844 wait complete. 2023-06-08T03:49:28.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:28.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.519+0000 7fce12bd5700 1 Processor -- start 2023-06-08T03:49:28.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.519+0000 7fce12bd5700 1 -- start start 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce12bd5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce12bd5700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fce0c0ce310 0x7fce0c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce12bd5700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c0d0d30 con 0x7fce0c15c270 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce12bd5700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c06aec0 con 0x7fce0c0ce310 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce12bd5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0d1520 con 0x7fce0c0cd840 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce11172700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fce0c0ce310 0x7fce0c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce10971700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fce0c15c270 0x7fce0c0cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54128/0 (socket says 172.21.15.43:54128) 2023-06-08T03:49:28.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce10971700 1 -- 172.21.15.43:0/4266401645 learned_addr learned my addr 172.21.15.43:0/4266401645 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:28.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce0bfff700 1 --2- 172.21.15.43:0/4266401645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce11172700 1 -- 172.21.15.43:0/4266401645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 msgr2=0x7fce0c0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce11172700 1 --2- 172.21.15.43:0/4266401645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c0d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce11172700 1 -- 172.21.15.43:0/4266401645 >> v1:172.21.15.43:6789/0 conn(0x7fce0c15c270 legacy=0x7fce0c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce11172700 1 -- 172.21.15.43:0/4266401645 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0cb1a0 con 0x7fce0c0ce310 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce0b7fe700 1 -- 172.21.15.43:0/4266401645 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938424043 0 0) 0x7fce0c0d0d30 con 0x7fce0c15c270 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce11172700 1 --2- 172.21.15.43:0/4266401645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c0ce310 0x7fce0c0cb630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fce04009d90 tx=0x7fce0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1823e6355966b11 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.520+0000 7fce0b7fe700 1 -- 172.21.15.43:0/4266401645 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400e070 con 0x7fce0c0ce310 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce0b7fe700 1 -- 172.21.15.43:0/4266401645 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400bbd0 con 0x7fce0c0ce310 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce0b7fe700 1 -- 172.21.15.43:0/4266401645 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04012430 con 0x7fce0c0ce310 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 -- 172.21.15.43:0/4266401645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c0ce310 msgr2=0x7fce0c0cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 --2- 172.21.15.43:0/4266401645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c0ce310 0x7fce0c0cb630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fce04009d90 tx=0x7fce0400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 -- 172.21.15.43:0/4266401645 shutdown_connections 2023-06-08T03:49:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 --2- 172.21.15.43:0/4266401645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c0ce310 0x7fce0c0cb630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 --2- 172.21.15.43:0/4266401645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c0d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 -- 172.21.15.43:0/4266401645 >> 172.21.15.43:0/4266401645 conn(0x7fce0c069db0 msgr2=0x7fce0c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 -- 172.21.15.43:0/4266401645 shutdown_connections 2023-06-08T03:49:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.521+0000 7fce12bd5700 1 -- 172.21.15.43:0/4266401645 wait complete. 2023-06-08T03:49:28.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.522+0000 7fce12bd5700 1 Processor -- start 2023-06-08T03:49:28.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.522+0000 7fce12bd5700 1 -- start start 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce12bd5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce12bd5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0ce310 0x7fce0c15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce12bd5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 0x7fce0c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce12bd5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c15d510 con 0x7fce0c15c270 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce12bd5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c15c640 con 0x7fce0c0ce310 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce12bd5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c14d200 con 0x7fce0c0cd840 2023-06-08T03:49:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce11172700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 0x7fce0c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce11172700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 0x7fce0c15e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59232/0 (socket says 172.21.15.43:59232) 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.523+0000 7fce11172700 1 -- 172.21.15.43:0/1108919563 learned_addr learned my addr 172.21.15.43:0/1108919563 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce11172700 1 -- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 msgr2=0x7fce0c14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce0bfff700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0ce310 0x7fce0c15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce10971700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce11172700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c14ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce11172700 1 -- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0ce310 msgr2=0x7fce0c15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce11172700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0ce310 0x7fce0c15df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce11172700 1 -- 172.21.15.43:0/1108919563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009a70 con 0x7fce0c15c270 2023-06-08T03:49:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce11172700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 0x7fce0c15e440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce0c06f750 tx=0x7fce04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04012430 con 0x7fce0c15c270 2023-06-08T03:49:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce04020070 con 0x7fce0c15c270 2023-06-08T03:49:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04004280 con 0x7fce0c15c270 2023-06-08T03:49:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c15c890 con 0x7fce0c15c270 2023-06-08T03:49:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.524+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c15ce50 con 0x7fce0c15c270 2023-06-08T03:49:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.525+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c15d650 con 0x7fce0c15c270 2023-06-08T03:49:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.525+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce040043e0 con 0x7fce0c15c270 2023-06-08T03:49:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.526+0000 7fce097fa700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdf006ace0 0x7fcdf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.526+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce04022070 con 0x7fce0c15c270 2023-06-08T03:49:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.526+0000 7fce10971700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdf006ace0 0x7fcdf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.526+0000 7fce10971700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdf006ace0 0x7fcdf006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce00000f60 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.530+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce0c15d650 con 0x7fce0c15c270 2023-06-08T03:49:28.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.725+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce0c15d650 con 0x7fce0c15c270 2023-06-08T03:49:28.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.726+0000 7fce097fa700 1 -- 172.21.15.43:0/1108919563 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce0c15d650 con 0x7fce0c15c270 2023-06-08T03:49:28.729 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:28.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdf006ace0 msgr2=0x7fcdf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdf006ace0 0x7fcdf006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce00000f60 tx=0x7fce00009040 comp rx=0 tx=0).stop 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 msgr2=0x7fce0c15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 0x7fce0c15e440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce0c06f750 tx=0x7fce04004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 shutdown_connections 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcdf006ace0 0x7fcdf006d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0c15c270 0x7fce0c15e440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c0cd840 0x7fce0c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 --2- 172.21.15.43:0/1108919563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0ce310 0x7fce0c15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 >> 172.21.15.43:0/1108919563 conn(0x7fce0c069db0 msgr2=0x7fce0c06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:28.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 shutdown_connections 2023-06-08T03:49:28.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.728+0000 7fce12bd5700 1 -- 172.21.15.43:0/1108919563 wait complete. 2023-06-08T03:49:28.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:28.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.868+0000 7f804dcbc700 1 Processor -- start 2023-06-08T03:49:28.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.868+0000 7f804dcbc700 1 -- start start 2023-06-08T03:49:28.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f804dcbc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 0x7f80480cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f804dcbc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80480cf5b0 0x7f804815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f804dcbc700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80480cda20 con 0x7f804815e170 2023-06-08T03:49:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f804dcbc700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480b6470 con 0x7f80480cf5b0 2023-06-08T03:49:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f804dcbc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804815a520 con 0x7f80480b60a0 2023-06-08T03:49:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f8047fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f804815e170 0x7f80480ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54146/0 (socket says 172.21.15.43:54146) 2023-06-08T03:49:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.869+0000 7f8047fff700 1 -- 172.21.15.43:0/2766170494 learned_addr learned my addr 172.21.15.43:0/2766170494 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80477fe700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 0x7f80480cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8046ffd700 1 --2- 172.21.15.43:0/2766170494 >> v2:172.21.15.135:3300/0 conn(0x7f80480cf5b0 0x7f804815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476179316 0 0) 0x7f80480cda20 con 0x7f804815e170 2023-06-08T03:49:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80340035b0 con 0x7f804815e170 2023-06-08T03:49:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874720802 0 0) 0x7f80340035b0 con 0x7f804815e170 2023-06-08T03:49:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 msgr2=0x7f80480cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 0x7f80480cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 >> v2:172.21.15.135:3300/0 conn(0x7f80480cf5b0 msgr2=0x7f804815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 --2- 172.21.15.43:0/2766170494 >> v2:172.21.15.135:3300/0 conn(0x7f80480cf5b0 0x7f804815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804815ea40 con 0x7f804815e170 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f80400019f0 con 0x7f804815e170 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 >> v1:172.21.15.43:6789/0 conn(0x7f804815e170 legacy=0x7f80480ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 0x7f8034003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034003f80 0x7f8034004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034004d90 0x7f8034005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480b6470 con 0x7f8034004d90 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804815a520 con 0x7f8034003f80 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803400ba40 con 0x7f80480b60a0 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8047fff700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034004d90 0x7f8034005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8046ffd700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034003f80 0x7f8034004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f80477fe700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 0x7f8034003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8047fff700 1 -- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 msgr2=0x7f8034003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8047fff700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b60a0 0x7f8034003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8047fff700 1 -- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034003f80 msgr2=0x7f8034004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8047fff700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034003f80 0x7f8034004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.870+0000 7f8047fff700 1 -- 172.21.15.43:0/2766170494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340035b0 con 0x7f8034004d90 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f8047fff700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034004d90 0x7f8034005200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f804000a880 tx=0x7f8034005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda13c8f929ca574 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804000a370 con 0x7f8034004d90 2023-06-08T03:49:28.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8040012600 con 0x7f8034004d90 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f80467fc700 1 -- 172.21.15.43:0/2766170494 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400129b0 con 0x7f8034004d90 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f804dcbc700 1 -- 172.21.15.43:0/2766170494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034004d90 msgr2=0x7f8034005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f804dcbc700 1 --2- 172.21.15.43:0/2766170494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034004d90 0x7f8034005200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f804000a880 tx=0x7f8034005880 comp rx=0 tx=0).stop 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f8047fff700 1 -- 172.21.15.43:0/2766170494 reap_dead start 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f804dcbc700 1 -- 172.21.15.43:0/2766170494 shutdown_connections 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f804dcbc700 1 -- 172.21.15.43:0/2766170494 >> 172.21.15.43:0/2766170494 conn(0x7f8048069db0 msgr2=0x7f804806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:28.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f804dcbc700 1 -- 172.21.15.43:0/2766170494 shutdown_connections 2023-06-08T03:49:28.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.871+0000 7f804dcbc700 1 -- 172.21.15.43:0/2766170494 wait complete. 2023-06-08T03:49:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.873+0000 7f804dcbc700 1 Processor -- start 2023-06-08T03:49:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.873+0000 7f804dcbc700 1 -- start start 2023-06-08T03:49:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.873+0000 7f804dcbc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034004d90 0x7f80481ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f804dcbc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 0x7f80481f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f804dcbc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b0180 0x7f804806a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f804dcbc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80481ef7e0 con 0x7f804815d2e0 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f804dcbc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80481f22d0 con 0x7f8034004d90 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f804dcbc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80481f2570 con 0x7f80480b0180 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 0x7f80481f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 0x7f80481f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59252/0 (socket says 172.21.15.43:59252) 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 -- 172.21.15.43:0/1785916753 learned_addr learned my addr 172.21.15.43:0/1785916753 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f80477fe700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034004d90 0x7f80481ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8047fff700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b0180 0x7f804806a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 -- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b0180 msgr2=0x7f804806a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b0180 0x7f804806a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 -- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034004d90 msgr2=0x7f80481ef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034004d90 0x7f80481ef2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 -- 172.21.15.43:0/1785916753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80481f2850 con 0x7f804815d2e0 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f8046ffd700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 0x7f80481f1d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8030011aa0 tx=0x7f8030011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011ed0 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000f940 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000fcd0 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.874+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80481f2b30 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.875+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804815b3f0 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.875+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80480cd080 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.876+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8030014440 con 0x7f804815d2e0 2023-06-08T03:49:28.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.876+0000 7f803ffff700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f802806ace0 0x7f802806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:28.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.876+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8030089d80 con 0x7f804815d2e0 2023-06-08T03:49:28.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.876+0000 7f80477fe700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f802806ace0 0x7f802806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:28.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.877+0000 7f80477fe700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f802806ace0 0x7f802806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80480cab40 tx=0x7f8038009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:28.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:28.881+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f80480cd080 con 0x7f804815d2e0 2023-06-08T03:49:29.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.078+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80481f2d20 con 0x7f804815d2e0 2023-06-08T03:49:29.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.079+0000 7f803ffff700 1 -- 172.21.15.43:0/1785916753 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8030022020 con 0x7f804815d2e0 2023-06-08T03:49:29.082 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:29.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f802806ace0 msgr2=0x7f802806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f802806ace0 0x7f802806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80480cab40 tx=0x7f8038009210 comp rx=0 tx=0).stop 2023-06-08T03:49:29.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 msgr2=0x7f80481f1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 0x7f80481f1d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8030011aa0 tx=0x7f8030011db0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 shutdown_connections 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f802806ace0 0x7f802806d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80480b0180 0x7f804806a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8034004d90 0x7f80481ef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 --2- 172.21.15.43:0/1785916753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804815d2e0 0x7f80481f1d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 >> 172.21.15.43:0/1785916753 conn(0x7f8048069db0 msgr2=0x7f80480b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 shutdown_connections 2023-06-08T03:49:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.081+0000 7f804dcbc700 1 -- 172.21.15.43:0/1785916753 wait complete. 2023-06-08T03:49:29.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:29.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.221+0000 7fee7aae5700 1 Processor -- start 2023-06-08T03:49:29.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.221+0000 7fee7aae5700 1 -- start start 2023-06-08T03:49:29.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee7aae5700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fee7415c300 0x7fee74071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee7aae5700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fee7415c6d0 0x7fee740cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee7aae5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee74069db0 0x7fee7406a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee7aae5700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7406a770 con 0x7fee7415c6d0 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee7aae5700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee740b2090 con 0x7fee7415c300 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee7aae5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee740cd910 con 0x7fee74069db0 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fee7415c6d0 0x7fee740cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fee7415c6d0 0x7fee740cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59258/0 (socket says 172.21.15.43:59258) 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 -- 172.21.15.43:0/2651237104 learned_addr learned my addr 172.21.15.43:0/2651237104 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee78881700 1 --2- 172.21.15.43:0/2651237104 >> v2:172.21.15.135:3300/0 conn(0x7fee7415c300 0x7fee74071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee79082700 1 --2- 172.21.15.43:0/2651237104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee74069db0 0x7fee7406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 -- 172.21.15.43:0/2651237104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee74069db0 msgr2=0x7fee7406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 --2- 172.21.15.43:0/2651237104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee74069db0 0x7fee7406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 -- 172.21.15.43:0/2651237104 >> v2:172.21.15.135:3300/0 conn(0x7fee7415c300 msgr2=0x7fee74071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 --2- 172.21.15.43:0/2651237104 >> v2:172.21.15.135:3300/0 conn(0x7fee7415c300 0x7fee74071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.222+0000 7fee73fff700 1 -- 172.21.15.43:0/2651237104 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740b1db0 con 0x7fee7415c6d0 2023-06-08T03:49:29.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee73fff700 1 --2- 172.21.15.43:0/2651237104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7415c6d0 0x7fee740cedb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee740b1340 tx=0x7fee60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801be3dc4dabc08b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee737fe700 1 -- 172.21.15.43:0/2651237104 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000b870 con 0x7fee7415c6d0 2023-06-08T03:49:29.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee737fe700 1 -- 172.21.15.43:0/2651237104 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000b9d0 con 0x7fee7415c6d0 2023-06-08T03:49:29.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee737fe700 1 -- 172.21.15.43:0/2651237104 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000bd60 con 0x7fee7415c6d0 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 -- 172.21.15.43:0/2651237104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7415c6d0 msgr2=0x7fee740cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 --2- 172.21.15.43:0/2651237104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7415c6d0 0x7fee740cedb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee740b1340 tx=0x7fee60009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 -- 172.21.15.43:0/2651237104 shutdown_connections 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 --2- 172.21.15.43:0/2651237104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee74069db0 0x7fee7406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 --2- 172.21.15.43:0/2651237104 >> v2:172.21.15.135:3300/0 conn(0x7fee7415c300 0x7fee74071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 --2- 172.21.15.43:0/2651237104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7415c6d0 0x7fee740cedb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 -- 172.21.15.43:0/2651237104 >> 172.21.15.43:0/2651237104 conn(0x7fee7406aec0 msgr2=0x7fee7406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:29.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.223+0000 7fee7aae5700 1 -- 172.21.15.43:0/2651237104 shutdown_connections 2023-06-08T03:49:29.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.224+0000 7fee7aae5700 1 -- 172.21.15.43:0/2651237104 wait complete. 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.225+0000 7fee7aae5700 1 Processor -- start 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.225+0000 7fee7aae5700 1 -- start start 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 0x7fee741546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee7415c300 0x7fee740b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee7415c6d0 0x7fee7415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee741f28a0 con 0x7fee74069db0 2023-06-08T03:49:29.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee741f1cb0 con 0x7fee7415c6d0 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee741f1f70 con 0x7fee7415c300 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 0x7fee741546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 0x7fee741546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59262/0 (socket says 172.21.15.43:59262) 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 -- 172.21.15.43:0/3542735736 learned_addr learned my addr 172.21.15.43:0/3542735736 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee73fff700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee7415c300 0x7fee740b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee79082700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee7415c6d0 0x7fee7415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 -- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee7415c300 msgr2=0x7fee740b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee7415c300 0x7fee740b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 -- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee7415c6d0 msgr2=0x7fee7415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee7415c6d0 0x7fee7415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 -- 172.21.15.43:0/3542735736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009550 con 0x7fee74069db0 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee78881700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 0x7fee741546d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee6800e810 tx=0x7fee6800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800c070 con 0x7fee74069db0 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68013610 con 0x7fee74069db0 2023-06-08T03:49:29.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee741f2250 con 0x7fee74069db0 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee680139c0 con 0x7fee74069db0 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.226+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee74154c10 con 0x7fee74069db0 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.227+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee74073fa0 con 0x7fee74069db0 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.228+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee68013b20 con 0x7fee74069db0 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.228+0000 7fee717fa700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fee5806ace0 0x7fee5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.228+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee68089580 con 0x7fee74069db0 2023-06-08T03:49:29.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.228+0000 7fee73fff700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fee5806ace0 0x7fee5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.229+0000 7fee73fff700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fee5806ace0 0x7fee5806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee60014040 tx=0x7fee60008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.233+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fee68057d40 con 0x7fee74069db0 2023-06-08T03:49:29.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.426+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee7406a360 con 0x7fee74069db0 2023-06-08T03:49:29.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.427+0000 7fee717fa700 1 -- 172.21.15.43:0/3542735736 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee680578d0 con 0x7fee74069db0 2023-06-08T03:49:29.430 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:29.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.428+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fee5806ace0 msgr2=0x7fee5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.428+0000 7fee7aae5700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fee5806ace0 0x7fee5806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee60014040 tx=0x7fee60008030 comp rx=0 tx=0).stop 2023-06-08T03:49:29.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.428+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 msgr2=0x7fee741546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.428+0000 7fee7aae5700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 0x7fee741546d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee6800e810 tx=0x7fee6800eb20 comp rx=0 tx=0).stop 2023-06-08T03:49:29.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 shutdown_connections 2023-06-08T03:49:29.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fee5806ace0 0x7fee5806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74069db0 0x7fee741546d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee7415c6d0 0x7fee7415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 --2- 172.21.15.43:0/3542735736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee7415c300 0x7fee740b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 >> 172.21.15.43:0/3542735736 conn(0x7fee7406aec0 msgr2=0x7fee74155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 shutdown_connections 2023-06-08T03:49:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.429+0000 7fee7aae5700 1 -- 172.21.15.43:0/3542735736 wait complete. 2023-06-08T03:49:29.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:29.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.568+0000 7fc1d4112700 1 Processor -- start 2023-06-08T03:49:29.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.568+0000 7fc1d4112700 1 -- start start 2023-06-08T03:49:29.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d4112700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 0x7fc1cc15e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d4112700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0cda20 con 0x7fc1cc0b60a0 2023-06-08T03:49:29.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d4112700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc15a520 con 0x7fc1cc0cf5b0 2023-06-08T03:49:29.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d4112700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b6470 con 0x7fc1cc0cad90 2023-06-08T03:49:29.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d1eae700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc1cc0b60a0 0x7fc1cc15dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54174/0 (socket says 172.21.15.43:54174) 2023-06-08T03:49:29.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d1eae700 1 -- 172.21.15.43:0/1929938110 learned_addr learned my addr 172.21.15.43:0/1929938110 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 0x7fc1cc15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134716147 0 0) 0x7fc1cc0cda20 con 0x7fc1cc0b60a0 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b80035b0 con 0x7fc1cc0b60a0 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2965052391 0 0) 0x7fc1b80035b0 con 0x7fc1cc0b60a0 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 msgr2=0x7fc1cc15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 0x7fc1cc15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 >> v1:172.21.15.135:6789/0 conn(0x7fc1cc0cf5b0 legacy=0x7fc1cc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc15ea40 con 0x7fc1cc0b60a0 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7fc1c8001670 con 0x7fc1cc0b60a0 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 >> v1:172.21.15.43:6789/0 conn(0x7fc1cc0b60a0 legacy=0x7fc1cc15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b8003a30 0x7fc1b8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 0x7fc1b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1b8004d90 0x7fc1b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b6470 con 0x7fc1b8004d90 2023-06-08T03:49:29.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b800bac0 con 0x7fc1b8003a30 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.569+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b800bc50 con 0x7fc1cc0cad90 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1b8004d90 0x7fc1b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d1eae700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b8003a30 0x7fc1b8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d16ad700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 0x7fc1b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 -- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 msgr2=0x7fc1b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc0cad90 0x7fc1b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 -- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b8003a30 msgr2=0x7fc1b8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b8003a30 0x7fc1b8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 -- 172.21.15.43:0/1929938110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80035b0 con 0x7fc1b8004d90 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1b8004d90 0x7fc1b8005200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009fc0 tx=0x7fc1b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd241ac14623e1b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400ec30 con 0x7fc1b8004d90 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c400f040 con 0x7fc1b8004d90 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.570+0000 7fc1d0eac700 1 -- 172.21.15.43:0/1929938110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4014480 con 0x7fc1b8004d90 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d4112700 1 -- 172.21.15.43:0/1929938110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1b8004d90 msgr2=0x7fc1b8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1929938110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1b8004d90 0x7fc1b8005200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009fc0 tx=0x7fc1b8005880 comp rx=0 tx=0).stop 2023-06-08T03:49:29.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d26af700 1 -- 172.21.15.43:0/1929938110 reap_dead start 2023-06-08T03:49:29.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d4112700 1 -- 172.21.15.43:0/1929938110 shutdown_connections 2023-06-08T03:49:29.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d4112700 1 -- 172.21.15.43:0/1929938110 >> 172.21.15.43:0/1929938110 conn(0x7fc1cc069db0 msgr2=0x7fc1cc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:29.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d4112700 1 -- 172.21.15.43:0/1929938110 shutdown_connections 2023-06-08T03:49:29.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.571+0000 7fc1d4112700 1 -- 172.21.15.43:0/1929938110 wait complete. 2023-06-08T03:49:29.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.572+0000 7fc1d4112700 1 Processor -- start 2023-06-08T03:49:29.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.572+0000 7fc1d4112700 1 -- start start 2023-06-08T03:49:29.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d4112700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 0x7fc1cc15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d4112700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc15d3e0 0x7fc1cc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d4112700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc151140 0x7fc1cc0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d4112700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc152900 con 0x7fc1cc150d70 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d4112700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc152be0 con 0x7fc1cc15d3e0 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d4112700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc152ec0 con 0x7fc1cc151140 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 0x7fc1cc15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 0x7fc1cc15cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59282/0 (socket says 172.21.15.43:59282) 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 -- 172.21.15.43:0/1909953804 learned_addr learned my addr 172.21.15.43:0/1909953804 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:29.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc151140 0x7fc1cc0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d16ad700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc15d3e0 0x7fc1cc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 -- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc151140 msgr2=0x7fc1cc0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc151140 0x7fc1cc0b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 -- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc15d3e0 msgr2=0x7fc1cc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc15d3e0 0x7fc1cc0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 -- 172.21.15.43:0/1909953804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc1531a0 con 0x7fc1cc150d70 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d26af700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc151140 0x7fc1cc0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:29.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1d1eae700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 0x7fc1cc15cea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007290 tx=0x7fc1c8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.573+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8007830 con 0x7fc1cc150d70 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.574+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800f870 con 0x7fc1cc150d70 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.574+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc153480 con 0x7fc1cc150d70 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.574+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800fc00 con 0x7fc1cc150d70 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.574+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc0c43b0 con 0x7fc1cc150d70 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.574+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc0c45d0 con 0x7fc1cc150d70 2023-06-08T03:49:29.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.575+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1c800fd60 con 0x7fc1cc150d70 2023-06-08T03:49:29.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.575+0000 7fc1c27fc700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc1b006ad10 0x7fc1b006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.576+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc1c8089820 con 0x7fc1cc150d70 2023-06-08T03:49:29.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.576+0000 7fc1d16ad700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc1b006ad10 0x7fc1b006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.576+0000 7fc1d16ad700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc1b006ad10 0x7fc1b006d1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc15c420 tx=0x7fc1bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.580+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1cc0c45d0 con 0x7fc1cc150d70 2023-06-08T03:49:29.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.776+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc1cc0c45d0 con 0x7fc1cc150d70 2023-06-08T03:49:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.776+0000 7fc1c27fc700 1 -- 172.21.15.43:0/1909953804 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc1cc0c45d0 con 0x7fc1cc150d70 2023-06-08T03:49:29.780 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.778+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc1b006ad10 msgr2=0x7fc1b006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.778+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc1b006ad10 0x7fc1b006d1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc15c420 tx=0x7fc1bc009040 comp rx=0 tx=0).stop 2023-06-08T03:49:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.778+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 msgr2=0x7fc1cc15cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.778+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 0x7fc1cc15cea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007290 tx=0x7fc1c8007650 comp rx=0 tx=0).stop 2023-06-08T03:49:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.778+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 shutdown_connections 2023-06-08T03:49:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.778+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc1b006ad10 0x7fc1b006d1c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.779+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1cc150d70 0x7fc1cc15cea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.779+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1cc151140 0x7fc1cc0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.779+0000 7fc1d4112700 1 --2- 172.21.15.43:0/1909953804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1cc15d3e0 0x7fc1cc0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.779+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 >> 172.21.15.43:0/1909953804 conn(0x7fc1cc069db0 msgr2=0x7fc1cc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.779+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 shutdown_connections 2023-06-08T03:49:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.779+0000 7fc1d4112700 1 -- 172.21.15.43:0/1909953804 wait complete. 2023-06-08T03:49:29.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.915+0000 7f19cebe4700 1 Processor -- start 2023-06-08T03:49:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.915+0000 7f19cebe4700 1 -- start start 2023-06-08T03:49:29.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cebe4700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19c8158fc0 0x7f19c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cebe4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806c8f0 0x7f19c806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cebe4700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19c806cd60 0x7f19c806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cebe4700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c80caee0 con 0x7f19c8158fc0 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cebe4700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c8159390 con 0x7f19c806cd60 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cebe4700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80ae770 con 0x7f19c806c8f0 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19c8158fc0 0x7f19c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19c8158fc0 0x7f19c8069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59290/0 (socket says 172.21.15.43:59290) 2023-06-08T03:49:29.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 -- 172.21.15.43:0/1699673552 learned_addr learned my addr 172.21.15.43:0/1699673552 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cd181700 1 --2- 172.21.15.43:0/1699673552 >> v2:172.21.15.135:3300/0 conn(0x7f19c806cd60 0x7f19c806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19c7fff700 1 --2- 172.21.15.43:0/1699673552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806c8f0 0x7f19c806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 -- 172.21.15.43:0/1699673552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806c8f0 msgr2=0x7f19c806d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 --2- 172.21.15.43:0/1699673552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806c8f0 0x7f19c806d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 -- 172.21.15.43:0/1699673552 >> v2:172.21.15.135:3300/0 conn(0x7f19c806cd60 msgr2=0x7f19c806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 --2- 172.21.15.43:0/1699673552 >> v2:172.21.15.135:3300/0 conn(0x7f19c806cd60 0x7f19c806d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.916+0000 7f19cc980700 1 -- 172.21.15.43:0/1699673552 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80ca920 con 0x7f19c8158fc0 2023-06-08T03:49:29.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cc980700 1 --2- 172.21.15.43:0/1699673552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c8158fc0 0x7f19c8069db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19c815dad0 tx=0x7f19bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de4750babf070ca server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19c77fe700 1 -- 172.21.15.43:0/1699673552 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011830 con 0x7f19c8158fc0 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19c77fe700 1 -- 172.21.15.43:0/1699673552 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc011990 con 0x7f19c8158fc0 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19c77fe700 1 -- 172.21.15.43:0/1699673552 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011d20 con 0x7f19c8158fc0 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 -- 172.21.15.43:0/1699673552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c8158fc0 msgr2=0x7f19c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1699673552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c8158fc0 0x7f19c8069db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19c815dad0 tx=0x7f19bc009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 -- 172.21.15.43:0/1699673552 shutdown_connections 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1699673552 >> v2:172.21.15.135:3300/0 conn(0x7f19c806cd60 0x7f19c806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1699673552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c8158fc0 0x7f19c8069db0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1699673552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806c8f0 0x7f19c806d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 -- 172.21.15.43:0/1699673552 >> 172.21.15.43:0/1699673552 conn(0x7f19c80ceed0 msgr2=0x7f19c80cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:29.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 -- 172.21.15.43:0/1699673552 shutdown_connections 2023-06-08T03:49:29.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.917+0000 7f19cebe4700 1 -- 172.21.15.43:0/1699673552 wait complete. 2023-06-08T03:49:29.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.919+0000 7f19cebe4700 1 Processor -- start 2023-06-08T03:49:29.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.919+0000 7f19cebe4700 1 -- start start 2023-06-08T03:49:29.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.919+0000 7f19cebe4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 0x7f19c80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806cd60 0x7f19c80b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c8158fc0 0x7f19c80b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814f730 con 0x7f19c806c8f0 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814eb20 con 0x7f19c8158fc0 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814ee00 con 0x7f19c806cd60 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 0x7f19c80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 0x7f19c80c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59294/0 (socket says 172.21.15.43:59294) 2023-06-08T03:49:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 -- 172.21.15.43:0/1739591435 learned_addr learned my addr 172.21.15.43:0/1739591435 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19c7fff700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806cd60 0x7f19c80b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cd181700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c8158fc0 0x7f19c80b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 -- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806cd60 msgr2=0x7f19c80b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806cd60 0x7f19c80b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 -- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c8158fc0 msgr2=0x7f19c80b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c8158fc0 0x7f19c80b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 -- 172.21.15.43:0/1739591435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc009550 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cc980700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 0x7f19c80c80e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19bc000c00 tx=0x7f19bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc004240 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc01f070 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c814f0e0 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0036a0 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.920+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c80c8620 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.921+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8073fa0 con 0x7f19c806c8f0 2023-06-08T03:49:29.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.922+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19bc021030 con 0x7f19c806c8f0 2023-06-08T03:49:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.922+0000 7f19c57fa700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19ac06ace0 0x7f19ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.922+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19bc08a860 con 0x7f19c806c8f0 2023-06-08T03:49:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.922+0000 7f19c7fff700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19ac06ace0 0x7f19ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.923+0000 7f19c7fff700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19ac06ace0 0x7f19ac06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19c80c59a0 tx=0x7f19b4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:29.927+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19bc0556b0 con 0x7f19c806c8f0 2023-06-08T03:49:30.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.126+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19c80b4e50 con 0x7f19c806c8f0 2023-06-08T03:49:30.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.128+0000 7f19c57fa700 1 -- 172.21.15.43:0/1739591435 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f19bc058cd0 con 0x7f19c806c8f0 2023-06-08T03:49:30.131 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:30.131 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:30.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19ac06ace0 msgr2=0x7f19ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19ac06ace0 0x7f19ac06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19c80c59a0 tx=0x7f19b4009210 comp rx=0 tx=0).stop 2023-06-08T03:49:30.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 msgr2=0x7f19c80c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 0x7f19c80c80e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19bc000c00 tx=0x7f19bc004750 comp rx=0 tx=0).stop 2023-06-08T03:49:30.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 shutdown_connections 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19ac06ace0 0x7f19ac06d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19c806c8f0 0x7f19c80c80e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c8158fc0 0x7f19c80b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 --2- 172.21.15.43:0/1739591435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c806cd60 0x7f19c80b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 >> 172.21.15.43:0/1739591435 conn(0x7f19c80ceed0 msgr2=0x7f19c8153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 shutdown_connections 2023-06-08T03:49:30.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.130+0000 7f19cebe4700 1 -- 172.21.15.43:0/1739591435 wait complete. 2023-06-08T03:49:30.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:30.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:30.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 Processor -- start 2023-06-08T03:49:30.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 -- start start 2023-06-08T03:49:30.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5f815c270 0x7fd5f80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5f80cd840 0x7fd5f80cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f80d0d30 con 0x7fd5f80ce310 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f806aec0 con 0x7fd5f815c270 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.270+0000 7fd5fdc2a700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f80d1520 con 0x7fd5f80cd840 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5f815c270 0x7fd5f80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5f815c270 0x7fd5f80d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59302/0 (socket says 172.21.15.43:59302) 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 -- 172.21.15.43:0/224000342 learned_addr learned my addr 172.21.15.43:0/224000342 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f7fff700 1 --2- 172.21.15.43:0/224000342 >> v2:172.21.15.135:3300/0 conn(0x7fd5f80cd840 0x7fd5f80cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 -- 172.21.15.43:0/224000342 >> v2:172.21.15.135:3300/0 conn(0x7fd5f80cd840 msgr2=0x7fd5f80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 --2- 172.21.15.43:0/224000342 >> v2:172.21.15.135:3300/0 conn(0x7fd5f80cd840 0x7fd5f80cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 -- 172.21.15.43:0/224000342 >> v1:172.21.15.135:6789/0 conn(0x7fd5f80ce310 legacy=0x7fd5f80cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 -- 172.21.15.43:0/224000342 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f80cb1a0 con 0x7fd5f815c270 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f7fff700 1 --2- 172.21.15.43:0/224000342 >> v2:172.21.15.135:3300/0 conn(0x7fd5f80cd840 0x7fd5f80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f77fe700 1 --2- 172.21.15.43:0/224000342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f80d07f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5f806f700 tx=0x7fd5e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b6d39ac92390e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f6ffd700 1 -- 172.21.15.43:0/224000342 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8004230 con 0x7fd5f815c270 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f6ffd700 1 -- 172.21.15.43:0/224000342 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e8004390 con 0x7fd5f815c270 2023-06-08T03:49:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.271+0000 7fd5f6ffd700 1 -- 172.21.15.43:0/224000342 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80036a0 con 0x7fd5f815c270 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/224000342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 msgr2=0x7fd5f80d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/224000342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f80d07f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5f806f700 tx=0x7fd5e8009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/224000342 shutdown_connections 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/224000342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f80d07f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/224000342 >> v2:172.21.15.135:3300/0 conn(0x7fd5f80cd840 0x7fd5f80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/224000342 >> 172.21.15.43:0/224000342 conn(0x7fd5f8069db0 msgr2=0x7fd5f806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/224000342 shutdown_connections 2023-06-08T03:49:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.272+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/224000342 wait complete. 2023-06-08T03:49:30.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.273+0000 7fd5fdc2a700 1 Processor -- start 2023-06-08T03:49:30.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.274+0000 7fd5fdc2a700 1 -- start start 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5f80cd840 0x7fd5f80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5f80ce310 0x7fd5f815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c8260 con 0x7fd5f815c270 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c8540 con 0x7fd5f80ce310 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c8820 con 0x7fd5f80cd840 2023-06-08T03:49:30.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f806bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59310/0 (socket says 172.21.15.43:59310) 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 -- 172.21.15.43:0/3936557248 learned_addr learned my addr 172.21.15.43:0/3936557248 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f77fe700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5f80cd840 0x7fd5f80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5eeffd700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5f80ce310 0x7fd5f815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 -- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5f80cd840 msgr2=0x7fd5f80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5f80cd840 0x7fd5f80c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 -- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5f80ce310 msgr2=0x7fd5f815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5f80ce310 0x7fd5f815cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 -- 172.21.15.43:0/3936557248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009550 con 0x7fd5f815c270 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f7fff700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f806bbb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000ce80 tx=0x7fd5f000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000ad40 con 0x7fd5f815c270 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0015440 con 0x7fd5f815c270 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f815c6e0 con 0x7fd5f815c270 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.275+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000aea0 con 0x7fd5f815c270 2023-06-08T03:49:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.276+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80c9940 con 0x7fd5f815c270 2023-06-08T03:49:30.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.276+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f8073fa0 con 0x7fd5f815c270 2023-06-08T03:49:30.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.277+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5f000d430 con 0x7fd5f815c270 2023-06-08T03:49:30.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.277+0000 7fd5f4ff9700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd5d806ace0 0x7fd5d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.277+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5f0089c40 con 0x7fd5f815c270 2023-06-08T03:49:30.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.278+0000 7fd5f77fe700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd5d806ace0 0x7fd5d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.278+0000 7fd5f77fe700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd5d806ace0 0x7fd5d806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009130 tx=0x7fd5e8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.282+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5f0054970 con 0x7fd5f815c270 2023-06-08T03:49:30.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.478+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5f80b2790 con 0x7fd5f815c270 2023-06-08T03:49:30.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.479+0000 7fd5f4ff9700 1 -- 172.21.15.43:0/3936557248 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5f001a070 con 0x7fd5f815c270 2023-06-08T03:49:30.482 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:30.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd5d806ace0 msgr2=0x7fd5d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd5d806ace0 0x7fd5d806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009130 tx=0x7fd5e8008030 comp rx=0 tx=0).stop 2023-06-08T03:49:30.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 msgr2=0x7fd5f806bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f806bbb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000ce80 tx=0x7fd5f000ceb0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 shutdown_connections 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd5d806ace0 0x7fd5d806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f815c270 0x7fd5f806bbb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5f80cd840 0x7fd5f80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 --2- 172.21.15.43:0/3936557248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5f80ce310 0x7fd5f815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 >> 172.21.15.43:0/3936557248 conn(0x7fd5f8069db0 msgr2=0x7fd5f815fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:30.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 shutdown_connections 2023-06-08T03:49:30.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.481+0000 7fd5fdc2a700 1 -- 172.21.15.43:0/3936557248 wait complete. 2023-06-08T03:49:30.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:30.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.620+0000 7f19f138f700 1 Processor -- start 2023-06-08T03:49:30.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.620+0000 7f19f138f700 1 -- start start 2023-06-08T03:49:30.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19f138f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19ec071560 0x7f19ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19f138f700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec15c8f0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19f138f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec0719b0 con 0x7f19ec15c520 2023-06-08T03:49:30.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19f138f700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0cd940 con 0x7f19ec071560 2023-06-08T03:49:30.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19ea7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19ec071560 0x7f19ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19ea7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19ec071560 0x7f19ec069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59316/0 (socket says 172.21.15.43:59316) 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19eb7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f19ec06a2f0 0x7f19ec0b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54222/0 (socket says 172.21.15.43:54222) 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.621+0000 7f19ea7fc700 1 -- 172.21.15.43:0/3275250287 learned_addr learned my addr 172.21.15.43:0/3275250287 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19ea7fc700 1 -- 172.21.15.43:0/3275250287 >> v1:172.21.15.135:6789/0 conn(0x7f19ec15c520 legacy=0x7f19ec0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19ea7fc700 1 -- 172.21.15.43:0/3275250287 >> v1:172.21.15.43:6789/0 conn(0x7f19ec06a2f0 legacy=0x7f19ec0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19ea7fc700 1 -- 172.21.15.43:0/3275250287 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec06a720 con 0x7f19ec071560 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19e9ffb700 1 -- 172.21.15.43:0/3275250287 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051959375 0 0) 0x7f19e4001490 con 0x7f19ec06a2f0 2023-06-08T03:49:30.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19ea7fc700 1 --2- 172.21.15.43:0/3275250287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec071560 0x7f19ec069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0098f0 tx=0x7f19dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4aaaa956eb6867 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19e9ffb700 1 -- 172.21.15.43:0/3275250287 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00b8a0 con 0x7f19ec071560 2023-06-08T03:49:30.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19e9ffb700 1 -- 172.21.15.43:0/3275250287 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00ba00 con 0x7f19ec071560 2023-06-08T03:49:30.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19e9ffb700 1 -- 172.21.15.43:0/3275250287 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00bd90 con 0x7f19ec071560 2023-06-08T03:49:30.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19f138f700 1 -- 172.21.15.43:0/3275250287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec071560 msgr2=0x7f19ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19f138f700 1 --2- 172.21.15.43:0/3275250287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec071560 0x7f19ec069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0098f0 tx=0x7f19dc009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:30.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19f138f700 1 -- 172.21.15.43:0/3275250287 shutdown_connections 2023-06-08T03:49:30.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19f138f700 1 --2- 172.21.15.43:0/3275250287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec071560 0x7f19ec069db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19f138f700 1 -- 172.21.15.43:0/3275250287 >> 172.21.15.43:0/3275250287 conn(0x7f19ec06aec0 msgr2=0x7f19ec06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.622+0000 7f19f138f700 1 -- 172.21.15.43:0/3275250287 shutdown_connections 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.623+0000 7f19f138f700 1 -- 172.21.15.43:0/3275250287 wait complete. 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.624+0000 7f19f138f700 1 Processor -- start 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.624+0000 7f19f138f700 1 -- start start 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 0x7f19ec1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19ec071560 0x7f19ec15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19ec15c520 0x7f19ec0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1f5260 con 0x7f19ec06a2f0 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0c3180 con 0x7f19ec071560 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec15f810 con 0x7f19ec15c520 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 0x7f19ec1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 0x7f19ec1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59320/0 (socket says 172.21.15.43:59320) 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 -- 172.21.15.43:0/94339419 learned_addr learned my addr 172.21.15.43:0/94339419 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19ea7fc700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19ec071560 0x7f19ec15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eb7fe700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19ec15c520 0x7f19ec0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 -- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19ec15c520 msgr2=0x7f19ec0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19ec15c520 0x7f19ec0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 -- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19ec071560 msgr2=0x7f19ec15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19ec071560 0x7f19ec15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 -- 172.21.15.43:0/94339419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc009550 con 0x7f19ec06a2f0 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19ea7fc700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19ec071560 0x7f19ec15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19eaffd700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 0x7f19ec1518c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19e000c450 tx=0x7f19e000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00052d0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0005430 con 0x7f19ec06a2f0 2023-06-08T03:49:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec1f54b0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00038c0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.625+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec1f5a70 con 0x7f19ec06a2f0 2023-06-08T03:49:30.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.626+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec073fa0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.627+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19e0003a20 con 0x7f19ec06a2f0 2023-06-08T03:49:30.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.627+0000 7f19d37fe700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19d806ace0 0x7f19d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.628+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19e0088db0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.628+0000 7f19ea7fc700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19d806ace0 0x7f19d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.628+0000 7f19ea7fc700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19d806ace0 0x7f19d806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f19dc000c00 tx=0x7f19dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.631+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19e0053c00 con 0x7f19ec06a2f0 2023-06-08T03:49:30.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.829+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19ec0b55d0 con 0x7f19ec06a2f0 2023-06-08T03:49:30.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.829+0000 7f19d37fe700 1 -- 172.21.15.43:0/94339419 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19e0057220 con 0x7f19ec06a2f0 2023-06-08T03:49:30.832 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:30.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19d806ace0 msgr2=0x7f19d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19d806ace0 0x7f19d806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f19dc000c00 tx=0x7f19dc008030 comp rx=0 tx=0).stop 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 msgr2=0x7f19ec1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 0x7f19ec1518c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19e000c450 tx=0x7f19e000c810 comp rx=0 tx=0).stop 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 shutdown_connections 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f19d806ace0 0x7f19d806d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19ec06a2f0 0x7f19ec1518c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19ec15c520 0x7f19ec0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 --2- 172.21.15.43:0/94339419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19ec071560 0x7f19ec15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 >> 172.21.15.43:0/94339419 conn(0x7f19ec06aec0 msgr2=0x7f19ec15b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 shutdown_connections 2023-06-08T03:49:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.831+0000 7f19f138f700 1 -- 172.21.15.43:0/94339419 wait complete. 2023-06-08T03:49:30.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.970+0000 7f2c1f2f3700 1 Processor -- start 2023-06-08T03:49:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.970+0000 7f2c1f2f3700 1 -- start start 2023-06-08T03:49:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1f2f3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c180d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1f2f3700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c180ce310 0x7f2c180cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1f2f3700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180d0d30 con 0x7f2c180cd670 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1f2f3700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1806aec0 con 0x7f2c180ce310 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1f2f3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180cdaf0 con 0x7f2c1815c270 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c180ce310 0x7f2c180cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c180ce310 0x7f2c180cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59332/0 (socket says 172.21.15.43:59332) 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 -- 172.21.15.43:0/1193241031 learned_addr learned my addr 172.21.15.43:0/1193241031 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1d08f700 1 --2- 172.21.15.43:0/1193241031 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c180d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 -- 172.21.15.43:0/1193241031 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 msgr2=0x7f2c180d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 --2- 172.21.15.43:0/1193241031 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c180d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 -- 172.21.15.43:0/1193241031 >> v1:172.21.15.135:6789/0 conn(0x7f2c180cd670 legacy=0x7f2c1815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 -- 172.21.15.43:0/1193241031 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180d1520 con 0x7f2c180ce310 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c1c88e700 1 --2- 172.21.15.43:0/1193241031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180ce310 0x7f2c180cd130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c080098f0 tx=0x7f2c08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c0cf9bc1fca02f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.971+0000 7f2c0ffff700 1 -- 172.21.15.43:0/1193241031 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800b8a0 con 0x7f2c180ce310 2023-06-08T03:49:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c0ffff700 1 -- 172.21.15.43:0/1193241031 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800ba00 con 0x7f2c180ce310 2023-06-08T03:49:30.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c0ffff700 1 -- 172.21.15.43:0/1193241031 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800bd90 con 0x7f2c180ce310 2023-06-08T03:49:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/1193241031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180ce310 msgr2=0x7f2c180cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/1193241031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180ce310 0x7f2c180cd130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c080098f0 tx=0x7f2c08009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/1193241031 shutdown_connections 2023-06-08T03:49:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/1193241031 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c180d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/1193241031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180ce310 0x7f2c180cd130 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/1193241031 >> 172.21.15.43:0/1193241031 conn(0x7f2c18069db0 msgr2=0x7f2c1806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/1193241031 shutdown_connections 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.972+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/1193241031 wait complete. 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.973+0000 7f2c1f2f3700 1 Processor -- start 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.973+0000 7f2c1f2f3700 1 -- start start 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1f2f3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 0x7f2c180c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1f2f3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c180ce310 0x7f2c1806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1f2f3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c1806e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1f2f3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180b4ce0 con 0x7f2c180cd670 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1f2f3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180c5af0 con 0x7f2c180ce310 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1f2f3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180c5dd0 con 0x7f2c1815c270 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1d08f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 0x7f2c180c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1d08f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 0x7f2c180c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59334/0 (socket says 172.21.15.43:59334) 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1d08f700 1 -- 172.21.15.43:0/753785660 learned_addr learned my addr 172.21.15.43:0/753785660 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1c88e700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c180ce310 0x7f2c1806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.974+0000 7f2c1d890700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c1806e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1d08f700 1 -- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 msgr2=0x7f2c1806e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1d08f700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c1806e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1d08f700 1 -- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c180ce310 msgr2=0x7f2c1806e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1d08f700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c180ce310 0x7f2c1806e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1d08f700 1 -- 172.21.15.43:0/753785660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08009550 con 0x7f2c180cd670 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1c88e700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c180ce310 0x7f2c1806e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1d08f700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 0x7f2c180c52c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400e810 tx=0x7f2c1400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14013610 con 0x7f2c180cd670 2023-06-08T03:49:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14013770 con 0x7f2c180cd670 2023-06-08T03:49:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c180c60b0 con 0x7f2c180cd670 2023-06-08T03:49:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14013b20 con 0x7f2c180cd670 2023-06-08T03:49:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.975+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c180c5800 con 0x7f2c180cd670 2023-06-08T03:49:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.976+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c18073fa0 con 0x7f2c180cd670 2023-06-08T03:49:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.977+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c14013c80 con 0x7f2c180cd670 2023-06-08T03:49:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.978+0000 7f2c0dffb700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bfc06ace0 0x7f2bfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.978+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c14089900 con 0x7f2c180cd670 2023-06-08T03:49:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.978+0000 7f2c1c88e700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bfc06ace0 0x7f2bfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.979+0000 7f2c1c88e700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bfc06ace0 0x7f2bfc06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009c40 tx=0x7f2c08008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:30.982+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c140546b0 con 0x7f2c180cd670 2023-06-08T03:49:31.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.177+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c180c62a0 con 0x7f2c180cd670 2023-06-08T03:49:31.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.178+0000 7f2c0dffb700 1 -- 172.21.15.43:0/753785660 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c14057cd0 con 0x7f2c180cd670 2023-06-08T03:49:31.181 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:31.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bfc06ace0 msgr2=0x7f2bfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bfc06ace0 0x7f2bfc06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009c40 tx=0x7f2c08008030 comp rx=0 tx=0).stop 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 msgr2=0x7f2c180c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 0x7f2c180c52c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400e810 tx=0x7f2c1400ebd0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 shutdown_connections 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2bfc06ace0 0x7f2bfc06d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c180cd670 0x7f2c180c52c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c1815c270 0x7f2c1806e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 --2- 172.21.15.43:0/753785660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c180ce310 0x7f2c1806e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 >> 172.21.15.43:0/753785660 conn(0x7f2c18069db0 msgr2=0x7f2c1806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 shutdown_connections 2023-06-08T03:49:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.180+0000 7f2c1f2f3700 1 -- 172.21.15.43:0/753785660 wait complete. 2023-06-08T03:49:31.195 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.319+0000 7f6464393700 1 Processor -- start 2023-06-08T03:49:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.319+0000 7f6464393700 1 -- start start 2023-06-08T03:49:31.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6464393700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 0x7f645c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6464393700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 0x7f645c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6464393700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c071290 con 0x7f645c15c6f0 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6464393700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0b2050 con 0x7f645c15c320 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6464393700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0cd2c0 con 0x7f645c071770 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f646192e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 0x7f645c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f646212f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 0x7f645c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6462930700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f645c15c6f0 0x7f645c160020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:41470/0 (socket says 172.21.15.43:41470) 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f646192e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 0x7f645c069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52800/0 (socket says 172.21.15.43:52800) 2023-06-08T03:49:31.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f6462930700 1 -- 172.21.15.43:0/2121192395 learned_addr learned my addr 172.21.15.43:0/2121192395 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:31.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.320+0000 7f646212f700 1 --2- 172.21.15.43:0/2121192395 >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 0x7f645c0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40958/0 (socket says 172.21.15.43:40958) 2023-06-08T03:49:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646192e700 1 -- 172.21.15.43:0/2121192395 >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 msgr2=0x7f645c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646192e700 1 --2- 172.21.15.43:0/2121192395 >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 0x7f645c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646192e700 1 -- 172.21.15.43:0/2121192395 >> v1:172.21.15.135:6789/0 conn(0x7f645c15c6f0 legacy=0x7f645c160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646192e700 1 -- 172.21.15.43:0/2121192395 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0cd5a0 con 0x7f645c071770 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646112d700 1 -- 172.21.15.43:0/2121192395 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469961477 0 0) 0x7f645c071290 con 0x7f645c15c6f0 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646212f700 1 --2- 172.21.15.43:0/2121192395 >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 0x7f645c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646192e700 1 --2- 172.21.15.43:0/2121192395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 0x7f645c069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6458009840 tx=0x7f6458009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4bfc154df6300f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646112d700 1 -- 172.21.15.43:0/2121192395 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458011830 con 0x7f645c071770 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646112d700 1 -- 172.21.15.43:0/2121192395 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458011990 con 0x7f645c071770 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.321+0000 7f646112d700 1 -- 172.21.15.43:0/2121192395 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458011d20 con 0x7f645c071770 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 -- 172.21.15.43:0/2121192395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 msgr2=0x7f645c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 --2- 172.21.15.43:0/2121192395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 0x7f645c069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6458009840 tx=0x7f6458009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 -- 172.21.15.43:0/2121192395 shutdown_connections 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 --2- 172.21.15.43:0/2121192395 >> v2:172.21.15.135:3300/0 conn(0x7f645c15c320 0x7f645c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 --2- 172.21.15.43:0/2121192395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c071770 0x7f645c069db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 -- 172.21.15.43:0/2121192395 >> 172.21.15.43:0/2121192395 conn(0x7f645c06aec0 msgr2=0x7f645c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 -- 172.21.15.43:0/2121192395 shutdown_connections 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.322+0000 7f6464393700 1 -- 172.21.15.43:0/2121192395 wait complete. 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.323+0000 7f6464393700 1 Processor -- start 2023-06-08T03:49:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.323+0000 7f6464393700 1 -- start start 2023-06-08T03:49:31.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6464393700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c071770 0x7f645c0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6464393700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c15c320 0x7f645c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6464393700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 0x7f645c153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6464393700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0cad20 con 0x7f645c15c6f0 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6464393700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0c6c60 con 0x7f645c071770 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6464393700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0caf70 con 0x7f645c15c320 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 0x7f645c153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 0x7f645c153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59352/0 (socket says 172.21.15.43:59352) 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 -- 172.21.15.43:0/3758033345 learned_addr learned my addr 172.21.15.43:0/3758033345 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f646192e700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c15c320 0x7f645c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f646212f700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c071770 0x7f645c0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 -- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c15c320 msgr2=0x7f645c0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c15c320 0x7f645c0c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 -- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c071770 msgr2=0x7f645c0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c071770 0x7f645c0ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 -- 172.21.15.43:0/3758033345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0094a0 con 0x7f645c15c6f0 2023-06-08T03:49:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f646212f700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c071770 0x7f645c0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f646192e700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c15c320 0x7f645c0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6462930700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 0x7f645c153f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f645400cb60 tx=0x7f645400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.324+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400aaf0 con 0x7f645c15c6f0 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.325+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400ac50 con 0x7f645c15c6f0 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.325+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64580094a0 con 0x7f645c15c6f0 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.325+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540070d0 con 0x7f645c15c6f0 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.325+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c0cb530 con 0x7f645c15c6f0 2023-06-08T03:49:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.326+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c073fa0 con 0x7f645c15c6f0 2023-06-08T03:49:31.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.326+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6454007230 con 0x7f645c15c6f0 2023-06-08T03:49:31.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.327+0000 7f6452ffd700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f644006ace0 0x7f644006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.327+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f64540894c0 con 0x7f645c15c6f0 2023-06-08T03:49:31.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.327+0000 7f646212f700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f644006ace0 0x7f644006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.327+0000 7f646212f700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f644006ace0 0x7f644006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f644c009dc0 tx=0x7f644c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:31.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.331+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6454054310 con 0x7f645c15c6f0 2023-06-08T03:49:31.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.526+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f645c0b55d0 con 0x7f645c15c6f0 2023-06-08T03:49:31.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.527+0000 7f6452ffd700 1 -- 172.21.15.43:0/3758033345 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6454057930 con 0x7f645c15c6f0 2023-06-08T03:49:31.530 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:31.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f644006ace0 msgr2=0x7f644006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f644006ace0 0x7f644006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f644c009dc0 tx=0x7f644c008040 comp rx=0 tx=0).stop 2023-06-08T03:49:31.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 msgr2=0x7f645c153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 0x7f645c153f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f645400cb60 tx=0x7f645400cf20 comp rx=0 tx=0).stop 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 shutdown_connections 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f644006ace0 0x7f644006d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f645c15c6f0 0x7f645c153f60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c071770 0x7f645c0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 --2- 172.21.15.43:0/3758033345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f645c15c320 0x7f645c0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 >> 172.21.15.43:0/3758033345 conn(0x7f645c06aec0 msgr2=0x7f645c158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:31.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 shutdown_connections 2023-06-08T03:49:31.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.529+0000 7f6464393700 1 -- 172.21.15.43:0/3758033345 wait complete. 2023-06-08T03:49:31.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.668+0000 7fdedbf0b700 1 Processor -- start 2023-06-08T03:49:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.668+0000 7fdedbf0b700 1 -- start start 2023-06-08T03:49:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fdedbf0b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fded415c320 0x7fded40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fdedbf0b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fded4071770 0x7fded4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fdedbf0b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded4071290 con 0x7fded415c6f0 2023-06-08T03:49:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fdedbf0b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40b2050 con 0x7fded4071770 2023-06-08T03:49:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fdedbf0b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40cd2c0 con 0x7fded415c320 2023-06-08T03:49:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fded94a6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fded4071770 0x7fded4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fded94a6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fded4071770 0x7fded4069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59358/0 (socket says 172.21.15.43:59358) 2023-06-08T03:49:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fded94a6700 1 -- 172.21.15.43:0/4109177 learned_addr learned my addr 172.21.15.43:0/4109177 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fdeda4a8700 1 --1- 172.21.15.43:0/4109177 >> v1:172.21.15.43:6789/0 conn(0x7fded415c6f0 0x7fded4160020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54264/0 (socket says 172.21.15.43:54264) 2023-06-08T03:49:31.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.669+0000 7fded9ca7700 1 --2- 172.21.15.43:0/4109177 >> v2:172.21.15.135:3300/0 conn(0x7fded415c320 0x7fded40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded94a6700 1 -- 172.21.15.43:0/4109177 >> v2:172.21.15.135:3300/0 conn(0x7fded415c320 msgr2=0x7fded40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:31.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded94a6700 1 --2- 172.21.15.43:0/4109177 >> v2:172.21.15.135:3300/0 conn(0x7fded415c320 0x7fded40cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded94a6700 1 -- 172.21.15.43:0/4109177 >> v1:172.21.15.43:6789/0 conn(0x7fded415c6f0 legacy=0x7fded4160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded8ca5700 1 -- 172.21.15.43:0/4109177 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122984446 0 0) 0x7fded4071290 con 0x7fded415c6f0 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded94a6700 1 -- 172.21.15.43:0/4109177 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40cd5a0 con 0x7fded4071770 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded9ca7700 1 --2- 172.21.15.43:0/4109177 >> v2:172.21.15.135:3300/0 conn(0x7fded415c320 0x7fded40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded94a6700 1 --2- 172.21.15.43:0/4109177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fded40cd1a0 tx=0x7fded0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8687fa2ef856b420 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded8ca5700 1 -- 172.21.15.43:0/4109177 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000b870 con 0x7fded4071770 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded8ca5700 1 -- 172.21.15.43:0/4109177 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded000b9d0 con 0x7fded4071770 2023-06-08T03:49:31.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fded8ca5700 1 -- 172.21.15.43:0/4109177 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000bd60 con 0x7fded4071770 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fdedbf0b700 1 -- 172.21.15.43:0/4109177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 msgr2=0x7fded4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/4109177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fded40cd1a0 tx=0x7fded0009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fdedbf0b700 1 -- 172.21.15.43:0/4109177 shutdown_connections 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/4109177 >> v2:172.21.15.135:3300/0 conn(0x7fded415c320 0x7fded40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/4109177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4069db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.670+0000 7fdedbf0b700 1 -- 172.21.15.43:0/4109177 >> 172.21.15.43:0/4109177 conn(0x7fded406aec0 msgr2=0x7fded406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.671+0000 7fdedbf0b700 1 -- 172.21.15.43:0/4109177 shutdown_connections 2023-06-08T03:49:31.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.671+0000 7fdedbf0b700 1 -- 172.21.15.43:0/4109177 wait complete. 2023-06-08T03:49:31.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.672+0000 7fdedbf0b700 1 Processor -- start 2023-06-08T03:49:31.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.672+0000 7fdedbf0b700 1 -- start start 2023-06-08T03:49:31.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fdedbf0b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fdedbf0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fded415c320 0x7fded40cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fdedbf0b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fded415c6f0 0x7fded40cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fdedbf0b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4158740 con 0x7fded4071770 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fdedbf0b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4158460 con 0x7fded415c320 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fdedbf0b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40ca810 con 0x7fded415c6f0 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fded9ca7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fded9ca7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59362/0 (socket says 172.21.15.43:59362) 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.673+0000 7fded9ca7700 1 -- 172.21.15.43:0/3124563364 learned_addr learned my addr 172.21.15.43:0/3124563364 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:31.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded94a6700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fded415c320 0x7fded40cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdeda4a8700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fded415c6f0 0x7fded40cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded9ca7700 1 -- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fded415c6f0 msgr2=0x7fded40cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded9ca7700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fded415c6f0 0x7fded40cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded9ca7700 1 -- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fded415c320 msgr2=0x7fded40cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded9ca7700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fded415c320 0x7fded40cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded9ca7700 1 -- 172.21.15.43:0/3124563364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0009550 con 0x7fded4071770 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdeda4a8700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fded415c6f0 0x7fded40cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fded9ca7700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4154cb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdec400e810 tx=0x7fdec400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4013610 con 0x7fded4071770 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4013770 con 0x7fded4071770 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded40caaf0 con 0x7fded4071770 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4013b20 con 0x7fded4071770 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.674+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded41580f0 con 0x7fded4071770 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.675+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded40cb140 con 0x7fded4071770 2023-06-08T03:49:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.675+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdec4013c80 con 0x7fded4071770 2023-06-08T03:49:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.676+0000 7fdeca7fc700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdeb806ace0 0x7fdeb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.676+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdec4089430 con 0x7fded4071770 2023-06-08T03:49:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.676+0000 7fded94a6700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdeb806ace0 0x7fdeb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.676+0000 7fded94a6700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdeb806ace0 0x7fdeb806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fded4071b60 tx=0x7fded0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.680+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdec4054280 con 0x7fded4071770 2023-06-08T03:49:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.876+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fded40ca670 con 0x7fded4071770 2023-06-08T03:49:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.876+0000 7fdeca7fc700 1 -- 172.21.15.43:0/3124563364 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fded40ca670 con 0x7fded4071770 2023-06-08T03:49:31.879 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdeb806ace0 msgr2=0x7fdeb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdeb806ace0 0x7fdeb806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fded4071b60 tx=0x7fded0008030 comp rx=0 tx=0).stop 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 msgr2=0x7fded4154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4154cb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdec400e810 tx=0x7fdec400ebd0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 shutdown_connections 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdeb806ace0 0x7fdeb806d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fded4071770 0x7fded4154cb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fded415c6f0 0x7fded40cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 --2- 172.21.15.43:0/3124563364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fded415c320 0x7fded40cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 >> 172.21.15.43:0/3124563364 conn(0x7fded406aec0 msgr2=0x7fded40b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 shutdown_connections 2023-06-08T03:49:31.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:31.878+0000 7fdedbf0b700 1 -- 172.21.15.43:0/3124563364 wait complete. 2023-06-08T03:49:31.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.014+0000 7fccb93f7700 1 Processor -- start 2023-06-08T03:49:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.014+0000 7fccb93f7700 1 -- start start 2023-06-08T03:49:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb93f7700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fccb40ae9f0 0x7fccb4071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb93f7700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb4069db0 0x7fccb406a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb93f7700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb4072300 con 0x7fccb40b4e10 2023-06-08T03:49:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb93f7700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb40b2180 con 0x7fccb40ae9f0 2023-06-08T03:49:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb93f7700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb406a770 con 0x7fccb4069db0 2023-06-08T03:49:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb27fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fccb40ae9f0 0x7fccb4071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb2ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fccb40b4e10 0x7fccb415a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54274/0 (socket says 172.21.15.43:54274) 2023-06-08T03:49:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.015+0000 7fccb2ffd700 1 -- 172.21.15.43:0/481667787 learned_addr learned my addr 172.21.15.43:0/481667787 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb37fe700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb4069db0 0x7fccb406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb27fc700 1 -- 172.21.15.43:0/481667787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb4069db0 msgr2=0x7fccb406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb27fc700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb4069db0 0x7fccb406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb27fc700 1 -- 172.21.15.43:0/481667787 >> v1:172.21.15.43:6789/0 conn(0x7fccb40b4e10 legacy=0x7fccb415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb27fc700 1 -- 172.21.15.43:0/481667787 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4071180 con 0x7fccb40ae9f0 2023-06-08T03:49:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb1ffb700 1 -- 172.21.15.43:0/481667787 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951184182 0 0) 0x7fccb4072300 con 0x7fccb40b4e10 2023-06-08T03:49:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb37fe700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb4069db0 0x7fccb406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb27fc700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb40ae9f0 0x7fccb4071dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009840 tx=0x7fcca4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a30dd89b37e14d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb1ffb700 1 -- 172.21.15.43:0/481667787 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4011830 con 0x7fccb40ae9f0 2023-06-08T03:49:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb1ffb700 1 -- 172.21.15.43:0/481667787 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca4011990 con 0x7fccb40ae9f0 2023-06-08T03:49:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.016+0000 7fccb1ffb700 1 -- 172.21.15.43:0/481667787 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4011d20 con 0x7fccb40ae9f0 2023-06-08T03:49:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 -- 172.21.15.43:0/481667787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb40ae9f0 msgr2=0x7fccb4071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb40ae9f0 0x7fccb4071dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009840 tx=0x7fcca4009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 -- 172.21.15.43:0/481667787 shutdown_connections 2023-06-08T03:49:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb4069db0 0x7fccb406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 --2- 172.21.15.43:0/481667787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb40ae9f0 0x7fccb4071dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 -- 172.21.15.43:0/481667787 >> 172.21.15.43:0/481667787 conn(0x7fccb406d180 msgr2=0x7fccb406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 -- 172.21.15.43:0/481667787 shutdown_connections 2023-06-08T03:49:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.017+0000 7fccb93f7700 1 -- 172.21.15.43:0/481667787 wait complete. 2023-06-08T03:49:32.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.019+0000 7fccb93f7700 1 Processor -- start 2023-06-08T03:49:32.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.019+0000 7fccb93f7700 1 -- start start 2023-06-08T03:49:32.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 0x7fccb41e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb40ae9f0 0x7fccb4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb40b4e10 0x7fccb4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4156d60 con 0x7fccb4069db0 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40c4990 con 0x7fccb40b4e10 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4156430 con 0x7fccb40ae9f0 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 0x7fccb41e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 0x7fccb41e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59374/0 (socket says 172.21.15.43:59374) 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 -- 172.21.15.43:0/3503615961 learned_addr learned my addr 172.21.15.43:0/3503615961 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb37fe700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb40b4e10 0x7fccb4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb27fc700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb40ae9f0 0x7fccb4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 -- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb40ae9f0 msgr2=0x7fccb4151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb40ae9f0 0x7fccb4151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 -- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb40b4e10 msgr2=0x7fccb4158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb40b4e10 0x7fccb4158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 -- 172.21.15.43:0/3503615961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40094a0 con 0x7fccb4069db0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb2ffd700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 0x7fccb41e38b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcca80011e0 tx=0x7fcca800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8004c80 con 0x7fccb4069db0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca8004e00 con 0x7fccb4069db0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb4156710 con 0x7fccb4069db0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.020+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8007310 con 0x7fccb4069db0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.021+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41e3df0 con 0x7fccb4069db0 2023-06-08T03:49:32.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.021+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb4073fa0 con 0x7fccb4069db0 2023-06-08T03:49:32.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.022+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcca8007470 con 0x7fccb4069db0 2023-06-08T03:49:32.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.022+0000 7fcc9b7fe700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcca006ace0 0x7fcca006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.022+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcca8089560 con 0x7fccb4069db0 2023-06-08T03:49:32.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.023+0000 7fccb27fc700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcca006ace0 0x7fcca006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.023+0000 7fccb27fc700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcca006ace0 0x7fcca006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcca40090b0 tx=0x7fcca4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.027+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcca8054320 con 0x7fccb4069db0 2023-06-08T03:49:32.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.224+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccb41e67c0 con 0x7fccb4069db0 2023-06-08T03:49:32.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.226+0000 7fcc9b7fe700 1 -- 172.21.15.43:0/3503615961 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fcca8057940 con 0x7fccb4069db0 2023-06-08T03:49:32.229 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:32.229 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:48:51.146426+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcca006ace0 msgr2=0x7fcca006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcca006ace0 0x7fcca006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcca40090b0 tx=0x7fcca4008030 comp rx=0 tx=0).stop 2023-06-08T03:49:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 msgr2=0x7fccb41e38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 0x7fccb41e38b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcca80011e0 tx=0x7fcca800cae0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 shutdown_connections 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcca006ace0 0x7fcca006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb4069db0 0x7fccb41e38b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb40b4e10 0x7fccb4158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 --2- 172.21.15.43:0/3503615961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccb40ae9f0 0x7fccb4151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 >> 172.21.15.43:0/3503615961 conn(0x7fccb406d180 msgr2=0x7fccb40b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 shutdown_connections 2023-06-08T03:49:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.228+0000 7fccb93f7700 1 -- 172.21.15.43:0/3503615961 wait complete. 2023-06-08T03:49:32.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:32.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:32.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.368+0000 7fbb85f29700 1 Processor -- start 2023-06-08T03:49:32.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.369+0000 7fbb85f29700 1 -- start start 2023-06-08T03:49:32.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.369+0000 7fbb85f29700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 0x7fbb800716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.369+0000 7fbb85f29700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb800ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.369+0000 7fbb85f29700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8006f480 con 0x7fbb800b1dc0 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.369+0000 7fbb85f29700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800b10d0 con 0x7fbb80159380 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.369+0000 7fbb85f29700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8006f760 con 0x7fbb800cd930 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7f7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 0x7fbb800716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb800ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7f7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 0x7fbb800716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:40998/0 (socket says 172.21.15.43:40998) 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb800ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:52842/0 (socket says 172.21.15.43:52842) 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7effd700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbb800b1dc0 0x7fbb800cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:41506/0 (socket says 172.21.15.43:41506) 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7f7fe700 1 -- 172.21.15.43:0/1521137908 learned_addr learned my addr 172.21.15.43:0/1521137908 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1521137908 >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 msgr2=0x7fbb800716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 --2- 172.21.15.43:0/1521137908 >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 0x7fbb800716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1521137908 >> v1:172.21.15.135:6789/0 conn(0x7fbb800b1dc0 legacy=0x7fbb800cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1521137908 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800b12e0 con 0x7fbb800cd930 2023-06-08T03:49:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7f7fe700 1 --2- 172.21.15.43:0/1521137908 >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 0x7fbb800716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7ffff700 1 --2- 172.21.15.43:0/1521137908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb800ca580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009d90 tx=0x7fbb7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca0e07fb964e19e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7e7fc700 1 -- 172.21.15.43:0/1521137908 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800e070 con 0x7fbb800cd930 2023-06-08T03:49:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7e7fc700 1 -- 172.21.15.43:0/1521137908 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7800bb20 con 0x7fbb800cd930 2023-06-08T03:49:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.370+0000 7fbb7e7fc700 1 -- 172.21.15.43:0/1521137908 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78012430 con 0x7fbb800cd930 2023-06-08T03:49:32.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 -- 172.21.15.43:0/1521137908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 msgr2=0x7fbb800ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1521137908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb800ca580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009d90 tx=0x7fbb7800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 -- 172.21.15.43:0/1521137908 shutdown_connections 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1521137908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb800ca580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1521137908 >> v2:172.21.15.135:3300/0 conn(0x7fbb80159380 0x7fbb800716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 -- 172.21.15.43:0/1521137908 >> 172.21.15.43:0/1521137908 conn(0x7fbb8006aec0 msgr2=0x7fbb8006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 -- 172.21.15.43:0/1521137908 shutdown_connections 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.371+0000 7fbb85f29700 1 -- 172.21.15.43:0/1521137908 wait complete. 2023-06-08T03:49:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.372+0000 7fbb85f29700 1 Processor -- start 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.372+0000 7fbb85f29700 1 -- start start 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb85f29700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb800b1dc0 0x7fbb800c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb85f29700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb801f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb85f29700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 0x7fbb800c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb85f29700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb801f0810 con 0x7fbb80159380 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb85f29700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800c3af0 con 0x7fbb800b1dc0 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb85f29700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800c3d40 con 0x7fbb800cd930 2023-06-08T03:49:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 0x7fbb800c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 0x7fbb800c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59392/0 (socket says 172.21.15.43:59392) 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1692607004 learned_addr learned my addr 172.21.15.43:0/1692607004 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb7effd700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb801f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.373+0000 7fbb7f7fe700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb800b1dc0 0x7fbb800c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 msgr2=0x7fbb801f02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb7ffff700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb801f02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb800b1dc0 msgr2=0x7fbb800c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb7ffff700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb800b1dc0 0x7fbb800c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb7ffff700 1 -- 172.21.15.43:0/1692607004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009550 con 0x7fbb80159380 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb7ffff700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 0x7fbb800c5cb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb78013000 tx=0x7fbb78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78012430 con 0x7fbb80159380 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb78020070 con 0x7fbb80159380 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78009a70 con 0x7fbb80159380 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78003ea0 con 0x7fbb80159380 2023-06-08T03:49:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.374+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800c94b0 con 0x7fbb80159380 2023-06-08T03:49:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.375+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800c4260 con 0x7fbb80159380 2023-06-08T03:49:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.375+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb78004040 con 0x7fbb80159380 2023-06-08T03:49:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.376+0000 7fbb77fff700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb6006ace0 0x7fbb6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.376+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb78022070 con 0x7fbb80159380 2023-06-08T03:49:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.376+0000 7fbb7f7fe700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb6006ace0 0x7fbb6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.377+0000 7fbb7f7fe700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb6006ace0 0x7fbb6006d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb70006d30 tx=0x7fbb700092c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.380+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb800c4260 con 0x7fbb80159380 2023-06-08T03:49:32.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.577+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb800c4260 con 0x7fbb80159380 2023-06-08T03:49:32.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.578+0000 7fbb77fff700 1 -- 172.21.15.43:0/1692607004 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb800c4260 con 0x7fbb80159380 2023-06-08T03:49:32.581 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:32.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb6006ace0 msgr2=0x7fbb6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb6006ace0 0x7fbb6006d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb70006d30 tx=0x7fbb700092c0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 msgr2=0x7fbb800c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 0x7fbb800c5cb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb78013000 tx=0x7fbb78004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 shutdown_connections 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb6006ace0 0x7fbb6006d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb80159380 0x7fbb800c5cb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb800b1dc0 0x7fbb800c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 --2- 172.21.15.43:0/1692607004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb800cd930 0x7fbb801f02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 >> 172.21.15.43:0/1692607004 conn(0x7fbb8006aec0 msgr2=0x7fbb800b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:32.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 shutdown_connections 2023-06-08T03:49:32.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.580+0000 7fbb85f29700 1 -- 172.21.15.43:0/1692607004 wait complete. 2023-06-08T03:49:32.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:32.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.719+0000 7f29946ae700 1 Processor -- start 2023-06-08T03:49:32.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.719+0000 7f29946ae700 1 -- start start 2023-06-08T03:49:32.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.720+0000 7f29946ae700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c15a150 0x7f298c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.720+0000 7f29946ae700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f298c0cb690 0x7f298c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.720+0000 7f29946ae700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c06a730 con 0x7f298c06a2f0 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.720+0000 7f29946ae700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c15b6c0 con 0x7f298c0cb690 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.720+0000 7f29946ae700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c072200 con 0x7f298c15a150 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f298c0cb690 0x7f298c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2992c4b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f298c06a2f0 0x7f298c0cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54304/0 (socket says 172.21.15.43:54304) 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f298c0cb690 0x7f298c069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59398/0 (socket says 172.21.15.43:59398) 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2992c4b700 1 -- 172.21.15.43:0/2878966709 learned_addr learned my addr 172.21.15.43:0/2878966709 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:32.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f299244a700 1 --2- 172.21.15.43:0/2878966709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c15a150 0x7f298c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 -- 172.21.15.43:0/2878966709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c15a150 msgr2=0x7f298c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 --2- 172.21.15.43:0/2878966709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c15a150 0x7f298c15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 -- 172.21.15.43:0/2878966709 >> v1:172.21.15.43:6789/0 conn(0x7f298c06a2f0 legacy=0x7f298c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 -- 172.21.15.43:0/2878966709 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c15a520 con 0x7f298c0cb690 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991448700 1 -- 172.21.15.43:0/2878966709 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521772299 0 0) 0x7f298c06a730 con 0x7f298c06a2f0 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991c49700 1 --2- 172.21.15.43:0/2878966709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c0cb690 0x7f298c069db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f297c009840 tx=0x7f297c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1cd71b766bae2d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991448700 1 -- 172.21.15.43:0/2878966709 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c011830 con 0x7f298c0cb690 2023-06-08T03:49:32.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991448700 1 -- 172.21.15.43:0/2878966709 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c011990 con 0x7f298c0cb690 2023-06-08T03:49:32.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.721+0000 7f2991448700 1 -- 172.21.15.43:0/2878966709 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c011d20 con 0x7f298c0cb690 2023-06-08T03:49:32.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 -- 172.21.15.43:0/2878966709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c0cb690 msgr2=0x7f298c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 --2- 172.21.15.43:0/2878966709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c0cb690 0x7f298c069db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f297c009840 tx=0x7f297c009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:32.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 -- 172.21.15.43:0/2878966709 shutdown_connections 2023-06-08T03:49:32.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 --2- 172.21.15.43:0/2878966709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c15a150 0x7f298c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 --2- 172.21.15.43:0/2878966709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c0cb690 0x7f298c069db0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 -- 172.21.15.43:0/2878966709 >> 172.21.15.43:0/2878966709 conn(0x7f298c06aec0 msgr2=0x7f298c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:32.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 -- 172.21.15.43:0/2878966709 shutdown_connections 2023-06-08T03:49:32.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.722+0000 7f29946ae700 1 -- 172.21.15.43:0/2878966709 wait complete. 2023-06-08T03:49:32.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.723+0000 7f29946ae700 1 Processor -- start 2023-06-08T03:49:32.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.723+0000 7f29946ae700 1 -- start start 2023-06-08T03:49:32.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f29946ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c06a2f0 0x7f298c153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f29946ae700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c0cb690 0x7f298c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f29946ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 0x7f298c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f29946ae700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c6b80 con 0x7f298c15a150 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f29946ae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c68c0 con 0x7f298c06a2f0 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f29946ae700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c4580 con 0x7f298c0cb690 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 0x7f298c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 0x7f298c0b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59404/0 (socket says 172.21.15.43:59404) 2023-06-08T03:49:32.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 -- 172.21.15.43:0/915179874 learned_addr learned my addr 172.21.15.43:0/915179874 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:32.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f299244a700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c06a2f0 0x7f298c153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2991c49700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c0cb690 0x7f298c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 -- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c0cb690 msgr2=0x7f298c0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c0cb690 0x7f298c0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 -- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c06a2f0 msgr2=0x7f298c153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c06a2f0 0x7f298c153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.724+0000 7f2992c4b700 1 -- 172.21.15.43:0/915179874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0094a0 con 0x7f298c15a150 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.725+0000 7f2992c4b700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 0x7f298c0b00e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f298400cc70 tx=0x7f298400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.725+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400aac0 con 0x7f298c15a150 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.725+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400ac40 con 0x7f298c15a150 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.725+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c0c4860 con 0x7f298c15a150 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.725+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29840070d0 con 0x7f298c15a150 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.725+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c0c4e20 con 0x7f298c15a150 2023-06-08T03:49:32.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.726+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c0c6cf0 con 0x7f298c15a150 2023-06-08T03:49:32.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.726+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2984007250 con 0x7f298c15a150 2023-06-08T03:49:32.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.727+0000 7f2982ffd700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f297006ace0 0x7f297006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:32.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.727+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29840894c0 con 0x7f298c15a150 2023-06-08T03:49:32.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.727+0000 7f299244a700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f297006ace0 0x7f297006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:32.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.727+0000 7f299244a700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f297006ace0 0x7f297006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2988009b40 tx=0x7f2988009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:32.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.731+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f298c0c6cf0 con 0x7f298c15a150 2023-06-08T03:49:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.926+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f298c0c6cc0 con 0x7f298c15a150 2023-06-08T03:49:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.926+0000 7f2982ffd700 1 -- 172.21.15.43:0/915179874 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2984054310 con 0x7f298c15a150 2023-06-08T03:49:32.930 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f297006ace0 msgr2=0x7f297006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f297006ace0 0x7f297006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2988009b40 tx=0x7f2988009210 comp rx=0 tx=0).stop 2023-06-08T03:49:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 msgr2=0x7f298c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 0x7f298c0b00e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f298400cc70 tx=0x7f298400cf80 comp rx=0 tx=0).stop 2023-06-08T03:49:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 shutdown_connections 2023-06-08T03:49:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f297006ace0 0x7f297006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f298c15a150 0x7f298c0b00e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c06a2f0 0x7f298c153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 --2- 172.21.15.43:0/915179874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f298c0cb690 0x7f298c0c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 >> 172.21.15.43:0/915179874 conn(0x7f298c06aec0 msgr2=0x7f298c06a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 shutdown_connections 2023-06-08T03:49:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:32.928+0000 7f29946ae700 1 -- 172.21.15.43:0/915179874 wait complete. 2023-06-08T03:49:32.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:33.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.068+0000 7fa3db6b2700 1 Processor -- start 2023-06-08T03:49:33.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.068+0000 7fa3db6b2700 1 -- start start 2023-06-08T03:49:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3db6b2700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3d415c520 0x7fa3d4071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3db6b2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3db6b2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d415c8f0 con 0x7fa3d406a2f0 2023-06-08T03:49:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3db6b2700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d40cd940 con 0x7fa3d415c520 2023-06-08T03:49:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3db6b2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d406a770 con 0x7fa3d40cee20 2023-06-08T03:49:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3d944e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3d415c520 0x7fa3d4071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3d944e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3d415c520 0x7fa3d4071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59410/0 (socket says 172.21.15.43:59410) 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.069+0000 7fa3d944e700 1 -- 172.21.15.43:0/2412019703 learned_addr learned my addr 172.21.15.43:0/2412019703 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3d944e700 1 -- 172.21.15.43:0/2412019703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 msgr2=0x7fa3d4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3d944e700 1 --2- 172.21.15.43:0/2412019703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3d944e700 1 -- 172.21.15.43:0/2412019703 >> v1:172.21.15.135:6789/0 conn(0x7fa3d406a2f0 legacy=0x7fa3d40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3d944e700 1 -- 172.21.15.43:0/2412019703 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40cd3c0 con 0x7fa3d415c520 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3d944e700 1 --2- 172.21.15.43:0/2412019703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d4071560 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40098f0 tx=0x7fa3c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa39e6dd55e28eae server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3cbfff700 1 -- 172.21.15.43:0/2412019703 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4004230 con 0x7fa3d415c520 2023-06-08T03:49:33.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3cbfff700 1 -- 172.21.15.43:0/2412019703 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c4004390 con 0x7fa3d415c520 2023-06-08T03:49:33.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.070+0000 7fa3cbfff700 1 -- 172.21.15.43:0/2412019703 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40036a0 con 0x7fa3d415c520 2023-06-08T03:49:33.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 -- 172.21.15.43:0/2412019703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 msgr2=0x7fa3d4071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/2412019703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d4071560 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40098f0 tx=0x7fa3c4009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:33.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 -- 172.21.15.43:0/2412019703 shutdown_connections 2023-06-08T03:49:33.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/2412019703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d4071560 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/2412019703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 -- 172.21.15.43:0/2412019703 >> 172.21.15.43:0/2412019703 conn(0x7fa3d406aec0 msgr2=0x7fa3d406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:33.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 -- 172.21.15.43:0/2412019703 shutdown_connections 2023-06-08T03:49:33.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.071+0000 7fa3db6b2700 1 -- 172.21.15.43:0/2412019703 wait complete. 2023-06-08T03:49:33.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.072+0000 7fa3db6b2700 1 Processor -- start 2023-06-08T03:49:33.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.072+0000 7fa3db6b2700 1 -- start start 2023-06-08T03:49:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3d406a2f0 0x7fa3d41e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d415ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40c58c0 con 0x7fa3d415c520 2023-06-08T03:49:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40c4c40 con 0x7fa3d406a2f0 2023-06-08T03:49:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40c4f20 con 0x7fa3d40cee20 2023-06-08T03:49:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d415ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d415ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59418/0 (socket says 172.21.15.43:59418) 2023-06-08T03:49:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 -- 172.21.15.43:0/1152868218 learned_addr learned my addr 172.21.15.43:0/1152868218 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d944e700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3d406a2f0 0x7fa3d41e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d8c4d700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 -- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 msgr2=0x7fa3d4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 -- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3d406a2f0 msgr2=0x7fa3d41e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3d406a2f0 0x7fa3d41e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 -- 172.21.15.43:0/1152868218 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009550 con 0x7fa3d415c520 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d8c4d700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3d9c4f700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d415ec60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00cc10 tx=0x7fa3cc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00ab10 con 0x7fa3d415c520 2023-06-08T03:49:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00ac70 con 0x7fa3d415c520 2023-06-08T03:49:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d40c5200 con 0x7fa3d415c520 2023-06-08T03:49:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.073+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc012420 con 0x7fa3d415c520 2023-06-08T03:49:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.074+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d41e7700 con 0x7fa3d415c520 2023-06-08T03:49:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.075+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d40c5a00 con 0x7fa3d415c520 2023-06-08T03:49:33.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.075+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3cc012580 con 0x7fa3d415c520 2023-06-08T03:49:33.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.075+0000 7fa3c9ffb700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3b806ace0 0x7fa3b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.075+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3cc089aa0 con 0x7fa3d415c520 2023-06-08T03:49:33.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.076+0000 7fa3d944e700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3b806ace0 0x7fa3b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.076+0000 7fa3d944e700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3b806ace0 0x7fa3b806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009130 tx=0x7fa3c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.080+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3cc0548f0 con 0x7fa3d415c520 2023-06-08T03:49:33.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.276+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3d40b1ac0 con 0x7fa3d415c520 2023-06-08T03:49:33.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.276+0000 7fa3c9ffb700 1 -- 172.21.15.43:0/1152868218 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3cc057f10 con 0x7fa3d415c520 2023-06-08T03:49:33.280 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3b806ace0 msgr2=0x7fa3b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3b806ace0 0x7fa3b806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009130 tx=0x7fa3c4008030 comp rx=0 tx=0).stop 2023-06-08T03:49:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 msgr2=0x7fa3d415ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d415ec60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00cc10 tx=0x7fa3cc00cf20 comp rx=0 tx=0).stop 2023-06-08T03:49:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 shutdown_connections 2023-06-08T03:49:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa3b806ace0 0x7fa3b806d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3d415c520 0x7fa3d415ec60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3d406a2f0 0x7fa3d41e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 --2- 172.21.15.43:0/1152868218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3d40cee20 0x7fa3d4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 >> 172.21.15.43:0/1152868218 conn(0x7fa3d406aec0 msgr2=0x7fa3d40ab9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 shutdown_connections 2023-06-08T03:49:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.278+0000 7fa3db6b2700 1 -- 172.21.15.43:0/1152868218 wait complete. 2023-06-08T03:49:33.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:33.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.417+0000 7f88eca21700 1 Processor -- start 2023-06-08T03:49:33.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.417+0000 7f88eca21700 1 -- start start 2023-06-08T03:49:33.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88eca21700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88e81588a0 0x7f88e806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88eca21700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88e8071010 0x7f88e815c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88eca21700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80cb5f0 con 0x7f88e806c2b0 2023-06-08T03:49:33.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88eca21700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80caec0 con 0x7f88e8071010 2023-06-08T03:49:33.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88eca21700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e806dbd0 con 0x7f88e81588a0 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88e6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88e8071010 0x7f88e815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88e6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88e8071010 0x7f88e815c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59426/0 (socket says 172.21.15.43:59426) 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.418+0000 7f88e6d9d700 1 -- 172.21.15.43:0/604228608 learned_addr learned my addr 172.21.15.43:0/604228608 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e659c700 1 --2- 172.21.15.43:0/604228608 >> v2:172.21.15.135:3300/0 conn(0x7f88e81588a0 0x7f88e806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e6d9d700 1 -- 172.21.15.43:0/604228608 >> v2:172.21.15.135:3300/0 conn(0x7f88e81588a0 msgr2=0x7f88e806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e6d9d700 1 --2- 172.21.15.43:0/604228608 >> v2:172.21.15.135:3300/0 conn(0x7f88e81588a0 0x7f88e806b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e6d9d700 1 -- 172.21.15.43:0/604228608 >> v1:172.21.15.135:6789/0 conn(0x7f88e806c2b0 legacy=0x7f88e8070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:33.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e6d9d700 1 -- 172.21.15.43:0/604228608 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e806deb0 con 0x7f88e8071010 2023-06-08T03:49:33.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e659c700 1 --2- 172.21.15.43:0/604228608 >> v2:172.21.15.135:3300/0 conn(0x7f88e81588a0 0x7f88e806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:33.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e6d9d700 1 --2- 172.21.15.43:0/604228608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8071010 0x7f88e815c820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88e80cff30 tx=0x7f88e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5200cbe61c92fd32 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e559a700 1 -- 172.21.15.43:0/604228608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000e070 con 0x7f88e8071010 2023-06-08T03:49:33.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e559a700 1 -- 172.21.15.43:0/604228608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0003a20 con 0x7f88e8071010 2023-06-08T03:49:33.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88e559a700 1 -- 172.21.15.43:0/604228608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0003dd0 con 0x7f88e8071010 2023-06-08T03:49:33.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88eca21700 1 -- 172.21.15.43:0/604228608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8071010 msgr2=0x7f88e815c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.419+0000 7f88eca21700 1 --2- 172.21.15.43:0/604228608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8071010 0x7f88e815c820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88e80cff30 tx=0x7f88e000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:33.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.420+0000 7f88eca21700 1 -- 172.21.15.43:0/604228608 shutdown_connections 2023-06-08T03:49:33.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.420+0000 7f88eca21700 1 --2- 172.21.15.43:0/604228608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8071010 0x7f88e815c820 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.420+0000 7f88eca21700 1 --2- 172.21.15.43:0/604228608 >> v2:172.21.15.135:3300/0 conn(0x7f88e81588a0 0x7f88e806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.420+0000 7f88eca21700 1 -- 172.21.15.43:0/604228608 >> 172.21.15.43:0/604228608 conn(0x7f88e80cee30 msgr2=0x7f88e80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:33.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.420+0000 7f88eca21700 1 -- 172.21.15.43:0/604228608 shutdown_connections 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.420+0000 7f88eca21700 1 -- 172.21.15.43:0/604228608 wait complete. 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.421+0000 7f88eca21700 1 Processor -- start 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.421+0000 7f88eca21700 1 -- start start 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88eca21700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 0x7f88e80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88eca21700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e8071010 0x7f88e815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88eca21700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88e81588a0 0x7f88e8151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88eca21700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e815a390 con 0x7f88e806c2b0 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88eca21700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8165dd0 con 0x7f88e8071010 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88eca21700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e815bca0 con 0x7f88e81588a0 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 0x7f88e80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 0x7f88e80ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59428/0 (socket says 172.21.15.43:59428) 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 -- 172.21.15.43:0/1011987096 learned_addr learned my addr 172.21.15.43:0/1011987096 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e6d9d700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88e81588a0 0x7f88e8151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 -- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88e81588a0 msgr2=0x7f88e8151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e5d9b700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e8071010 0x7f88e815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88e81588a0 0x7f88e8151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 -- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e8071010 msgr2=0x7f88e815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e8071010 0x7f88e815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 -- 172.21.15.43:0/1011987096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0009b30 con 0x7f88e806c2b0 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e6d9d700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88e81588a0 0x7f88e8151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e5d9b700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e8071010 0x7f88e815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.422+0000 7f88e659c700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 0x7f88e80ad410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00c7f0 tx=0x7f88dc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.423+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011800 con 0x7f88e806c2b0 2023-06-08T03:49:33.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.423+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc011960 con 0x7f88e806c2b0 2023-06-08T03:49:33.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.423+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e80b4730 con 0x7f88e806c2b0 2023-06-08T03:49:33.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.423+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011d10 con 0x7f88e806c2b0 2023-06-08T03:49:33.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.423+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e80b4170 con 0x7f88e806c2b0 2023-06-08T03:49:33.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.424+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e8073fa0 con 0x7f88e806c2b0 2023-06-08T03:49:33.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.424+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88dc018360 con 0x7f88e806c2b0 2023-06-08T03:49:33.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.424+0000 7f88d6ffd700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88c806ace0 0x7f88c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.425+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88dc089750 con 0x7f88e806c2b0 2023-06-08T03:49:33.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.425+0000 7f88e5d9b700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88c806ace0 0x7f88c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.425+0000 7f88e5d9b700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88c806ace0 0x7f88c806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88e8157a50 tx=0x7f88d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.429+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88dc057fa0 con 0x7f88e806c2b0 2023-06-08T03:49:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.624+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88e80b4db0 con 0x7f88e806c2b0 2023-06-08T03:49:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.624+0000 7f88d6ffd700 1 -- 172.21.15.43:0/1011987096 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88dc057b30 con 0x7f88e806c2b0 2023-06-08T03:49:33.627 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88c806ace0 msgr2=0x7f88c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88c806ace0 0x7f88c806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88e8157a50 tx=0x7f88d8009040 comp rx=0 tx=0).stop 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 msgr2=0x7f88e80ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 0x7f88e80ad410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00c7f0 tx=0x7f88dc00cbb0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 shutdown_connections 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88c806ace0 0x7f88c806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e806c2b0 0x7f88e80ad410 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88e81588a0 0x7f88e8151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 --2- 172.21.15.43:0/1011987096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e8071010 0x7f88e815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 >> 172.21.15.43:0/1011987096 conn(0x7f88e80cee30 msgr2=0x7f88e80cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:33.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 shutdown_connections 2023-06-08T03:49:33.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.626+0000 7f88eca21700 1 -- 172.21.15.43:0/1011987096 wait complete. 2023-06-08T03:49:33.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:33.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.767+0000 7f9481deb700 1 Processor -- start 2023-06-08T03:49:33.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.768+0000 7f9481deb700 1 -- start start 2023-06-08T03:49:33.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f9481deb700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f947c159380 0x7f947c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f9481deb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c0b1dc0 0x7f947c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f9481deb700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c06f480 con 0x7f947c071d50 2023-06-08T03:49:33.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f9481deb700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0b10d0 con 0x7f947c159380 2023-06-08T03:49:33.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f9481deb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0cb590 con 0x7f947c0b1dc0 2023-06-08T03:49:33.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f947bfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f947c071d50 0x7f947c15cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:41564/0 (socket says 172.21.15.43:41564) 2023-06-08T03:49:33.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.770+0000 7f947bfff700 1 -- 172.21.15.43:0/3728850261 learned_addr learned my addr 172.21.15.43:0/3728850261 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:33.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947affd700 1 --2- 172.21.15.43:0/3728850261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c0b1dc0 0x7f947c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947b7fe700 1 --2- 172.21.15.43:0/3728850261 >> v2:172.21.15.43:3300/0 conn(0x7f947c159380 0x7f947c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947a7fc700 1 -- 172.21.15.43:0/3728850261 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484649984 0 0) 0x7f947c06f480 con 0x7f947c071d50 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947a7fc700 1 -- 172.21.15.43:0/3728850261 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94640035b0 con 0x7f947c071d50 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947affd700 1 -- 172.21.15.43:0/3728850261 >> v2:172.21.15.43:3300/0 conn(0x7f947c159380 msgr2=0x7f947c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947affd700 1 --2- 172.21.15.43:0/3728850261 >> v2:172.21.15.43:3300/0 conn(0x7f947c159380 0x7f947c0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947affd700 1 -- 172.21.15.43:0/3728850261 >> v1:172.21.15.135:6789/0 conn(0x7f947c071d50 legacy=0x7f947c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947affd700 1 -- 172.21.15.43:0/3728850261 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c06f760 con 0x7f947c0b1dc0 2023-06-08T03:49:33.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.771+0000 7f947b7fe700 1 --2- 172.21.15.43:0/3728850261 >> v2:172.21.15.43:3300/0 conn(0x7f947c159380 0x7f947c0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.772+0000 7f947affd700 1 --2- 172.21.15.43:0/3728850261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c0b1dc0 0x7f947c0cd220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f946c009840 tx=0x7f946c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5bf6b2dfd4b3a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.772+0000 7f947a7fc700 1 -- 172.21.15.43:0/3728850261 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c011830 con 0x7f947c0b1dc0 2023-06-08T03:49:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.772+0000 7f947a7fc700 1 -- 172.21.15.43:0/3728850261 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c011990 con 0x7f947c0b1dc0 2023-06-08T03:49:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.772+0000 7f947a7fc700 1 -- 172.21.15.43:0/3728850261 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c011d20 con 0x7f947c0b1dc0 2023-06-08T03:49:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 -- 172.21.15.43:0/3728850261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c0b1dc0 msgr2=0x7f947c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 --2- 172.21.15.43:0/3728850261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c0b1dc0 0x7f947c0cd220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f946c009840 tx=0x7f946c009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 -- 172.21.15.43:0/3728850261 shutdown_connections 2023-06-08T03:49:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 --2- 172.21.15.43:0/3728850261 >> v2:172.21.15.43:3300/0 conn(0x7f947c159380 0x7f947c0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 --2- 172.21.15.43:0/3728850261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c0b1dc0 0x7f947c0cd220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 -- 172.21.15.43:0/3728850261 >> 172.21.15.43:0/3728850261 conn(0x7f947c06aec0 msgr2=0x7f947c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 -- 172.21.15.43:0/3728850261 shutdown_connections 2023-06-08T03:49:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.773+0000 7f9481deb700 1 -- 172.21.15.43:0/3728850261 wait complete. 2023-06-08T03:49:33.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.774+0000 7f9481deb700 1 Processor -- start 2023-06-08T03:49:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 -- start start 2023-06-08T03:49:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f947c071d50 0x7f947c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 0x7f947c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c159380 0x7f947c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0c3ed0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0c57d0 con 0x7f947c071d50 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f9481deb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0b4cf0 con 0x7f947c159380 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f947affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 0x7f947c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f947affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 0x7f947c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59444/0 (socket says 172.21.15.43:59444) 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.775+0000 7f947affd700 1 -- 172.21.15.43:0/1268521798 learned_addr learned my addr 172.21.15.43:0/1268521798 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947b7fe700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f947c071d50 0x7f947c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947bfff700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c159380 0x7f947c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947affd700 1 -- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c159380 msgr2=0x7f947c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947affd700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c159380 0x7f947c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947affd700 1 -- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f947c071d50 msgr2=0x7f947c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947affd700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f947c071d50 0x7f947c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947affd700 1 -- 172.21.15.43:0/1268521798 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0094a0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f947affd700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 0x7f947c0c5c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f946c009fd0 tx=0x7f946c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0036a0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c01f070 con 0x7f947c0b1dc0 2023-06-08T03:49:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c003a40 con 0x7f947c0b1dc0 2023-06-08T03:49:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c0b4fd0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.776+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c0c5460 con 0x7f947c0b1dc0 2023-06-08T03:49:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.777+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c0c5620 con 0x7f947c0b1dc0 2023-06-08T03:49:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.778+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f946c003ba0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.778+0000 7f9463fff700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f946806ace0 0x7f946806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:33.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.778+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f946c021070 con 0x7f947c0b1dc0 2023-06-08T03:49:33.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.778+0000 7f947b7fe700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f946806ace0 0x7f946806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:33.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.779+0000 7f947b7fe700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f946806ace0 0x7f946806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f947c0c97f0 tx=0x7f9474009890 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:33.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.782+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f946c08f070 con 0x7f947c0b1dc0 2023-06-08T03:49:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.978+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f947c0c52c0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.978+0000 7f9463fff700 1 -- 172.21.15.43:0/1268521798 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f947c0c52c0 con 0x7f947c0b1dc0 2023-06-08T03:49:33.982 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:33.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f946806ace0 msgr2=0x7f946806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f946806ace0 0x7f946806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f947c0c97f0 tx=0x7f9474009890 comp rx=0 tx=0).stop 2023-06-08T03:49:33.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 msgr2=0x7f947c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:33.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 0x7f947c0c5c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f946c009fd0 tx=0x7f946c004750 comp rx=0 tx=0).stop 2023-06-08T03:49:33.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 shutdown_connections 2023-06-08T03:49:33.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f946806ace0 0x7f946806d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f947c159380 0x7f947c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f947c071d50 0x7f947c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 --2- 172.21.15.43:0/1268521798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f947c0b1dc0 0x7f947c0c5c60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:33.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 >> 172.21.15.43:0/1268521798 conn(0x7f947c06aec0 msgr2=0x7f947c156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:33.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 shutdown_connections 2023-06-08T03:49:33.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:33.980+0000 7f9481deb700 1 -- 172.21.15.43:0/1268521798 wait complete. 2023-06-08T03:49:34.003 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-08T03:49:34.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-08T03:49:34.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.127+0000 7f6e1db88700 1 Processor -- start 2023-06-08T03:49:34.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.127+0000 7f6e1db88700 1 -- start start 2023-06-08T03:49:34.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.127+0000 7f6e1db88700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6e1806a4c0 0x7f6e180af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.127+0000 7f6e1db88700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e180ccba0 0x7f6e180b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.127+0000 7f6e1db88700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180af050 con 0x7f6e1815c590 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.127+0000 7f6e1db88700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e180afae0 con 0x7f6e1806a4c0 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e1db88700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180ccfe0 con 0x7f6e180ccba0 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6e1806a4c0 0x7f6e180af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e177fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6e1815c590 0x7f6e18069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54354/0 (socket says 172.21.15.43:54354) 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6e1806a4c0 0x7f6e180af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59452/0 (socket says 172.21.15.43:59452) 2023-06-08T03:49:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e177fe700 1 -- 172.21.15.43:0/1020075451 learned_addr learned my addr 172.21.15.43:0/1020075451 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e17fff700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e180ccba0 0x7f6e180b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 -- 172.21.15.43:0/1020075451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e180ccba0 msgr2=0x7f6e180b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e180ccba0 0x7f6e180b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 -- 172.21.15.43:0/1020075451 >> v1:172.21.15.43:6789/0 conn(0x7f6e1815c590 legacy=0x7f6e18069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e167fc700 1 -- 172.21.15.43:0/1020075451 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498019244 0 0) 0x7f6e180af050 con 0x7f6e1815c590 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 -- 172.21.15.43:0/1020075451 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180af800 con 0x7f6e1806a4c0 2023-06-08T03:49:34.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e17fff700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e180ccba0 0x7f6e180b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e16ffd700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e1806a4c0 0x7f6e180af220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009840 tx=0x7f6e00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6146e8c2e79c7bbf server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e167fc700 1 -- 172.21.15.43:0/1020075451 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00011830 con 0x7f6e1806a4c0 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e167fc700 1 -- 172.21.15.43:0/1020075451 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00011990 con 0x7f6e1806a4c0 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.128+0000 7f6e167fc700 1 -- 172.21.15.43:0/1020075451 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00011d20 con 0x7f6e1806a4c0 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 -- 172.21.15.43:0/1020075451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e1806a4c0 msgr2=0x7f6e180af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e1806a4c0 0x7f6e180af220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009840 tx=0x7f6e00009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 -- 172.21.15.43:0/1020075451 shutdown_connections 2023-06-08T03:49:34.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e180ccba0 0x7f6e180b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 --2- 172.21.15.43:0/1020075451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e1806a4c0 0x7f6e180af220 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 -- 172.21.15.43:0/1020075451 >> 172.21.15.43:0/1020075451 conn(0x7f6e1806b7e0 msgr2=0x7f6e180cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 -- 172.21.15.43:0/1020075451 shutdown_connections 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.129+0000 7f6e1db88700 1 -- 172.21.15.43:0/1020075451 wait complete. 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.130+0000 7f6e1db88700 1 Processor -- start 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.130+0000 7f6e1db88700 1 -- start start 2023-06-08T03:49:34.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e1db88700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1806a4c0 0x7f6e1815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e1db88700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 0x7f6e18159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e1db88700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e1815c590 0x7f6e180b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e1db88700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1815a520 con 0x7f6e180ccba0 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e1db88700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180c7000 con 0x7f6e1806a4c0 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e1db88700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180b2840 con 0x7f6e1815c590 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 0x7f6e18159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 0x7f6e18159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59458/0 (socket says 172.21.15.43:59458) 2023-06-08T03:49:34.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 -- 172.21.15.43:0/3230760913 learned_addr learned my addr 172.21.15.43:0/3230760913 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e17fff700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e1815c590 0x7f6e180b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e177fe700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1806a4c0 0x7f6e1815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 -- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e1815c590 msgr2=0x7f6e180b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e1815c590 0x7f6e180b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 -- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1806a4c0 msgr2=0x7f6e1815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1806a4c0 0x7f6e1815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e16ffd700 1 -- 172.21.15.43:0/3230760913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000094a0 con 0x7f6e180ccba0 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e17fff700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e1815c590 0x7f6e180b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.131+0000 7f6e177fe700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1806a4c0 0x7f6e1815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.132+0000 7f6e16ffd700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 0x7f6e18159fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6e000090b0 tx=0x7f6e00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.132+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000038a0 con 0x7f6e180ccba0 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.132+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0001f070 con 0x7f6e180ccba0 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.132+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e180b2b20 con 0x7f6e180ccba0 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.132+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00003c60 con 0x7f6e180ccba0 2023-06-08T03:49:34.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.132+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e180b24d0 con 0x7f6e180ccba0 2023-06-08T03:49:34.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.133+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e180c71c0 con 0x7f6e180ccba0 2023-06-08T03:49:34.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.133+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e0001a430 con 0x7f6e180ccba0 2023-06-08T03:49:34.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.134+0000 7f6e0ffff700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6df806ace0 0x7f6df806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.134+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6e00021070 con 0x7f6e180ccba0 2023-06-08T03:49:34.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.134+0000 7f6e177fe700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6df806ace0 0x7f6df806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.135+0000 7f6e177fe700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6df806ace0 0x7f6df806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e1806e4c0 tx=0x7f6e08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:34.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.138+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e000560c0 con 0x7f6e180ccba0 2023-06-08T03:49:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.417+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f6e18073fa0 con 0x7f6e180ccba0 2023-06-08T03:49:34.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.774+0000 7f6e0ffff700 1 -- 172.21.15.43:0/3230760913 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v61) v1 ==== 147+0+0 (secure 0 0 0) 0x7f6e000596e0 con 0x7f6e180ccba0 2023-06-08T03:49:34.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6df806ace0 msgr2=0x7f6df806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6df806ace0 0x7f6df806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e1806e4c0 tx=0x7f6e08009040 comp rx=0 tx=0).stop 2023-06-08T03:49:34.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 msgr2=0x7f6e18159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 0x7f6e18159fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6e000090b0 tx=0x7f6e00004750 comp rx=0 tx=0).stop 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 shutdown_connections 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6df806ace0 0x7f6df806d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e1815c590 0x7f6e180b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1806a4c0 0x7f6e1815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 --2- 172.21.15.43:0/3230760913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e180ccba0 0x7f6e18159fe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 >> 172.21.15.43:0/3230760913 conn(0x7f6e1806b7e0 msgr2=0x7f6e180b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:34.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 shutdown_connections 2023-06-08T03:49:34.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.777+0000 7f6e1db88700 1 -- 172.21.15.43:0/3230760913 wait complete. 2023-06-08T03:49:34.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-08T03:49:34.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.917+0000 7f0d584d9700 1 Processor -- start 2023-06-08T03:49:34.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.917+0000 7f0d584d9700 1 -- start start 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d584d9700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d5015c5c0 0x7f0d50071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d584d9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 0x7f0d500cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d584d9700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5015c990 con 0x7f0d50069db0 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d584d9700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d500cd2c0 con 0x7f0d5015c5c0 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d584d9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500cd5a0 con 0x7f0d500b1a80 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d56a76700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0d50069db0 0x7f0d500b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54372/0 (socket says 172.21.15.43:54372) 2023-06-08T03:49:34.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d56a76700 1 -- 172.21.15.43:0/4040326869 learned_addr learned my addr 172.21.15.43:0/4040326869 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811509627 0 0) 0x7f0d5015c990 con 0x7f0d50069db0 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d3c0035b0 con 0x7f0d50069db0 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d55a74700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 0x7f0d500cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.918+0000 7f0d56275700 1 --2- 172.21.15.43:0/4040326869 >> v2:172.21.15.135:3300/0 conn(0x7f0d5015c5c0 0x7f0d50071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514214191 0 0) 0x7f0d3c0035b0 con 0x7f0d50069db0 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 msgr2=0x7f0d500cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:34.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 0x7f0d500cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 >> v2:172.21.15.135:3300/0 conn(0x7f0d5015c5c0 msgr2=0x7f0d50071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 --2- 172.21.15.43:0/4040326869 >> v2:172.21.15.135:3300/0 conn(0x7f0d5015c5c0 0x7f0d50071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50071320 con 0x7f0d50069db0 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f0d480019f0 con 0x7f0d50069db0 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 >> v1:172.21.15.43:6789/0 conn(0x7f0d50069db0 legacy=0x7f0d500b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c003a00 0x7f0d3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 0x7f0d3c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c004d90 0x7f0d3c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500cd2c0 con 0x7f0d3c003a00 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500cd5a0 con 0x7f0d3c004d90 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c00ba10 con 0x7f0d500b1a80 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c003a00 0x7f0d3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56a76700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c004d90 0x7f0d3c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d55a74700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 0x7f0d3c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 -- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 msgr2=0x7f0d3c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d500b1a80 0x7f0d3c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 -- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c004d90 msgr2=0x7f0d3c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c004d90 0x7f0d3c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 -- 172.21.15.43:0/4040326869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0035b0 con 0x7f0d3c003a00 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.919+0000 7f0d56275700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c003a00 0x7f0d3c003e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009b60 tx=0x7f0d3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0de5198c414a78 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000e6c0 con 0x7f0d3c003a00 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000e820 con 0x7f0d3c003a00 2023-06-08T03:49:34.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d55273700 1 -- 172.21.15.43:0/4040326869 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000eb90 con 0x7f0d3c003a00 2023-06-08T03:49:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d584d9700 1 -- 172.21.15.43:0/4040326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c003a00 msgr2=0x7f0d3c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d584d9700 1 --2- 172.21.15.43:0/4040326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c003a00 0x7f0d3c003e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009b60 tx=0x7f0d3c005880 comp rx=0 tx=0).stop 2023-06-08T03:49:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d56a76700 1 -- 172.21.15.43:0/4040326869 reap_dead start 2023-06-08T03:49:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d584d9700 1 -- 172.21.15.43:0/4040326869 shutdown_connections 2023-06-08T03:49:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d584d9700 1 -- 172.21.15.43:0/4040326869 >> 172.21.15.43:0/4040326869 conn(0x7f0d5006aec0 msgr2=0x7f0d5006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d584d9700 1 -- 172.21.15.43:0/4040326869 shutdown_connections 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.920+0000 7f0d584d9700 1 -- 172.21.15.43:0/4040326869 wait complete. 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.921+0000 7f0d584d9700 1 Processor -- start 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.921+0000 7f0d584d9700 1 -- start start 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d584d9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c003a00 0x7f0d500c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d584d9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 0x7f0d501464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d584d9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d501469f0 0x7f0d5006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d584d9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50147490 con 0x7f0d501576d0 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d584d9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50144920 con 0x7f0d3c003a00 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d584d9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50146ed0 con 0x7f0d501469f0 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d55a74700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 0x7f0d501464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d55a74700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 0x7f0d501464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59478/0 (socket says 172.21.15.43:59478) 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d55a74700 1 -- 172.21.15.43:0/3523994085 learned_addr learned my addr 172.21.15.43:0/3523994085 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:34.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.922+0000 7f0d56275700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c003a00 0x7f0d500c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d56a76700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d501469f0 0x7f0d5006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d55a74700 1 -- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d501469f0 msgr2=0x7f0d5006f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d55a74700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d501469f0 0x7f0d5006f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d55a74700 1 -- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c003a00 msgr2=0x7f0d500c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d55a74700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c003a00 0x7f0d500c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d55a74700 1 -- 172.21.15.43:0/3523994085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d501471b0 con 0x7f0d501576d0 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d56275700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c003a00 0x7f0d500c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:34.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d55a74700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 0x7f0d501464b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c011ad0 tx=0x7f0d4c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00f9a0 con 0x7f0d501576d0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00fb00 con 0x7f0d501576d0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d501445b0 con 0x7f0d501576d0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00feb0 con 0x7f0d501576d0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.923+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5006f770 con 0x7f0d501576d0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.924+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5006f9f0 con 0x7f0d501576d0 2023-06-08T03:49:34.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.924+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d4c014440 con 0x7f0d501576d0 2023-06-08T03:49:34.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.925+0000 7f0d46ffd700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d3406ace0 0x7f0d3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:34.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.925+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d4c089e80 con 0x7f0d501576d0 2023-06-08T03:49:34.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.925+0000 7f0d56275700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d3406ace0 0x7f0d3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:34.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.925+0000 7f0d56275700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d3406ace0 0x7f0d3406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d400090b0 tx=0x7f0d40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:34.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:34.929+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d4c0587e0 con 0x7f0d501576d0 2023-06-08T03:49:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.128+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d50073fa0 con 0x7f0d501576d0 2023-06-08T03:49:35.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.132+0000 7f0d46ffd700 1 -- 172.21.15.43:0/3523994085 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d4c058370 con 0x7f0d501576d0 2023-06-08T03:49:35.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d3406ace0 msgr2=0x7f0d3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d3406ace0 0x7f0d3406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d400090b0 tx=0x7f0d40008030 comp rx=0 tx=0).stop 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 msgr2=0x7f0d501464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 0x7f0d501464b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c011ad0 tx=0x7f0d4c011e90 comp rx=0 tx=0).stop 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 shutdown_connections 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0d3406ace0 0x7f0d3406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d501469f0 0x7f0d5006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c003a00 0x7f0d500c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 --2- 172.21.15.43:0/3523994085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d501576d0 0x7f0d501464b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 >> 172.21.15.43:0/3523994085 conn(0x7f0d5006aec0 msgr2=0x7f0d500b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:35.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 shutdown_connections 2023-06-08T03:49:35.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.134+0000 7f0d584d9700 1 -- 172.21.15.43:0/3523994085 wait complete. 2023-06-08T03:49:35.149 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-08T03:49:35.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-08T03:49:35.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-08T03:49:35.255 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-08T03:49:35.256 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:35.256 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:35.273 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:35.273 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:35.330 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:35.331 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:35.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:35.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.550+0000 7f11d853d700 1 Processor -- start 2023-06-08T03:49:35.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.550+0000 7f11d853d700 1 -- start start 2023-06-08T03:49:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d853d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f11d01603c0 0x7f11d00b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d853d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00cdc60 con 0x7f11d00cd680 2023-06-08T03:49:35.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d853d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00cb4a0 con 0x7f11d015c0b0 2023-06-08T03:49:35.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d853d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00b2f60 con 0x7f11d01603c0 2023-06-08T03:49:35.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d5ad8700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f11d00cd680 0x7f11d015fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54390/0 (socket says 172.21.15.43:54390) 2023-06-08T03:49:35.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d5ad8700 1 -- 172.21.15.43:0/397780437 learned_addr learned my addr 172.21.15.43:0/397780437 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:35.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d6ada700 1 --2- 172.21.15.43:0/397780437 >> v2:172.21.15.43:3300/0 conn(0x7f11d01603c0 0x7f11d00b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d52d7700 1 -- 172.21.15.43:0/397780437 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447686634 0 0) 0x7f11d00cdc60 con 0x7f11d00cd680 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d52d7700 1 -- 172.21.15.43:0/397780437 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc0035b0 con 0x7f11d00cd680 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d6ada700 1 -- 172.21.15.43:0/397780437 >> v1:172.21.15.135:6789/0 conn(0x7f11d015c0b0 legacy=0x7f11d00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d6ada700 1 -- 172.21.15.43:0/397780437 >> v1:172.21.15.43:6789/0 conn(0x7f11d00cd680 legacy=0x7f11d015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.551+0000 7f11d6ada700 1 -- 172.21.15.43:0/397780437 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00cfdf0 con 0x7f11d01603c0 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d6ada700 1 --2- 172.21.15.43:0/397780437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d01603c0 0x7f11d00b2a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009d90 tx=0x7f11c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb5a7687f6309b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d52d7700 1 -- 172.21.15.43:0/397780437 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800e070 con 0x7f11d01603c0 2023-06-08T03:49:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d52d7700 1 -- 172.21.15.43:0/397780437 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c800bb20 con 0x7f11d01603c0 2023-06-08T03:49:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d52d7700 1 -- 172.21.15.43:0/397780437 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8012430 con 0x7f11d01603c0 2023-06-08T03:49:35.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 -- 172.21.15.43:0/397780437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d01603c0 msgr2=0x7f11d00b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 --2- 172.21.15.43:0/397780437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d01603c0 0x7f11d00b2a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009d90 tx=0x7f11c800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:35.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 -- 172.21.15.43:0/397780437 shutdown_connections 2023-06-08T03:49:35.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 --2- 172.21.15.43:0/397780437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d01603c0 0x7f11d00b2a20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 -- 172.21.15.43:0/397780437 >> 172.21.15.43:0/397780437 conn(0x7f11d0069db0 msgr2=0x7f11d006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:35.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 -- 172.21.15.43:0/397780437 shutdown_connections 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.552+0000 7f11d853d700 1 -- 172.21.15.43:0/397780437 wait complete. 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 Processor -- start 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 -- start start 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 0x7f11d0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11d015c0b0 0x7f11d00c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d01603c0 0x7f11d015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0151d70 con 0x7f11d00cd680 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b3570 con 0x7f11d01603c0 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d853d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b3850 con 0x7f11d015c0b0 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d62d9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 0x7f11d0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d62d9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 0x7f11d0151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59490/0 (socket says 172.21.15.43:59490) 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.554+0000 7f11d62d9700 1 -- 172.21.15.43:0/3615914950 learned_addr learned my addr 172.21.15.43:0/3615914950 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d6ada700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d01603c0 0x7f11d015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d5ad8700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11d015c0b0 0x7f11d00c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d62d9700 1 -- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11d015c0b0 msgr2=0x7f11d00c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d62d9700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11d015c0b0 0x7f11d00c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d62d9700 1 -- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d01603c0 msgr2=0x7f11d015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d62d9700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d01603c0 0x7f11d015c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d62d9700 1 -- 172.21.15.43:0/3615914950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009a70 con 0x7f11d00cd680 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d6ada700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d01603c0 0x7f11d015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d62d9700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 0x7f11d0151830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00c700 tx=0x7f11cc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0052d0 con 0x7f11d00cd680 2023-06-08T03:49:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc005430 con 0x7f11d00cd680 2023-06-08T03:49:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d00b3b30 con 0x7f11d00cd680 2023-06-08T03:49:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc003880 con 0x7f11d00cd680 2023-06-08T03:49:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.555+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d00b40f0 con 0x7f11d00cd680 2023-06-08T03:49:35.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.556+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d0073fa0 con 0x7f11d00cd680 2023-06-08T03:49:35.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.556+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11cc0039e0 con 0x7f11d00cd680 2023-06-08T03:49:35.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.557+0000 7f11c6ffd700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f11b406ace0 0x7f11b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.557+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11cc088b70 con 0x7f11d00cd680 2023-06-08T03:49:35.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.557+0000 7f11d5ad8700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f11b406ace0 0x7f11b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.558+0000 7f11d5ad8700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f11b406ace0 0x7f11b406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f11d01f5280 tx=0x7f11c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:35.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.561+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f11cc0539b0 con 0x7f11d00cd680 2023-06-08T03:49:35.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.761+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11d00b2720 con 0x7f11d00cd680 2023-06-08T03:49:35.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.762+0000 7f11c6ffd700 1 -- 172.21.15.43:0/3615914950 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f11cc056fd0 con 0x7f11d00cd680 2023-06-08T03:49:35.766 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:35.766 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:35.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f11b406ace0 msgr2=0x7f11b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f11b406ace0 0x7f11b406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f11d01f5280 tx=0x7f11c0009040 comp rx=0 tx=0).stop 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 msgr2=0x7f11d0151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 0x7f11d0151830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00c700 tx=0x7f11cc00cac0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 shutdown_connections 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f11b406ace0 0x7f11b406d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11d00cd680 0x7f11d0151830 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d01603c0 0x7f11d015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 --2- 172.21.15.43:0/3615914950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11d015c0b0 0x7f11d00c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 >> 172.21.15.43:0/3615914950 conn(0x7f11d0069db0 msgr2=0x7f11d006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:35.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 shutdown_connections 2023-06-08T03:49:35.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.764+0000 7f11d853d700 1 -- 172.21.15.43:0/3615914950 wait complete. 2023-06-08T03:49:35.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:35.781 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:35.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.905+0000 7fdfdca8c700 1 Processor -- start 2023-06-08T03:49:35.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.905+0000 7fdfdca8c700 1 -- start start 2023-06-08T03:49:35.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.906+0000 7fdfdca8c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdfd80cad90 0x7fdfd815e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.906+0000 7fdfdca8c700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80cda20 con 0x7fdfd80b60a0 2023-06-08T03:49:35.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.906+0000 7fdfdca8c700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd815a520 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.906+0000 7fdfdca8c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd80b6470 con 0x7fdfd80cad90 2023-06-08T03:49:35.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.906+0000 7fdfd659c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdfd80b60a0 0x7fdfd815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54402/0 (socket says 172.21.15.43:54402) 2023-06-08T03:49:35.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.906+0000 7fdfd659c700 1 -- 172.21.15.43:0/3833229890 learned_addr learned my addr 172.21.15.43:0/3833229890 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:35.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd6d9d700 1 --2- 172.21.15.43:0/3833229890 >> v2:172.21.15.135:3300/0 conn(0x7fdfd80cad90 0x7fdfd815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd559a700 1 -- 172.21.15.43:0/3833229890 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932404317 0 0) 0x7fdfd80cda20 con 0x7fdfd80b60a0 2023-06-08T03:49:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd559a700 1 -- 172.21.15.43:0/3833229890 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc00035b0 con 0x7fdfd80b60a0 2023-06-08T03:49:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/3833229890 >> v1:172.21.15.135:6789/0 conn(0x7fdfd80cf5b0 legacy=0x7fdfd80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd559a700 1 -- 172.21.15.43:0/3833229890 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10342975 0 0) 0x7fdfc00035b0 con 0x7fdfd80b60a0 2023-06-08T03:49:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/3833229890 >> v1:172.21.15.43:6789/0 conn(0x7fdfd80b60a0 legacy=0x7fdfd815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/3833229890 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd815ea40 con 0x7fdfd80cad90 2023-06-08T03:49:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd6d9d700 1 --2- 172.21.15.43:0/3833229890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80cad90 0x7fdfd815e340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009d90 tx=0x7fdfd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61171d85e4cb84ec server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd559a700 1 -- 172.21.15.43:0/3833229890 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000e070 con 0x7fdfd80cad90 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd559a700 1 -- 172.21.15.43:0/3833229890 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0003a20 con 0x7fdfd80cad90 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.907+0000 7fdfd559a700 1 -- 172.21.15.43:0/3833229890 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc001670 con 0x7fdfd80cad90 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 -- 172.21.15.43:0/3833229890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80cad90 msgr2=0x7fdfd815e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/3833229890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80cad90 0x7fdfd815e340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009d90 tx=0x7fdfd000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 -- 172.21.15.43:0/3833229890 shutdown_connections 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/3833229890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80cad90 0x7fdfd815e340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 -- 172.21.15.43:0/3833229890 >> 172.21.15.43:0/3833229890 conn(0x7fdfd8069db0 msgr2=0x7fdfd806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:35.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 -- 172.21.15.43:0/3833229890 shutdown_connections 2023-06-08T03:49:35.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.908+0000 7fdfdca8c700 1 -- 172.21.15.43:0/3833229890 wait complete. 2023-06-08T03:49:35.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.909+0000 7fdfdca8c700 1 Processor -- start 2023-06-08T03:49:35.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.909+0000 7fdfdca8c700 1 -- start start 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfdca8c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80b60a0 0x7fdfd8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfdca8c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd80cad90 0x7fdfd80ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfdca8c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 0x7fdfd80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfdca8c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd806b650 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfdca8c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8157eb0 con 0x7fdfd80b60a0 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfdca8c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80ca710 con 0x7fdfd80cad90 2023-06-08T03:49:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfd6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 0x7fdfd80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfd6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 0x7fdfd80ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59508/0 (socket says 172.21.15.43:59508) 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/29673748 learned_addr learned my addr 172.21.15.43:0/29673748 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfd5d9b700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd80cad90 0x7fdfd80ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.910+0000 7fdfd659c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80b60a0 0x7fdfd8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd80cad90 msgr2=0x7fdfd80ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfd6d9d700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd80cad90 0x7fdfd80ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80b60a0 msgr2=0x7fdfd8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfd6d9d700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80b60a0 0x7fdfd8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfd6d9d700 1 -- 172.21.15.43:0/29673748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009a70 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfd6d9d700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 0x7fdfd80ab8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000b370 tx=0x7fdfd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0009450 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0004560 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd80c7d60 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0004910 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.911+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd806bb80 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.912+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd8073fa0 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.912+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfd0012450 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.913+0000 7fdfc6ffd700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdfb806ace0 0x7fdfb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:35.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.913+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdfd008af60 con 0x7fdfd80cf5b0 2023-06-08T03:49:35.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.913+0000 7fdfd659c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdfb806ace0 0x7fdfb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:35.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.914+0000 7fdfd659c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdfb806ace0 0x7fdfb806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc000f60 tx=0x7fdfcc001e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:35.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:35.917+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfd0059800 con 0x7fdfd80cf5b0 2023-06-08T03:49:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.113+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdfd80b3990 con 0x7fdfd80cf5b0 2023-06-08T03:49:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.113+0000 7fdfc6ffd700 1 -- 172.21.15.43:0/29673748 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdfd0059390 con 0x7fdfd80cf5b0 2023-06-08T03:49:36.117 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:36.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdfb806ace0 msgr2=0x7fdfb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdfb806ace0 0x7fdfb806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc000f60 tx=0x7fdfcc001e40 comp rx=0 tx=0).stop 2023-06-08T03:49:36.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 msgr2=0x7fdfd80ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 0x7fdfd80ab8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000b370 tx=0x7fdfd0004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 shutdown_connections 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fdfb806ace0 0x7fdfb806d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfd80cf5b0 0x7fdfd80ab8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfd80b60a0 0x7fdfd8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 --2- 172.21.15.43:0/29673748 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfd80cad90 0x7fdfd80ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 >> 172.21.15.43:0/29673748 conn(0x7fdfd8069db0 msgr2=0x7fdfd80c7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:36.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 shutdown_connections 2023-06-08T03:49:36.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.115+0000 7fdfdca8c700 1 -- 172.21.15.43:0/29673748 wait complete. 2023-06-08T03:49:36.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:36.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.254+0000 7fe4818c4700 1 Processor -- start 2023-06-08T03:49:36.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.254+0000 7fe4818c4700 1 -- start start 2023-06-08T03:49:36.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe4818c4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe47c0b4ed0 0x7fe47c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe4818c4700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c15c750 con 0x7fe47c0ccb00 2023-06-08T03:49:36.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe4818c4700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0cf740 con 0x7fe47c0b43f0 2023-06-08T03:49:36.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe4818c4700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0ccfc0 con 0x7fe47c0b4ed0 2023-06-08T03:49:36.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe47a7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe47c0ccb00 0x7fe47c0d0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54416/0 (socket says 172.21.15.43:54416) 2023-06-08T03:49:36.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe47a7fc700 1 -- 172.21.15.43:0/3175772419 learned_addr learned my addr 172.21.15.43:0/3175772419 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:36.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe47b7fe700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe47c0b4ed0 0x7fe47c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469089126 0 0) 0x7fe46c001110 con 0x7fe47c0ccb00 2023-06-08T03:49:36.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.255+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4640035b0 con 0x7fe47c0ccb00 2023-06-08T03:49:36.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552320142 0 0) 0x7fe47c0cf740 con 0x7fe47c0b43f0 2023-06-08T03:49:36.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe46c001110 con 0x7fe47c0b43f0 2023-06-08T03:49:36.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511440186 0 0) 0x7fe4640035b0 con 0x7fe47c0ccb00 2023-06-08T03:49:36.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe47c0b4ed0 msgr2=0x7fe47c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe47c0b4ed0 0x7fe47c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 >> v1:172.21.15.135:6789/0 conn(0x7fe47c0b43f0 legacy=0x7fe47c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0cd540 con 0x7fe47c0ccb00 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7fe46c001800 con 0x7fe47c0ccb00 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 >> v1:172.21.15.43:6789/0 conn(0x7fe47c0ccb00 legacy=0x7fe47c0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe464003bc0 0x7fe464003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464004850 0x7fe464004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464005200 0x7fe46400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0ccfc0 con 0x7fe464003bc0 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46400c100 con 0x7fe464004850 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46400c2c0 con 0x7fe464005200 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47b7fe700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe47c0b4ed0 0x7fe47c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe464003bc0 0x7fe464003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47a7fc700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464004850 0x7fe464004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47b7fe700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464005200 0x7fe46400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 -- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464005200 msgr2=0x7fe46400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464005200 0x7fe46400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 -- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464004850 msgr2=0x7fe464004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464004850 0x7fe464004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 -- 172.21.15.43:0/3175772419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640035b0 con 0x7fe464003bc0 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47a7fc700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe464004850 0x7fe464004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe47affd700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe464003bc0 0x7fe464003fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe470001970 tx=0x7fe464005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd91847a02de2d07 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700052d0 con 0x7fe464003bc0 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470005430 con 0x7fe464003bc0 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.256+0000 7fe479ffb700 1 -- 172.21.15.43:0/3175772419 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700038c0 con 0x7fe464003bc0 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe4818c4700 1 -- 172.21.15.43:0/3175772419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe464003bc0 msgr2=0x7fe464003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe4818c4700 1 --2- 172.21.15.43:0/3175772419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe464003bc0 0x7fe464003fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe470001970 tx=0x7fe464005880 comp rx=0 tx=0).stop 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe47b7fe700 1 -- 172.21.15.43:0/3175772419 reap_dead start 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe4818c4700 1 -- 172.21.15.43:0/3175772419 shutdown_connections 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe4818c4700 1 -- 172.21.15.43:0/3175772419 >> 172.21.15.43:0/3175772419 conn(0x7fe47c072120 msgr2=0x7fe47c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe4818c4700 1 -- 172.21.15.43:0/3175772419 shutdown_connections 2023-06-08T03:49:36.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.257+0000 7fe4818c4700 1 -- 172.21.15.43:0/3175772419 wait complete. 2023-06-08T03:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.258+0000 7fe4818c4700 1 Processor -- start 2023-06-08T03:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.258+0000 7fe4818c4700 1 -- start start 2023-06-08T03:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe4818c4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464003bc0 0x7fe47c0d3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe4818c4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 0x7fe47c1f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe4818c4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe47c15e860 0x7fe47c0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe4818c4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0d3760 con 0x7fe47c15d330 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe4818c4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c15d7c0 con 0x7fe47c15e860 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe4818c4700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c15daa0 con 0x7fe464003bc0 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe47a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 0x7fe47c1f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe47a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 0x7fe47c1f1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59526/0 (socket says 172.21.15.43:59526) 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe47a7fc700 1 -- 172.21.15.43:0/1269208555 learned_addr learned my addr 172.21.15.43:0/1269208555 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe47b7fe700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe47c15e860 0x7fe47c0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.259+0000 7fe47affd700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464003bc0 0x7fe47c0d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47a7fc700 1 -- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464003bc0 msgr2=0x7fe47c0d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47a7fc700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464003bc0 0x7fe47c0d3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47a7fc700 1 -- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe47c15e860 msgr2=0x7fe47c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47a7fc700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe47c15e860 0x7fe47c0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47a7fc700 1 -- 172.21.15.43:0/1269208555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c15dd80 con 0x7fe47c15d330 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47affd700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464003bc0 0x7fe47c0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe47a7fc700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 0x7fe47c1f1210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000fb0 tx=0x7fe46c00ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c012590 con 0x7fe47c15d330 2023-06-08T03:49:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0126f0 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c15e060 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c012a80 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.260+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c15f730 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.261+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c15e580 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.261+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe46c012be0 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.262+0000 7fe463fff700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe46806ace0 0x7fe46806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.262+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe46c0891f0 con 0x7fe47c15d330 2023-06-08T03:49:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.262+0000 7fe47affd700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe46806ace0 0x7fe46806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.262+0000 7fe47affd700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe46806ace0 0x7fe46806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe470015040 tx=0x7fe470009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.266+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe47c15e580 con 0x7fe47c15d330 2023-06-08T03:49:36.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.467+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe47c15c750 con 0x7fe47c15d330 2023-06-08T03:49:36.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.468+0000 7fe463fff700 1 -- 172.21.15.43:0/1269208555 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe47c15c750 con 0x7fe47c15d330 2023-06-08T03:49:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:36.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe46806ace0 msgr2=0x7fe46806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe46806ace0 0x7fe46806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe470015040 tx=0x7fe470009030 comp rx=0 tx=0).stop 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 msgr2=0x7fe47c1f1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 0x7fe47c1f1210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000fb0 tx=0x7fe46c00ea60 comp rx=0 tx=0).stop 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 shutdown_connections 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe46806ace0 0x7fe46806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe47c15e860 0x7fe47c0d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe464003bc0 0x7fe47c0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 --2- 172.21.15.43:0/1269208555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15d330 0x7fe47c1f1210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 >> 172.21.15.43:0/1269208555 conn(0x7fe47c072120 msgr2=0x7fe47c0c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 shutdown_connections 2023-06-08T03:49:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.470+0000 7fe4818c4700 1 -- 172.21.15.43:0/1269208555 wait complete. 2023-06-08T03:49:36.485 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:36.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.609+0000 7f75ab9fb700 1 Processor -- start 2023-06-08T03:49:36.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.610+0000 7f75ab9fb700 1 -- start start 2023-06-08T03:49:36.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.610+0000 7f75ab9fb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40cd930 0x7f75a40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.610+0000 7f75ab9fb700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a406f480 con 0x7f75a40b1dc0 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.610+0000 7f75ab9fb700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a406f760 con 0x7f75a4159380 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.610+0000 7f75ab9fb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40b10d0 con 0x7f75a40cd930 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a9f98700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f75a40b1dc0 0x7f75a40ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54440/0 (socket says 172.21.15.43:54440) 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a9f98700 1 -- 172.21.15.43:0/2536442939 learned_addr learned my addr 172.21.15.43:0/2536442939 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a8f96700 1 --2- 172.21.15.43:0/2536442939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40cd930 0x7f75a40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190384409 0 0) 0x7f75a406f480 con 0x7f75a40b1dc0 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75900035b0 con 0x7f75a40b1dc0 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954700856 0 0) 0x7f75a406f760 con 0x7f75a4159380 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a406f480 con 0x7f75a4159380 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1593509054 0 0) 0x7f75900035b0 con 0x7f75a40b1dc0 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a8f96700 1 -- 172.21.15.43:0/2536442939 >> v1:172.21.15.135:6789/0 conn(0x7f75a4159380 legacy=0x7f75a40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a8f96700 1 -- 172.21.15.43:0/2536442939 >> v1:172.21.15.43:6789/0 conn(0x7f75a40b1dc0 legacy=0x7f75a40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a8f96700 1 -- 172.21.15.43:0/2536442939 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40b12e0 con 0x7f75a40cd930 2023-06-08T03:49:36.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f75a8f96700 1 --2- 172.21.15.43:0/2536442939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40cd930 0x7f75a40716c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7598009870 tx=0x7f7598009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6915d7088d84c11 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.611+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c0019f0 con 0x7f75a40cd930 2023-06-08T03:49:36.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598004030 con 0x7f75a40cd930 2023-06-08T03:49:36.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f7597fff700 1 -- 172.21.15.43:0/2536442939 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75980043c0 con 0x7f75a40cd930 2023-06-08T03:49:36.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 -- 172.21.15.43:0/2536442939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40cd930 msgr2=0x7f75a40716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/2536442939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40cd930 0x7f75a40716c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7598009870 tx=0x7f7598009b80 comp rx=0 tx=0).stop 2023-06-08T03:49:36.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 -- 172.21.15.43:0/2536442939 shutdown_connections 2023-06-08T03:49:36.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/2536442939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40cd930 0x7f75a40716c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 -- 172.21.15.43:0/2536442939 >> 172.21.15.43:0/2536442939 conn(0x7f75a406aec0 msgr2=0x7f75a406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 -- 172.21.15.43:0/2536442939 shutdown_connections 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.612+0000 7f75ab9fb700 1 -- 172.21.15.43:0/2536442939 wait complete. 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.613+0000 7f75ab9fb700 1 Processor -- start 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.613+0000 7f75ab9fb700 1 -- start start 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75ab9fb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40b1dc0 0x7f75a40cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75ab9fb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75a40cd930 0x7f75a415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75ab9fb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 0x7f75a40c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75ab9fb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40cbb50 con 0x7f75a4159380 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75ab9fb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40c3b50 con 0x7f75a40cd930 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75ab9fb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41efb00 con 0x7f75a40b1dc0 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75a9f98700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 0x7f75a40c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75a9f98700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 0x7f75a40c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59542/0 (socket says 172.21.15.43:59542) 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75a9f98700 1 -- 172.21.15.43:0/3952987970 learned_addr learned my addr 172.21.15.43:0/3952987970 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75a8f96700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75a40cd930 0x7f75a415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.614+0000 7f75a9797700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40b1dc0 0x7f75a40cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a9f98700 1 -- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40b1dc0 msgr2=0x7f75a40cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a9f98700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40b1dc0 0x7f75a40cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a9f98700 1 -- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75a40cd930 msgr2=0x7f75a415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a9f98700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75a40cd930 0x7f75a415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a9f98700 1 -- 172.21.15.43:0/3952987970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980094a0 con 0x7f75a4159380 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a8f96700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75a40cd930 0x7f75a415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75a9f98700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 0x7f75a40c3fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f759c00cc50 tx=0x7f759c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00ade0 con 0x7f75a4159380 2023-06-08T03:49:36.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00ce50 con 0x7f75a4159380 2023-06-08T03:49:36.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c0072f0 con 0x7f75a4159380 2023-06-08T03:49:36.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a40c3220 con 0x7f75a4159380 2023-06-08T03:49:36.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.615+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a40c37e0 con 0x7f75a4159380 2023-06-08T03:49:36.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.616+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4073fa0 con 0x7f75a4159380 2023-06-08T03:49:36.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.616+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f759c007450 con 0x7f75a4159380 2023-06-08T03:49:36.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.617+0000 7f7595ffb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f758806ace0 0x7f758806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.617+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f759c089440 con 0x7f75a4159380 2023-06-08T03:49:36.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.617+0000 7f75a9797700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f758806ace0 0x7f758806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.617+0000 7f75a9797700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f758806ace0 0x7f758806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75a0001220 tx=0x7f75a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.621+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f759c054120 con 0x7f75a4159380 2023-06-08T03:49:36.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.820+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75a40c3c90 con 0x7f75a4159380 2023-06-08T03:49:36.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.820+0000 7f7595ffb700 1 -- 172.21.15.43:0/3952987970 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f759c057740 con 0x7f75a4159380 2023-06-08T03:49:36.824 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f758806ace0 msgr2=0x7f758806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f758806ace0 0x7f758806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75a0001220 tx=0x7f75a0009040 comp rx=0 tx=0).stop 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 msgr2=0x7f75a40c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 0x7f75a40c3fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f759c00cc50 tx=0x7f759c00a340 comp rx=0 tx=0).stop 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 shutdown_connections 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f758806ace0 0x7f758806d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75a4159380 0x7f75a40c3fe0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75a40b1dc0 0x7f75a40cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.822+0000 7f75ab9fb700 1 --2- 172.21.15.43:0/3952987970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75a40cd930 0x7f75a415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.823+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 >> 172.21.15.43:0/3952987970 conn(0x7f75a406aec0 msgr2=0x7f75a40b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.823+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 shutdown_connections 2023-06-08T03:49:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.823+0000 7f75ab9fb700 1 -- 172.21.15.43:0/3952987970 wait complete. 2023-06-08T03:49:36.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:36.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.962+0000 7f6980b59700 1 Processor -- start 2023-06-08T03:49:36.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.962+0000 7f6980b59700 1 -- start start 2023-06-08T03:49:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.962+0000 7f6980b59700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f697c159380 0x7f697c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f6980b59700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c06f480 con 0x7f697c0cd930 2023-06-08T03:49:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f6980b59700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c06f760 con 0x7f697c0b1dc0 2023-06-08T03:49:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f6980b59700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0b10d0 con 0x7f697c159380 2023-06-08T03:49:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f697c159380 0x7f697c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f697c0cd930 0x7f697c0ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54454/0 (socket says 172.21.15.43:54454) 2023-06-08T03:49:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697ad9d700 1 -- 172.21.15.43:0/3386267974 learned_addr learned my addr 172.21.15.43:0/3386267974 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697a59c700 1 -- 172.21.15.43:0/3386267974 >> v1:172.21.15.135:6789/0 conn(0x7f697c0b1dc0 legacy=0x7f697c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697a59c700 1 -- 172.21.15.43:0/3386267974 >> v1:172.21.15.43:6789/0 conn(0x7f697c0cd930 legacy=0x7f697c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697959a700 1 -- 172.21.15.43:0/3386267974 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755547307 0 0) 0x7f697c06f480 con 0x7f697c0cd930 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697a59c700 1 -- 172.21.15.43:0/3386267974 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0b12e0 con 0x7f697c159380 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697a59c700 1 --2- 172.21.15.43:0/3386267974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c0716c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f696c009840 tx=0x7f696c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be53aa9fd49aa0f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697959a700 1 -- 172.21.15.43:0/3386267974 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c011830 con 0x7f697c159380 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697959a700 1 -- 172.21.15.43:0/3386267974 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c011990 con 0x7f697c159380 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.963+0000 7f697959a700 1 -- 172.21.15.43:0/3386267974 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c011d20 con 0x7f697c159380 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 -- 172.21.15.43:0/3386267974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 msgr2=0x7f697c0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 --2- 172.21.15.43:0/3386267974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c0716c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f696c009840 tx=0x7f696c009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 -- 172.21.15.43:0/3386267974 shutdown_connections 2023-06-08T03:49:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 --2- 172.21.15.43:0/3386267974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c0716c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 -- 172.21.15.43:0/3386267974 >> 172.21.15.43:0/3386267974 conn(0x7f697c06aec0 msgr2=0x7f697c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 -- 172.21.15.43:0/3386267974 shutdown_connections 2023-06-08T03:49:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.964+0000 7f6980b59700 1 -- 172.21.15.43:0/3386267974 wait complete. 2023-06-08T03:49:36.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.965+0000 7f6980b59700 1 Processor -- start 2023-06-08T03:49:36.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.965+0000 7f6980b59700 1 -- start start 2023-06-08T03:49:36.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6980b59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697c0b1dc0 0x7f697c0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6980b59700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697c0cd930 0x7f697c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6980b59700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6980b59700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15a730 con 0x7f697c159380 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6980b59700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15a940 con 0x7f697c0b1dc0 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6980b59700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15ac20 con 0x7f697c0cd930 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f697ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f697ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59556/0 (socket says 172.21.15.43:59556) 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f697ad9d700 1 -- 172.21.15.43:0/2622794495 learned_addr learned my addr 172.21.15.43:0/2622794495 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f6979d9b700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697c0cd930 0x7f697c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.966+0000 7f697a59c700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697c0b1dc0 0x7f697c0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f697ad9d700 1 -- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697c0cd930 msgr2=0x7f697c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f697ad9d700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697c0cd930 0x7f697c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f697ad9d700 1 -- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697c0b1dc0 msgr2=0x7f697c0cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f697ad9d700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697c0b1dc0 0x7f697c0cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f697ad9d700 1 -- 172.21.15.43:0/2622794495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0094a0 con 0x7f697c159380 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f697ad9d700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c155690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6974002230 tx=0x7f697400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400aac0 con 0x7f697c159380 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400ac40 con 0x7f697c159380 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c15af00 con 0x7f697c159380 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740070d0 con 0x7f697c159380 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.967+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c15b4c0 con 0x7f697c159380 2023-06-08T03:49:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.968+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c15b6b0 con 0x7f697c159380 2023-06-08T03:49:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.968+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6974007250 con 0x7f697c159380 2023-06-08T03:49:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.969+0000 7f696affd700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f695c06ace0 0x7f695c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.969+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6974089620 con 0x7f697c159380 2023-06-08T03:49:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.969+0000 7f697a59c700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f695c06ace0 0x7f695c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.970+0000 7f697a59c700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f695c06ace0 0x7f695c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f696c0090b0 tx=0x7f696c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:36.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:36.973+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6974054310 con 0x7f697c159380 2023-06-08T03:49:37.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.168+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f697c073fa0 con 0x7f697c159380 2023-06-08T03:49:37.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.169+0000 7f696affd700 1 -- 172.21.15.43:0/2622794495 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69740180a0 con 0x7f697c159380 2023-06-08T03:49:37.172 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.170+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f695c06ace0 msgr2=0x7f695c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.170+0000 7f6980b59700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f695c06ace0 0x7f695c06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f696c0090b0 tx=0x7f696c01c040 comp rx=0 tx=0).stop 2023-06-08T03:49:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.170+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 msgr2=0x7f697c155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.170+0000 7f6980b59700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c155690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6974002230 tx=0x7f697400cf50 comp rx=0 tx=0).stop 2023-06-08T03:49:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 shutdown_connections 2023-06-08T03:49:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f695c06ace0 0x7f695c06d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f697c159380 0x7f697c155690 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697c0b1dc0 0x7f697c0cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 --2- 172.21.15.43:0/2622794495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f697c0cd930 0x7f697c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 >> 172.21.15.43:0/2622794495 conn(0x7f697c06aec0 msgr2=0x7f697c154730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 shutdown_connections 2023-06-08T03:49:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.171+0000 7f6980b59700 1 -- 172.21.15.43:0/2622794495 wait complete. 2023-06-08T03:49:37.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:37.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.310+0000 7f24e052b700 1 Processor -- start 2023-06-08T03:49:37.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.310+0000 7f24e052b700 1 -- start start 2023-06-08T03:49:37.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.311+0000 7f24e052b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24d815c540 0x7f24d80cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.311+0000 7f24e052b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b1a80 0x7f24d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.311+0000 7f24e052b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d806a710 con 0x7f24d806a2f0 2023-06-08T03:49:37.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.311+0000 7f24e052b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d80cf390 con 0x7f24d815c540 2023-06-08T03:49:37.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.311+0000 7f24e052b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80cd2c0 con 0x7f24d80b1a80 2023-06-08T03:49:37.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24d815c540 0x7f24d80cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24ddac6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b1a80 0x7f24d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24d815c540 0x7f24d80cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:41176/0 (socket says 172.21.15.43:41176) 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 -- 172.21.15.43:0/801558522 learned_addr learned my addr 172.21.15.43:0/801558522 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24deac8700 1 --1- 172.21.15.43:0/801558522 >> v1:172.21.15.135:6789/0 conn(0x7f24d806a2f0 0x7f24d8160090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:41686/0 (socket says 172.21.15.43:41686) 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 -- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b1a80 msgr2=0x7f24d8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 --2- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b1a80 0x7f24d8069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 -- 172.21.15.43:0/801558522 >> v1:172.21.15.135:6789/0 conn(0x7f24d806a2f0 legacy=0x7f24d8160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24dd2c5700 1 -- 172.21.15.43:0/801558522 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084440303 0 0) 0x7f24d806a710 con 0x7f24d806a2f0 2023-06-08T03:49:37.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 -- 172.21.15.43:0/801558522 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80cd5a0 con 0x7f24d815c540 2023-06-08T03:49:37.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24de2c7700 1 --2- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d815c540 0x7f24d80cedb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f24c80098f0 tx=0x7f24c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aadf992c5006872e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:37.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24dd2c5700 1 -- 172.21.15.43:0/801558522 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8011830 con 0x7f24d815c540 2023-06-08T03:49:37.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24dd2c5700 1 -- 172.21.15.43:0/801558522 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8011990 con 0x7f24d815c540 2023-06-08T03:49:37.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.312+0000 7f24dd2c5700 1 -- 172.21.15.43:0/801558522 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8011d20 con 0x7f24d815c540 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 -- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d815c540 msgr2=0x7f24d80cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 --2- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d815c540 0x7f24d80cedb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f24c80098f0 tx=0x7f24c8009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 -- 172.21.15.43:0/801558522 shutdown_connections 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 --2- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d815c540 0x7f24d80cedb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 --2- 172.21.15.43:0/801558522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d80b1a80 0x7f24d8069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 -- 172.21.15.43:0/801558522 >> 172.21.15.43:0/801558522 conn(0x7f24d806aec0 msgr2=0x7f24d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:37.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 -- 172.21.15.43:0/801558522 shutdown_connections 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.313+0000 7f24e052b700 1 -- 172.21.15.43:0/801558522 wait complete. 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.314+0000 7f24e052b700 1 Processor -- start 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.314+0000 7f24e052b700 1 -- start start 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24e052b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d806a2f0 0x7f24d80cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24e052b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 0x7f24d81e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24e052b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d815c540 0x7f24d8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24e052b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80cc2d0 con 0x7f24d80b1a80 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24e052b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80cb230 con 0x7f24d806a2f0 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24e052b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80cb510 con 0x7f24d815c540 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 0x7f24d81e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 0x7f24d81e78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59566/0 (socket says 172.21.15.43:59566) 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 -- 172.21.15.43:0/1638044673 learned_addr learned my addr 172.21.15.43:0/1638044673 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24deac8700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d815c540 0x7f24d8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24de2c7700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d806a2f0 0x7f24d80cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 -- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d815c540 msgr2=0x7f24d8153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d815c540 0x7f24d8153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 -- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d806a2f0 msgr2=0x7f24d80cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d806a2f0 0x7f24d80cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.315+0000 7f24ddac6700 1 -- 172.21.15.43:0/1638044673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8009550 con 0x7f24d80b1a80 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.316+0000 7f24ddac6700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 0x7f24d81e78f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f24d400e9d0 tx=0x7f24d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:37.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.316+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4009730 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.316+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400ee70 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.316+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d80cb7f0 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.316+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400ca70 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.316+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d80cbdb0 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.317+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d8073fa0 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.317+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24d400cbd0 con 0x7f24d80b1a80 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.318+0000 7f24ceffd700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ad10 0x7f24bc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.318+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f24d40897d0 con 0x7f24d80b1a80 2023-06-08T03:49:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.318+0000 7f24de2c7700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ad10 0x7f24bc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.318+0000 7f24de2c7700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ad10 0x7f24bc06d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009c40 tx=0x7f24c8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:37.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.322+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24d4057fe0 con 0x7f24d80b1a80 2023-06-08T03:49:37.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.519+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24d80b55d0 con 0x7f24d80b1a80 2023-06-08T03:49:37.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.519+0000 7f24ceffd700 1 -- 172.21.15.43:0/1638044673 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24d4057b70 con 0x7f24d80b1a80 2023-06-08T03:49:37.523 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:37.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ad10 msgr2=0x7f24bc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ad10 0x7f24bc06d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009c40 tx=0x7f24c8008030 comp rx=0 tx=0).stop 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 msgr2=0x7f24d81e78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 0x7f24d81e78f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f24d400e9d0 tx=0x7f24d400ece0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 shutdown_connections 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24bc06ad10 0x7f24bc06d1c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d815c540 0x7f24d8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d806a2f0 0x7f24d80cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 --2- 172.21.15.43:0/1638044673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d80b1a80 0x7f24d81e78f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 >> 172.21.15.43:0/1638044673 conn(0x7f24d806aec0 msgr2=0x7f24d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 shutdown_connections 2023-06-08T03:49:37.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.521+0000 7f24e052b700 1 -- 172.21.15.43:0/1638044673 wait complete. 2023-06-08T03:49:37.536 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T03:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.659+0000 7f894c3cd700 1 Processor -- start 2023-06-08T03:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.659+0000 7f894c3cd700 1 -- start start 2023-06-08T03:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894c3cd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415c170 0x7f89440b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894c3cd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f89440ccf50 0x7f89440cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894c3cd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f894415fc20 0x7f89441600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894c3cd700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440d06f0 con 0x7f89440ccf50 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894c3cd700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894415c540 con 0x7f894415fc20 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894c3cd700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440cd900 con 0x7f894415c170 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f89440ccf50 0x7f89440cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f89440ccf50 0x7f89440cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59576/0 (socket says 172.21.15.43:59576) 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 -- 172.21.15.43:0/868922190 learned_addr learned my addr 172.21.15.43:0/868922190 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894a169700 1 --2- 172.21.15.43:0/868922190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415c170 0x7f89440b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f894a96a700 1 --2- 172.21.15.43:0/868922190 >> v2:172.21.15.135:3300/0 conn(0x7f894415fc20 0x7f89441600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 -- 172.21.15.43:0/868922190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415c170 msgr2=0x7f89440b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 --2- 172.21.15.43:0/868922190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415c170 0x7f89440b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 -- 172.21.15.43:0/868922190 >> v2:172.21.15.135:3300/0 conn(0x7f894415fc20 msgr2=0x7f89441600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 --2- 172.21.15.43:0/868922190 >> v2:172.21.15.135:3300/0 conn(0x7f894415fc20 0x7f89441600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 -- 172.21.15.43:0/868922190 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440d14e0 con 0x7f89440ccf50 2023-06-08T03:49:37.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.660+0000 7f8949968700 1 --2- 172.21.15.43:0/868922190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89440ccf50 0x7f89440cd3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f894406f570 tx=0x7f8934009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ba8575d0380827 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:37.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f8949167700 1 -- 172.21.15.43:0/868922190 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011830 con 0x7f89440ccf50 2023-06-08T03:49:37.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f8949167700 1 -- 172.21.15.43:0/868922190 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934011990 con 0x7f89440ccf50 2023-06-08T03:49:37.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f8949167700 1 -- 172.21.15.43:0/868922190 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011d20 con 0x7f89440ccf50 2023-06-08T03:49:37.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 -- 172.21.15.43:0/868922190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89440ccf50 msgr2=0x7f89440cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 --2- 172.21.15.43:0/868922190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89440ccf50 0x7f89440cd3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f894406f570 tx=0x7f8934009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:37.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 -- 172.21.15.43:0/868922190 shutdown_connections 2023-06-08T03:49:37.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 --2- 172.21.15.43:0/868922190 >> v2:172.21.15.135:3300/0 conn(0x7f894415fc20 0x7f89441600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 --2- 172.21.15.43:0/868922190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415c170 0x7f89440b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 --2- 172.21.15.43:0/868922190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89440ccf50 0x7f89440cd3c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 -- 172.21.15.43:0/868922190 >> 172.21.15.43:0/868922190 conn(0x7f8944069db0 msgr2=0x7f894406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 -- 172.21.15.43:0/868922190 shutdown_connections 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.661+0000 7f894c3cd700 1 -- 172.21.15.43:0/868922190 wait complete. 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.662+0000 7f894c3cd700 1 Processor -- start 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.662+0000 7f894c3cd700 1 -- start start 2023-06-08T03:49:37.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894c3cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89440ccf50 0x7f8944150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894c3cd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 0x7f89440ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894c3cd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415fc20 0x7f89440abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894c3cd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440af210 con 0x7f894415c170 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894c3cd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944151340 con 0x7f89440ccf50 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894c3cd700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440ae590 con 0x7f894415fc20 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f8949968700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 0x7f89440ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f8949968700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 0x7f89440ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59582/0 (socket says 172.21.15.43:59582) 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f8949968700 1 -- 172.21.15.43:0/3252352592 learned_addr learned my addr 172.21.15.43:0/3252352592 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894a96a700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415fc20 0x7f89440abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f894a169700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89440ccf50 0x7f8944150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.663+0000 7f8949968700 1 -- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415fc20 msgr2=0x7f89440abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f8949968700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415fc20 0x7f89440abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f8949968700 1 -- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89440ccf50 msgr2=0x7f8944150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f8949968700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89440ccf50 0x7f8944150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f8949968700 1 -- 172.21.15.43:0/3252352592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934009550 con 0x7f894415c170 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f894a169700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89440ccf50 0x7f8944150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f894a96a700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415fc20 0x7f89440abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f8949968700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 0x7f89440ab8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f8934004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934004400 con 0x7f894415c170 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893401f070 con 0x7f894415c170 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89440ae870 con 0x7f894415c170 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340038c0 con 0x7f894415c170 2023-06-08T03:49:37.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.664+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440aee30 con 0x7f894415c170 2023-06-08T03:49:37.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.665+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89440af350 con 0x7f894415c170 2023-06-08T03:49:37.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.665+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8934021030 con 0x7f894415c170 2023-06-08T03:49:37.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.665+0000 7f893affd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f892806ace0 0x7f892806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:37.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.666+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f893408ab80 con 0x7f894415c170 2023-06-08T03:49:37.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.666+0000 7f894a169700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f892806ace0 0x7f892806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:37.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.666+0000 7f894a169700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f892806ace0 0x7f892806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8940009ae0 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:37.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.670+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89440af350 con 0x7f894415c170 2023-06-08T03:49:37.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.883+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f89440af350 con 0x7f894415c170 2023-06-08T03:49:37.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.883+0000 7f893affd700 1 -- 172.21.15.43:0/3252352592 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f89440af350 con 0x7f894415c170 2023-06-08T03:49:37.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f892806ace0 msgr2=0x7f892806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f892806ace0 0x7f892806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8940009ae0 tx=0x7f8940008040 comp rx=0 tx=0).stop 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 msgr2=0x7f89440ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 0x7f89440ab8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f8934004750 comp rx=0 tx=0).stop 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 shutdown_connections 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f892806ace0 0x7f892806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f894415fc20 0x7f89440abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89440ccf50 0x7f8944150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 --2- 172.21.15.43:0/3252352592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f894415c170 0x7f89440ab8f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:37.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 >> 172.21.15.43:0/3252352592 conn(0x7f8944069db0 msgr2=0x7f89440b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:37.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 shutdown_connections 2023-06-08T03:49:37.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:37.885+0000 7f894c3cd700 1 -- 172.21.15.43:0/3252352592 wait complete. 2023-06-08T03:49:37.890 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T03:49:37.900 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-08T03:49:37.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:37.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-08T03:49:37.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:49:37.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:37.949 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-08T03:49:37.966 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:37.967 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:37.988 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:37.988 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:38.047 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:38.048 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:38.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:38.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.228+0000 7ff752478700 1 Processor -- start 2023-06-08T03:49:38.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.228+0000 7ff752478700 1 -- start start 2023-06-08T03:49:38.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff752478700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c1589c0 0x7ff74c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff752478700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff74c0710b0 0x7ff74c06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff752478700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c15d2a0 con 0x7ff74c159650 2023-06-08T03:49:38.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff752478700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0cce80 con 0x7ff74c0710b0 2023-06-08T03:49:38.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff752478700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0cd160 con 0x7ff74c1589c0 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff750a15700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff74c0710b0 0x7ff74c06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff750a15700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff74c0710b0 0x7ff74c06cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59592/0 (socket says 172.21.15.43:59592) 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff74b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff74c159650 0x7ff74c0709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54492/0 (socket says 172.21.15.43:54492) 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.229+0000 7ff750a15700 1 -- 172.21.15.43:0/2629959439 learned_addr learned my addr 172.21.15.43:0/2629959439 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff74bfff700 1 --2- 172.21.15.43:0/2629959439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c1589c0 0x7ff74c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff750a15700 1 -- 172.21.15.43:0/2629959439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c1589c0 msgr2=0x7ff74c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff750a15700 1 --2- 172.21.15.43:0/2629959439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c1589c0 0x7ff74c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff750a15700 1 -- 172.21.15.43:0/2629959439 >> v1:172.21.15.43:6789/0 conn(0x7ff74c159650 legacy=0x7ff74c0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff750a15700 1 -- 172.21.15.43:0/2629959439 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0cd440 con 0x7ff74c0710b0 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff74affd700 1 -- 172.21.15.43:0/2629959439 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876270285 0 0) 0x7ff73c001110 con 0x7ff74c159650 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff750a15700 1 --2- 172.21.15.43:0/2629959439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c0710b0 0x7ff74c06cc30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff744009e50 tx=0x7ff74400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71386c769a0dbbe server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff74affd700 1 -- 172.21.15.43:0/2629959439 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400e070 con 0x7ff74c0710b0 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff74affd700 1 -- 172.21.15.43:0/2629959439 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74400b9c0 con 0x7ff74c0710b0 2023-06-08T03:49:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff74affd700 1 -- 172.21.15.43:0/2629959439 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400bd70 con 0x7ff74c0710b0 2023-06-08T03:49:38.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff752478700 1 -- 172.21.15.43:0/2629959439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c0710b0 msgr2=0x7ff74c06cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.230+0000 7ff752478700 1 --2- 172.21.15.43:0/2629959439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c0710b0 0x7ff74c06cc30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff744009e50 tx=0x7ff74400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.231+0000 7ff752478700 1 -- 172.21.15.43:0/2629959439 shutdown_connections 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.231+0000 7ff752478700 1 --2- 172.21.15.43:0/2629959439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c0710b0 0x7ff74c06cc30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.231+0000 7ff752478700 1 --2- 172.21.15.43:0/2629959439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c1589c0 0x7ff74c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.231+0000 7ff752478700 1 -- 172.21.15.43:0/2629959439 >> 172.21.15.43:0/2629959439 conn(0x7ff74c0ceed0 msgr2=0x7ff74c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.231+0000 7ff752478700 1 -- 172.21.15.43:0/2629959439 shutdown_connections 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.231+0000 7ff752478700 1 -- 172.21.15.43:0/2629959439 wait complete. 2023-06-08T03:49:38.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.232+0000 7ff752478700 1 Processor -- start 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.232+0000 7ff752478700 1 -- start start 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff752478700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c0710b0 0x7ff74c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff752478700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 0x7ff74c0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff752478700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff74c159650 0x7ff74c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff752478700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0af950 con 0x7ff74c1589c0 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff752478700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b4320 con 0x7ff74c159650 2023-06-08T03:49:38.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff752478700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b4600 con 0x7ff74c0710b0 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 0x7ff74c0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 0x7ff74c0c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59596/0 (socket says 172.21.15.43:59596) 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 -- 172.21.15.43:0/4243914269 learned_addr learned my addr 172.21.15.43:0/4243914269 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74bfff700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c0710b0 0x7ff74c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff750a15700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff74c159650 0x7ff74c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 -- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c0710b0 msgr2=0x7ff74c1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c0710b0 0x7ff74c1524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 -- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff74c159650 msgr2=0x7ff74c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff74c159650 0x7ff74c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 -- 172.21.15.43:0/4243914269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009b30 con 0x7ff74c1589c0 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff74b7fe700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 0x7ff74c0c5130 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c730 tx=0x7ff73c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004c80 con 0x7ff74c1589c0 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.233+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c004e00 con 0x7ff74c1589c0 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.234+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c0b48e0 con 0x7ff74c1589c0 2023-06-08T03:49:38.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.234+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c007310 con 0x7ff74c1589c0 2023-06-08T03:49:38.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.234+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c1529e0 con 0x7ff74c1589c0 2023-06-08T03:49:38.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.235+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c073fa0 con 0x7ff74c1589c0 2023-06-08T03:49:38.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.235+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff73c007470 con 0x7ff74c1589c0 2023-06-08T03:49:38.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.235+0000 7ff748ff9700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff72c06ad10 0x7ff72c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.235+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff73c089310 con 0x7ff74c1589c0 2023-06-08T03:49:38.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.235+0000 7ff74bfff700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff72c06ad10 0x7ff72c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.236+0000 7ff74bfff700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff72c06ad10 0x7ff72c06d1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff734006b20 tx=0x7ff734008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.240+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff73c054000 con 0x7ff74c1589c0 2023-06-08T03:49:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.436+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff74c15d2a0 con 0x7ff74c1589c0 2023-06-08T03:49:38.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.438+0000 7ff748ff9700 1 -- 172.21.15.43:0/4243914269 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7ff74c15d2a0 con 0x7ff74c1589c0 2023-06-08T03:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:38.441 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff72c06ad10 msgr2=0x7ff72c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff72c06ad10 0x7ff72c06d1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff734006b20 tx=0x7ff734008040 comp rx=0 tx=0).stop 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 msgr2=0x7ff74c0c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 0x7ff74c0c5130 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c730 tx=0x7ff73c00ca40 comp rx=0 tx=0).stop 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 shutdown_connections 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff72c06ad10 0x7ff72c06d1c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff74c159650 0x7ff74c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff74c0710b0 0x7ff74c1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 --2- 172.21.15.43:0/4243914269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff74c1589c0 0x7ff74c0c5130 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 >> 172.21.15.43:0/4243914269 conn(0x7ff74c0ceed0 msgr2=0x7ff74c1532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:38.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 shutdown_connections 2023-06-08T03:49:38.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.440+0000 7ff752478700 1 -- 172.21.15.43:0/4243914269 wait complete. 2023-06-08T03:49:38.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:38.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:38.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.580+0000 7f12fca57700 1 Processor -- start 2023-06-08T03:49:38.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.581+0000 7f12fca57700 1 -- start start 2023-06-08T03:49:38.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.581+0000 7f12fca57700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.581+0000 7f12fca57700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12f806a2f0 0x7f12f80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12fca57700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f806a710 con 0x7f12f815c540 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12fca57700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80cf390 con 0x7f12f806a2f0 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12fca57700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80cd2c0 con 0x7f12f80cedb0 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12f806a2f0 0x7f12f80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12f806a2f0 0x7f12f80b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59606/0 (socket says 172.21.15.43:59606) 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 -- 172.21.15.43:0/2455957124 learned_addr learned my addr 172.21.15.43:0/2455957124 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:38.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f5d9b700 1 --2- 172.21.15.43:0/2455957124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 -- 172.21.15.43:0/2455957124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 msgr2=0x7f12f8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 --2- 172.21.15.43:0/2455957124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f8069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 -- 172.21.15.43:0/2455957124 >> v1:172.21.15.135:6789/0 conn(0x7f12f815c540 legacy=0x7f12f80b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 -- 172.21.15.43:0/2455957124 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80cd5a0 con 0x7f12f806a2f0 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f6d9d700 1 --2- 172.21.15.43:0/2455957124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f80b24a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ea8c4a0f981e3a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f559a700 1 -- 172.21.15.43:0/2455957124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000e070 con 0x7f12f806a2f0 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f559a700 1 -- 172.21.15.43:0/2455957124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000b9c0 con 0x7f12f806a2f0 2023-06-08T03:49:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.582+0000 7f12f559a700 1 -- 172.21.15.43:0/2455957124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000bd70 con 0x7f12f806a2f0 2023-06-08T03:49:38.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 -- 172.21.15.43:0/2455957124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 msgr2=0x7f12f80b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 --2- 172.21.15.43:0/2455957124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f80b24a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 -- 172.21.15.43:0/2455957124 shutdown_connections 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 --2- 172.21.15.43:0/2455957124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f80b24a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 --2- 172.21.15.43:0/2455957124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f8069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 -- 172.21.15.43:0/2455957124 >> 172.21.15.43:0/2455957124 conn(0x7f12f806aec0 msgr2=0x7f12f806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 -- 172.21.15.43:0/2455957124 shutdown_connections 2023-06-08T03:49:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.583+0000 7f12fca57700 1 -- 172.21.15.43:0/2455957124 wait complete. 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.584+0000 7f12fca57700 1 Processor -- start 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.584+0000 7f12fca57700 1 -- start start 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12fca57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f81e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12fca57700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f81e7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12fca57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f815c540 0x7f12f8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12fca57700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81e5d10 con 0x7f12f806a2f0 2023-06-08T03:49:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12fca57700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80ac200 con 0x7f12f815c540 2023-06-08T03:49:38.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12fca57700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81e8140 con 0x7f12f80cedb0 2023-06-08T03:49:38.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12f659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f81e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12f659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f81e57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59608/0 (socket says 172.21.15.43:59608) 2023-06-08T03:49:38.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12f659c700 1 -- 172.21.15.43:0/2050387077 learned_addr learned my addr 172.21.15.43:0/2050387077 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:38.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12f6d9d700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f815c540 0x7f12f8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.585+0000 7f12f5d9b700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f81e7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12f659c700 1 -- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 msgr2=0x7f12f81e7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12f659c700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f81e7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12f659c700 1 -- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f815c540 msgr2=0x7f12f8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12f659c700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f815c540 0x7f12f8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12f659c700 1 -- 172.21.15.43:0/2050387077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0009b30 con 0x7f12f806a2f0 2023-06-08T03:49:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12f659c700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f81e57d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c4e0 tx=0x7f12e800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80052d0 con 0x7f12f806a2f0 2023-06-08T03:49:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8005430 con 0x7f12f806a2f0 2023-06-08T03:49:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80038c0 con 0x7f12f806a2f0 2023-06-08T03:49:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f80ab8f0 con 0x7f12f806a2f0 2023-06-08T03:49:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.586+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f80abbb0 con 0x7f12f806a2f0 2023-06-08T03:49:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.587+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f80ac4e0 con 0x7f12f806a2f0 2023-06-08T03:49:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.587+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12e8003a20 con 0x7f12f806a2f0 2023-06-08T03:49:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.588+0000 7f12e6ffd700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f12d806ace0 0x7f12d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.588+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12e8088bf0 con 0x7f12f806a2f0 2023-06-08T03:49:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.588+0000 7f12f5d9b700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f12d806ace0 0x7f12d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.589+0000 7f12f5d9b700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f12d806ace0 0x7f12d806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12f806ab30 tx=0x7f12ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.592+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f12e80538d0 con 0x7f12f806a2f0 2023-06-08T03:49:38.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.794+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12f8073fa0 con 0x7f12f806a2f0 2023-06-08T03:49:38.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.794+0000 7f12e6ffd700 1 -- 172.21.15.43:0/2050387077 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12e8017020 con 0x7f12f806a2f0 2023-06-08T03:49:38.798 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f12d806ace0 msgr2=0x7f12d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f12d806ace0 0x7f12d806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12f806ab30 tx=0x7f12ec008040 comp rx=0 tx=0).stop 2023-06-08T03:49:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 msgr2=0x7f12f81e57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f81e57d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c4e0 tx=0x7f12e800c7f0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 shutdown_connections 2023-06-08T03:49:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f12d806ace0 0x7f12d806d190 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12f806ab30 tx=0x7f12ec008040 comp rx=0 tx=0).stop 2023-06-08T03:49:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12f806a2f0 0x7f12f81e57d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f815c540 0x7f12f8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 --2- 172.21.15.43:0/2050387077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12f80cedb0 0x7f12f81e7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.796+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 >> 172.21.15.43:0/2050387077 conn(0x7f12f806aec0 msgr2=0x7f12f80b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:38.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.797+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 shutdown_connections 2023-06-08T03:49:38.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.797+0000 7f12fca57700 1 -- 172.21.15.43:0/2050387077 wait complete. 2023-06-08T03:49:38.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.936+0000 7f8a79f6c700 1 Processor -- start 2023-06-08T03:49:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.936+0000 7f8a79f6c700 1 -- start start 2023-06-08T03:49:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a79f6c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a740b43f0 0x7f8a740b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a79f6c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 0x7f8a740b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a79f6c700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7415c750 con 0x7f8a740ccb00 2023-06-08T03:49:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a79f6c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740ccfc0 con 0x7f8a740b43f0 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a79f6c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b5240 con 0x7f8a740d1650 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a72ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8a740ccb00 0x7f8a7415fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54522/0 (socket says 172.21.15.43:54522) 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a72ffd700 1 -- 172.21.15.43:0/267427757 learned_addr learned my addr 172.21.15.43:0/267427757 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216723236 0 0) 0x7f8a5c001110 con 0x7f8a740ccb00 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a73fff700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 0x7f8a740b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a600035b0 con 0x7f8a740ccb00 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a737fe700 1 --2- 172.21.15.43:0/267427757 >> v2:172.21.15.135:3300/0 conn(0x7f8a740b43f0 0x7f8a740b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.937+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163023253 0 0) 0x7f8a600035b0 con 0x7f8a740ccb00 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 msgr2=0x7f8a740b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 0x7f8a740b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 >> v2:172.21.15.135:3300/0 conn(0x7f8a740b43f0 msgr2=0x7f8a740b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 --2- 172.21.15.43:0/267427757 >> v2:172.21.15.135:3300/0 conn(0x7f8a740b43f0 0x7f8a740b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740cf740 con 0x7f8a740ccb00 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f8a5c001800 con 0x7f8a740ccb00 2023-06-08T03:49:38.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 >> v1:172.21.15.43:6789/0 conn(0x7f8a740ccb00 legacy=0x7f8a7415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 0x7f8a60003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60003f80 0x7f8a60004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a60004d90 0x7f8a60005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740ccfc0 con 0x7f8a60004d90 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b5240 con 0x7f8a60003f80 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6000ba40 con 0x7f8a740d1650 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a60004d90 0x7f8a60005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a737fe700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 0x7f8a60003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a72ffd700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60003f80 0x7f8a60004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 -- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 msgr2=0x7f8a60003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a740d1650 0x7f8a60003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 -- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60003f80 msgr2=0x7f8a60004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60003f80 0x7f8a60004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 -- 172.21.15.43:0/267427757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600035b0 con 0x7f8a60004d90 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a73fff700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a60004d90 0x7f8a60005200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009fc0 tx=0x7f8a60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56ae964065859c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00ebd0 con 0x7f8a60004d90 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00f040 con 0x7f8a60004d90 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.938+0000 7f8a727fc700 1 -- 172.21.15.43:0/267427757 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c014480 con 0x7f8a60004d90 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a79f6c700 1 -- 172.21.15.43:0/267427757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a60004d90 msgr2=0x7f8a60005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/267427757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a60004d90 0x7f8a60005200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009fc0 tx=0x7f8a60005880 comp rx=0 tx=0).stop 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a73fff700 1 -- 172.21.15.43:0/267427757 reap_dead start 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a79f6c700 1 -- 172.21.15.43:0/267427757 shutdown_connections 2023-06-08T03:49:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a79f6c700 1 -- 172.21.15.43:0/267427757 >> 172.21.15.43:0/267427757 conn(0x7f8a74072120 msgr2=0x7f8a7406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:38.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a79f6c700 1 -- 172.21.15.43:0/267427757 shutdown_connections 2023-06-08T03:49:38.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.939+0000 7f8a79f6c700 1 -- 172.21.15.43:0/267427757 wait complete. 2023-06-08T03:49:38.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.940+0000 7f8a79f6c700 1 Processor -- start 2023-06-08T03:49:38.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.940+0000 7f8a79f6c700 1 -- start start 2023-06-08T03:49:38.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a79f6c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60004d90 0x7f8a74153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a79f6c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 0x7f8a740caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a79f6c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a74153230 0x7f8a740c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a79f6c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740caa30 con 0x7f8a74154090 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a79f6c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740c9e20 con 0x7f8a60004d90 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a79f6c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740ca100 con 0x7f8a74153230 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a72ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 0x7f8a740caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a72ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 0x7f8a740caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59630/0 (socket says 172.21.15.43:59630) 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a72ffd700 1 -- 172.21.15.43:0/1656688421 learned_addr learned my addr 172.21.15.43:0/1656688421 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a73fff700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a74153230 0x7f8a740c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.941+0000 7f8a737fe700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60004d90 0x7f8a74153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a72ffd700 1 -- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a74153230 msgr2=0x7f8a740c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a72ffd700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a74153230 0x7f8a740c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a72ffd700 1 -- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60004d90 msgr2=0x7f8a74153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a72ffd700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60004d90 0x7f8a74153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a72ffd700 1 -- 172.21.15.43:0/1656688421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740ca3e0 con 0x7f8a74154090 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a73fff700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a74153230 0x7f8a740c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a72ffd700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 0x7f8a740caec0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c000fb0 tx=0x7f8a5c0076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00f8a0 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c00fa20 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00fdd0 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a740ca6c0 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.942+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a740c9a40 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.943+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a740cabe0 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.944+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a5c01d460 con 0x7f8a74154090 2023-06-08T03:49:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.944+0000 7f8a6bfff700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8a5406ace0 0x7f8a5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.944+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8a5c089730 con 0x7f8a74154090 2023-06-08T03:49:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.944+0000 7f8a737fe700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8a5406ace0 0x7f8a5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.945+0000 7f8a737fe700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8a5406ace0 0x7f8a5406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a7415fa80 tx=0x7f8a64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:38.948+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a740cabe0 con 0x7f8a74154090 2023-06-08T03:49:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.146+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a74073fa0 con 0x7f8a74154090 2023-06-08T03:49:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.146+0000 7f8a6bfff700 1 -- 172.21.15.43:0/1656688421 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a5c0544b0 con 0x7f8a74154090 2023-06-08T03:49:39.150 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8a5406ace0 msgr2=0x7f8a5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8a5406ace0 0x7f8a5406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a7415fa80 tx=0x7f8a64008040 comp rx=0 tx=0).stop 2023-06-08T03:49:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 msgr2=0x7f8a740caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 0x7f8a740caec0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c000fb0 tx=0x7f8a5c0076a0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 shutdown_connections 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8a5406ace0 0x7f8a5406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a74153230 0x7f8a740c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a60004d90 0x7f8a74153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 --2- 172.21.15.43:0/1656688421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a74154090 0x7f8a740caec0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 >> 172.21.15.43:0/1656688421 conn(0x7f8a74072120 msgr2=0x7f8a740cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 shutdown_connections 2023-06-08T03:49:39.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.149+0000 7f8a79f6c700 1 -- 172.21.15.43:0/1656688421 wait complete. 2023-06-08T03:49:39.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.289+0000 7f91fc577700 1 Processor -- start 2023-06-08T03:49:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.289+0000 7f91fc577700 1 -- start start 2023-06-08T03:49:39.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fc577700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91f40cd930 0x7f91f40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fc577700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91f40b1dc0 0x7f91f40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fc577700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f406f480 con 0x7f91f4159380 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fc577700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f40b10d0 con 0x7f91f40b1dc0 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fc577700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f406f760 con 0x7f91f40cd930 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91f40b1dc0 0x7f91f40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91f40b1dc0 0x7f91f40ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59638/0 (socket says 172.21.15.43:59638) 2023-06-08T03:49:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 -- 172.21.15.43:0/2850162482 learned_addr learned my addr 172.21.15.43:0/2850162482 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91f9b12700 1 --2- 172.21.15.43:0/2850162482 >> v2:172.21.15.135:3300/0 conn(0x7f91f40cd930 0x7f91f40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 -- 172.21.15.43:0/2850162482 >> v2:172.21.15.135:3300/0 conn(0x7f91f40cd930 msgr2=0x7f91f40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 --2- 172.21.15.43:0/2850162482 >> v2:172.21.15.135:3300/0 conn(0x7f91f40cd930 0x7f91f40716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 -- 172.21.15.43:0/2850162482 >> v1:172.21.15.135:6789/0 conn(0x7f91f4159380 legacy=0x7f91f40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 -- 172.21.15.43:0/2850162482 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40b12e0 con 0x7f91f40b1dc0 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91f9b12700 1 --2- 172.21.15.43:0/2850162482 >> v2:172.21.15.135:3300/0 conn(0x7f91f40cd930 0x7f91f40716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.290+0000 7f91fab14700 1 --2- 172.21.15.43:0/2850162482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f40b1dc0 0x7f91f40ca580 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f91f4070ca0 tx=0x7f91ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9380eb3a9ba55141 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91f9311700 1 -- 172.21.15.43:0/2850162482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00e070 con 0x7f91f40b1dc0 2023-06-08T03:49:39.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91f9311700 1 -- 172.21.15.43:0/2850162482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec003a20 con 0x7f91f40b1dc0 2023-06-08T03:49:39.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91f9311700 1 -- 172.21.15.43:0/2850162482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec003dd0 con 0x7f91f40b1dc0 2023-06-08T03:49:39.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 -- 172.21.15.43:0/2850162482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f40b1dc0 msgr2=0x7f91f40ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 --2- 172.21.15.43:0/2850162482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f40b1dc0 0x7f91f40ca580 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f91f4070ca0 tx=0x7f91ec00b330 comp rx=0 tx=0).stop 2023-06-08T03:49:39.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 -- 172.21.15.43:0/2850162482 shutdown_connections 2023-06-08T03:49:39.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 --2- 172.21.15.43:0/2850162482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f40b1dc0 0x7f91f40ca580 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 --2- 172.21.15.43:0/2850162482 >> v2:172.21.15.135:3300/0 conn(0x7f91f40cd930 0x7f91f40716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 -- 172.21.15.43:0/2850162482 >> 172.21.15.43:0/2850162482 conn(0x7f91f406aec0 msgr2=0x7f91f406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 -- 172.21.15.43:0/2850162482 shutdown_connections 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.291+0000 7f91fc577700 1 -- 172.21.15.43:0/2850162482 wait complete. 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.292+0000 7f91fc577700 1 Processor -- start 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.292+0000 7f91fc577700 1 -- start start 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fc577700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f40b1dc0 0x7f91f41e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fc577700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91f40cd930 0x7f91f41e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fc577700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 0x7f91f4158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fc577700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41e50b0 con 0x7f91f4159380 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fc577700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41e5390 con 0x7f91f40b1dc0 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fc577700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41e5670 con 0x7f91f40cd930 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fab14700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 0x7f91f4158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fab14700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 0x7f91f4158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59646/0 (socket says 172.21.15.43:59646) 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fab14700 1 -- 172.21.15.43:0/18457513 learned_addr learned my addr 172.21.15.43:0/18457513 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.293+0000 7f91fa313700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f40b1dc0 0x7f91f41e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91f9b12700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91f40cd930 0x7f91f41e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fab14700 1 -- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91f40cd930 msgr2=0x7f91f41e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fab14700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91f40cd930 0x7f91f41e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fab14700 1 -- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f40b1dc0 msgr2=0x7f91f41e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fab14700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f40b1dc0 0x7f91f41e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fab14700 1 -- 172.21.15.43:0/18457513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009b30 con 0x7f91f4159380 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91f9b12700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91f40cd930 0x7f91f41e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fa313700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f40b1dc0 0x7f91f41e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:39.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fab14700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 0x7f91f4158250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f91ec015040 tx=0x7f91ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec004440 con 0x7f91f4159380 2023-06-08T03:49:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec0045c0 con 0x7f91f4159380 2023-06-08T03:49:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f41e5950 con 0x7f91f4159380 2023-06-08T03:49:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec004970 con 0x7f91f4159380 2023-06-08T03:49:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.294+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4158790 con 0x7f91f4159380 2023-06-08T03:49:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.295+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f4158920 con 0x7f91f4159380 2023-06-08T03:49:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.295+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91ec012430 con 0x7f91f4159380 2023-06-08T03:49:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.296+0000 7f91eaffd700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f91d806ace0 0x7f91d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.296+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f91ec08adf0 con 0x7f91f4159380 2023-06-08T03:49:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.296+0000 7f91fa313700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f91d806ace0 0x7f91d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.296+0000 7f91fa313700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f91d806ace0 0x7f91d806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91f0006fd0 tx=0x7f91f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:39.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.300+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91ec055c40 con 0x7f91f4159380 2023-06-08T03:49:39.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.498+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91f4073fa0 con 0x7f91f4159380 2023-06-08T03:49:39.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.499+0000 7f91eaffd700 1 -- 172.21.15.43:0/18457513 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91ec076e60 con 0x7f91f4159380 2023-06-08T03:49:39.502 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:39.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f91d806ace0 msgr2=0x7f91d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f91d806ace0 0x7f91d806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91f0006fd0 tx=0x7f91f0008040 comp rx=0 tx=0).stop 2023-06-08T03:49:39.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 msgr2=0x7f91f4158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 0x7f91f4158250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f91ec015040 tx=0x7f91ec004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 shutdown_connections 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f91d806ace0 0x7f91d806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91f4159380 0x7f91f4158250 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f40b1dc0 0x7f91f41e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 --2- 172.21.15.43:0/18457513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91f40cd930 0x7f91f41e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 >> 172.21.15.43:0/18457513 conn(0x7f91f406aec0 msgr2=0x7f91f40b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 shutdown_connections 2023-06-08T03:49:39.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.501+0000 7f91fc577700 1 -- 172.21.15.43:0/18457513 wait complete. 2023-06-08T03:49:39.516 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.640+0000 7f20f7db4700 1 Processor -- start 2023-06-08T03:49:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.640+0000 7f20f7db4700 1 -- start start 2023-06-08T03:49:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f7db4700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20f00cd300 0x7f20f00ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f7db4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f01591d0 0x7f20f0071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f7db4700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f00716e0 con 0x7f20f00cded0 2023-06-08T03:49:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f7db4700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f006f4a0 con 0x7f20f00cd300 2023-06-08T03:49:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f7db4700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00ce7e0 con 0x7f20f01591d0 2023-06-08T03:49:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20f00cd300 0x7f20f00ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20f00cd300 0x7f20f00ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59652/0 (socket says 172.21.15.43:59652) 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 -- 172.21.15.43:0/2470897207 learned_addr learned my addr 172.21.15.43:0/2470897207 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f6351700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f01591d0 0x7f20f0071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 -- 172.21.15.43:0/2470897207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f01591d0 msgr2=0x7f20f0071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f01591d0 0x7f20f0071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 -- 172.21.15.43:0/2470897207 >> v1:172.21.15.135:6789/0 conn(0x7f20f00cded0 legacy=0x7f20f015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:39.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f534f700 1 -- 172.21.15.43:0/2470897207 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f006f6b0 con 0x7f20f00cd300 2023-06-08T03:49:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.641+0000 7f20f6351700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f01591d0 0x7f20f0071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f534f700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cd300 0x7f20f00ce2a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00bb90 tx=0x7f20ec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345295bbe27f3550 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f4b4e700 1 -- 172.21.15.43:0/2470897207 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00dd10 con 0x7f20f00cd300 2023-06-08T03:49:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f4b4e700 1 -- 172.21.15.43:0/2470897207 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec00de70 con 0x7f20f00cd300 2023-06-08T03:49:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f4b4e700 1 -- 172.21.15.43:0/2470897207 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004230 con 0x7f20f00cd300 2023-06-08T03:49:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 -- 172.21.15.43:0/2470897207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cd300 msgr2=0x7f20f00ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cd300 0x7f20f00ce2a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00bb90 tx=0x7f20ec00bea0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 -- 172.21.15.43:0/2470897207 shutdown_connections 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f01591d0 0x7f20f0071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 --2- 172.21.15.43:0/2470897207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cd300 0x7f20f00ce2a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 -- 172.21.15.43:0/2470897207 >> 172.21.15.43:0/2470897207 conn(0x7f20f006aec0 msgr2=0x7f20f006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 -- 172.21.15.43:0/2470897207 shutdown_connections 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.642+0000 7f20f7db4700 1 -- 172.21.15.43:0/2470897207 wait complete. 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 Processor -- start 2023-06-08T03:49:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 -- start start 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00cd300 0x7f20f00c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 0x7f20f014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01591d0 0x7f20f00cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c5ff0 con 0x7f20f00cded0 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c8da0 con 0x7f20f01591d0 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f7db4700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c7d00 con 0x7f20f00cd300 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f534f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 0x7f20f014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.644+0000 7f20f534f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 0x7f20f014fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59658/0 (socket says 172.21.15.43:59658) 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 -- 172.21.15.43:0/3495176104 learned_addr learned my addr 172.21.15.43:0/3495176104 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f5b50700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00cd300 0x7f20f00c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f6351700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01591d0 0x7f20f00cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 -- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00cd300 msgr2=0x7f20f00c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00cd300 0x7f20f00c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 -- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01591d0 msgr2=0x7f20f00cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01591d0 0x7f20f00cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 -- 172.21.15.43:0/3495176104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec00b7f0 con 0x7f20f00cded0 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f6351700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01591d0 0x7f20f00cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f5b50700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00cd300 0x7f20f00c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f534f700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 0x7f20f014fa40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00b340 tx=0x7f20ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec020070 con 0x7f20f00cded0 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec004030 con 0x7f20f00cded0 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f00c7fe0 con 0x7f20f00cded0 2023-06-08T03:49:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec010470 con 0x7f20f00cded0 2023-06-08T03:49:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.645+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f00c85a0 con 0x7f20f00cded0 2023-06-08T03:49:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.646+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f0073fa0 con 0x7f20f00cded0 2023-06-08T03:49:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.647+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20ec0193f0 con 0x7f20f00cded0 2023-06-08T03:49:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.647+0000 7f20e67fc700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f20d406ace0 0x7f20d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.647+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f20ec08ccf0 con 0x7f20f00cded0 2023-06-08T03:49:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.647+0000 7f20f5b50700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f20d406ace0 0x7f20d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.648+0000 7f20f5b50700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f20d406ace0 0x7f20d406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20e0003fc0 tx=0x7f20e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.651+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20ec091070 con 0x7f20f00cded0 2023-06-08T03:49:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.849+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20f00c9eb0 con 0x7f20f00cded0 2023-06-08T03:49:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.849+0000 7f20e67fc700 1 -- 172.21.15.43:0/3495176104 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20ec057a80 con 0x7f20f00cded0 2023-06-08T03:49:39.853 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f20d406ace0 msgr2=0x7f20d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f20d406ace0 0x7f20d406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20e0003fc0 tx=0x7f20e0009040 comp rx=0 tx=0).stop 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 msgr2=0x7f20f014fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 0x7f20f014fa40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00b340 tx=0x7f20ec004750 comp rx=0 tx=0).stop 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 shutdown_connections 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f20d406ace0 0x7f20d406d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01591d0 0x7f20f00cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00cd300 0x7f20f00c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 --2- 172.21.15.43:0/3495176104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20f00cded0 0x7f20f014fa40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 >> 172.21.15.43:0/3495176104 conn(0x7f20f006aec0 msgr2=0x7f20f0153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:39.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 shutdown_connections 2023-06-08T03:49:39.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.851+0000 7f20f7db4700 1 -- 172.21.15.43:0/3495176104 wait complete. 2023-06-08T03:49:39.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.990+0000 7f4ebf05f700 1 Processor -- start 2023-06-08T03:49:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.990+0000 7f4ebf05f700 1 -- start start 2023-06-08T03:49:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebf05f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 0x7f4eb80b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebf05f700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb815c750 con 0x7f4eb80d1650 2023-06-08T03:49:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebf05f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb80cf740 con 0x7f4eb80ccb00 2023-06-08T03:49:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebf05f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80ccfc0 con 0x7f4eb80b43f0 2023-06-08T03:49:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebd5fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4eb80d1650 0x7f4eb8160500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54572/0 (socket says 172.21.15.43:54572) 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebd5fc700 1 -- 172.21.15.43:0/3277782701 learned_addr learned my addr 172.21.15.43:0/3277782701 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4ebcdfb700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 0x7f4eb80b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.991+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950555758 0 0) 0x7f4eb0001490 con 0x7f4eb80d1650 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ea80035b0 con 0x7f4eb80d1650 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140684581 0 0) 0x7f4eb80cf740 con 0x7f4eb80ccb00 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb0001490 con 0x7f4eb80ccb00 2023-06-08T03:49:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104869448 0 0) 0x7f4ea80035b0 con 0x7f4eb80d1650 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 msgr2=0x7f4eb80b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 0x7f4eb80b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 >> v1:172.21.15.135:6789/0 conn(0x7f4eb80ccb00 legacy=0x7f4eb815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80cd540 con 0x7f4eb80d1650 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f4eb0001b80 con 0x7f4eb80d1650 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 >> v1:172.21.15.43:6789/0 conn(0x7f4eb80d1650 legacy=0x7f4eb8160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 0x7f4ea8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ea8004170 0x7f4ea8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8004d90 0x7f4ea8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80ccfc0 con 0x7f4ea8004170 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea800bba0 con 0x7f4ea8004d90 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea800bd60 con 0x7f4eb80b43f0 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb7fff700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ea8004170 0x7f4ea8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4ebcdfb700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 0x7f4ea8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4ebd5fc700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8004d90 0x7f4ea8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb7fff700 1 -- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 msgr2=0x7f4ea8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb7fff700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eb80b43f0 0x7f4ea8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb7fff700 1 -- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8004d90 msgr2=0x7f4ea8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb7fff700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8004d90 0x7f4ea8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.992+0000 7f4eb7fff700 1 -- 172.21.15.43:0/3277782701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80035b0 con 0x7f4ea8004170 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4eb7fff700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ea8004170 0x7f4ea8004850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80ccf70 tx=0x7f4ea8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf929c9b0687fb36 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4001d80 con 0x7f4ea8004170 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea40052d0 con 0x7f4ea8004170 2023-06-08T03:49:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4eb77fe700 1 -- 172.21.15.43:0/3277782701 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4001470 con 0x7f4ea8004170 2023-06-08T03:49:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebf05f700 1 -- 172.21.15.43:0/3277782701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ea8004170 msgr2=0x7f4ea8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/3277782701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ea8004170 0x7f4ea8004850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80ccf70 tx=0x7f4ea8005880 comp rx=0 tx=0).stop 2023-06-08T03:49:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebd5fc700 1 -- 172.21.15.43:0/3277782701 reap_dead start 2023-06-08T03:49:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebf05f700 1 -- 172.21.15.43:0/3277782701 shutdown_connections 2023-06-08T03:49:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebf05f700 1 -- 172.21.15.43:0/3277782701 >> 172.21.15.43:0/3277782701 conn(0x7f4eb8072120 msgr2=0x7f4eb806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebf05f700 1 -- 172.21.15.43:0/3277782701 shutdown_connections 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.993+0000 7f4ebf05f700 1 -- 172.21.15.43:0/3277782701 wait complete. 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.995+0000 7f4ebf05f700 1 Processor -- start 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.995+0000 7f4ebf05f700 1 -- start start 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebf05f700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ea8004170 0x7f4eb80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebf05f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eb80ca650 0x7f4eb81509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebf05f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 0x7f4eb80b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebf05f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80ca230 con 0x7f4eb80cac90 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebf05f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80caac0 con 0x7f4eb80ca650 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebf05f700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8150ee0 con 0x7f4ea8004170 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebd5fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 0x7f4eb80b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebd5fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 0x7f4eb80b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59680/0 (socket says 172.21.15.43:59680) 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebd5fc700 1 -- 172.21.15.43:0/2830596764 learned_addr learned my addr 172.21.15.43:0/2830596764 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebcdfb700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ea8004170 0x7f4eb80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.996+0000 7f4ebd5fc700 1 -- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ea8004170 msgr2=0x7f4eb80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebd5fc700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ea8004170 0x7f4eb80c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebd5fc700 1 -- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eb80ca650 msgr2=0x7f4eb81509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebd5fc700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eb80ca650 0x7f4eb81509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebd5fc700 1 -- 172.21.15.43:0/2830596764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80cb4e0 con 0x7f4eb80cac90 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebd5fc700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 0x7f4eb80b3510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80b1a70 tx=0x7f4eb0007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0007af0 con 0x7f4eb80cac90 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb00133f0 con 0x7f4eb80cac90 2023-06-08T03:49:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00137a0 con 0x7f4eb80cac90 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb80c9b70 con 0x7f4eb80cac90 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.997+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb80cb7c0 con 0x7f4eb80cac90 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.998+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb80ca370 con 0x7f4eb80cac90 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.998+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4eb0013900 con 0x7f4eb80cac90 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.999+0000 7f4eb57fa700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4e9c06ace0 0x7f4e9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.999+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4eb008a1b0 con 0x7f4eb80cac90 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:39.999+0000 7f4ebcdfb700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4e9c06ace0 0x7f4e9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.000+0000 7f4ebcdfb700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4e9c06ace0 0x7f4e9c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0099c0 tx=0x7f4eac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.003+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4eb80ca370 con 0x7f4eb80cac90 2023-06-08T03:49:40.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.202+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4eb815c750 con 0x7f4eb80cac90 2023-06-08T03:49:40.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.202+0000 7f4eb57fa700 1 -- 172.21.15.43:0/2830596764 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4eb815c750 con 0x7f4eb80cac90 2023-06-08T03:49:40.206 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4e9c06ace0 msgr2=0x7f4e9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4e9c06ace0 0x7f4e9c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0099c0 tx=0x7f4eac008040 comp rx=0 tx=0).stop 2023-06-08T03:49:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 msgr2=0x7f4eb80b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 0x7f4eb80b3510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80b1a70 tx=0x7f4eb0007340 comp rx=0 tx=0).stop 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 shutdown_connections 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4e9c06ace0 0x7f4e9c06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eb80cac90 0x7f4eb80b3510 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ea8004170 0x7f4eb80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 --2- 172.21.15.43:0/2830596764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eb80ca650 0x7f4eb81509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 >> 172.21.15.43:0/2830596764 conn(0x7f4eb8072120 msgr2=0x7f4eb80b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 shutdown_connections 2023-06-08T03:49:40.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.204+0000 7f4ebf05f700 1 -- 172.21.15.43:0/2830596764 wait complete. 2023-06-08T03:49:40.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T03:49:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.341+0000 7fc438bec700 1 Processor -- start 2023-06-08T03:49:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.341+0000 7fc438bec700 1 -- start start 2023-06-08T03:49:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc438bec700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4340ccf50 0x7fc4340cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc438bec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340cafb0 0x7fc4340cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc438bec700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4340d14e0 con 0x7fc43415c170 2023-06-08T03:49:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc438bec700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4340d06f0 con 0x7fc4340ccf50 2023-06-08T03:49:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc438bec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43415c540 con 0x7fc4340cafb0 2023-06-08T03:49:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc431d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4340ccf50 0x7fc4340cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc431d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4340ccf50 0x7fc4340cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:41300/0 (socket says 172.21.15.43:41300) 2023-06-08T03:49:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc432d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340cafb0 0x7fc4340cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.342+0000 7fc431d9b700 1 -- 172.21.15.43:0/1383701799 learned_addr learned my addr 172.21.15.43:0/1383701799 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc431d9b700 1 -- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340cafb0 msgr2=0x7fc4340cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc431d9b700 1 --2- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340cafb0 0x7fc4340cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc431d9b700 1 -- 172.21.15.43:0/1383701799 >> v1:172.21.15.135:6789/0 conn(0x7fc43415c170 legacy=0x7fc4340b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc43159a700 1 -- 172.21.15.43:0/1383701799 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242602554 0 0) 0x7fc4340d14e0 con 0x7fc43415c170 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc431d9b700 1 -- 172.21.15.43:0/1383701799 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340b2bb0 con 0x7fc4340ccf50 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc431d9b700 1 --2- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340ccf50 0x7fc4340cd3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098f0 tx=0x7fc424009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a5e3742f5c2c50 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc43159a700 1 -- 172.21.15.43:0/1383701799 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011830 con 0x7fc4340ccf50 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc43159a700 1 -- 172.21.15.43:0/1383701799 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424011990 con 0x7fc4340ccf50 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.343+0000 7fc43159a700 1 -- 172.21.15.43:0/1383701799 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011d20 con 0x7fc4340ccf50 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 -- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340ccf50 msgr2=0x7fc4340cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 --2- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340ccf50 0x7fc4340cd3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098f0 tx=0x7fc424009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 -- 172.21.15.43:0/1383701799 shutdown_connections 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 --2- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4340cafb0 0x7fc4340cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 --2- 172.21.15.43:0/1383701799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340ccf50 0x7fc4340cd3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 -- 172.21.15.43:0/1383701799 >> 172.21.15.43:0/1383701799 conn(0x7fc434069db0 msgr2=0x7fc43406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:40.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 -- 172.21.15.43:0/1383701799 shutdown_connections 2023-06-08T03:49:40.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.344+0000 7fc438bec700 1 -- 172.21.15.43:0/1383701799 wait complete. 2023-06-08T03:49:40.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.345+0000 7fc438bec700 1 Processor -- start 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.345+0000 7fc438bec700 1 -- start start 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc438bec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340cafb0 0x7fc43414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc438bec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 0x7fc43415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc438bec700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43415c170 0x7fc43415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc438bec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43415b970 con 0x7fc4340ccf50 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc438bec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43415f500 con 0x7fc4340cafb0 2023-06-08T03:49:40.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc438bec700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340b3610 con 0x7fc43415c170 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc431d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 0x7fc43415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc431d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 0x7fc43415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59690/0 (socket says 172.21.15.43:59690) 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc431d9b700 1 -- 172.21.15.43:0/1787507242 learned_addr learned my addr 172.21.15.43:0/1787507242 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.346+0000 7fc43259c700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340cafb0 0x7fc43414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc432d9d700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43415c170 0x7fc43415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc431d9b700 1 -- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43415c170 msgr2=0x7fc43415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc431d9b700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43415c170 0x7fc43415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc431d9b700 1 -- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340cafb0 msgr2=0x7fc43414c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc431d9b700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340cafb0 0x7fc43414c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc431d9b700 1 -- 172.21.15.43:0/1787507242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009550 con 0x7fc4340ccf50 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc43259c700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340cafb0 0x7fc43414c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc432d9d700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43415c170 0x7fc43415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc431d9b700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 0x7fc43415c680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc43406e130 tx=0x7fc424004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424004480 con 0x7fc4340ccf50 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42401f070 con 0x7fc4340ccf50 2023-06-08T03:49:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240038c0 con 0x7fc4340ccf50 2023-06-08T03:49:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4340c9df0 con 0x7fc4340ccf50 2023-06-08T03:49:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.347+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4340b3b90 con 0x7fc4340ccf50 2023-06-08T03:49:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.348+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc434073fa0 con 0x7fc4340ccf50 2023-06-08T03:49:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.348+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc424021030 con 0x7fc4340ccf50 2023-06-08T03:49:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.349+0000 7fc422ffd700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc41406ace0 0x7fc41406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.349+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc42408ad50 con 0x7fc4340ccf50 2023-06-08T03:49:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.349+0000 7fc43259c700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc41406ace0 0x7fc41406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.350+0000 7fc43259c700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc41406ace0 0x7fc41406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc428000f60 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.353+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc42408e030 con 0x7fc4340ccf50 2023-06-08T03:49:40.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.570+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4340b66c0 con 0x7fc4340ccf50 2023-06-08T03:49:40.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.570+0000 7fc422ffd700 1 -- 172.21.15.43:0/1787507242 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc424055c80 con 0x7fc4340ccf50 2023-06-08T03:49:40.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc41406ace0 msgr2=0x7fc41406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc41406ace0 0x7fc41406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc428000f60 tx=0x7fc428009040 comp rx=0 tx=0).stop 2023-06-08T03:49:40.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 msgr2=0x7fc43415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 0x7fc43415c680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc43406e130 tx=0x7fc424004750 comp rx=0 tx=0).stop 2023-06-08T03:49:40.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 shutdown_connections 2023-06-08T03:49:40.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc41406ace0 0x7fc41406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43415c170 0x7fc43415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4340cafb0 0x7fc43414c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 --2- 172.21.15.43:0/1787507242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4340ccf50 0x7fc43415c680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 >> 172.21.15.43:0/1787507242 conn(0x7fc434069db0 msgr2=0x7fc434156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:40.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 shutdown_connections 2023-06-08T03:49:40.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.572+0000 7fc438bec700 1 -- 172.21.15.43:0/1787507242 wait complete. 2023-06-08T03:49:40.578 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T03:49:40.587 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-08T03:49:40.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:40.588 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-08T03:49:40.659 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:49:40.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:40.660 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-08T03:49:40.682 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:40.683 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:40.700 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:40.701 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:40.757 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:49:40.758 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:40.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:40.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.976+0000 7fbcab211700 1 Processor -- start 2023-06-08T03:49:40.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.976+0000 7fbcab211700 1 -- start start 2023-06-08T03:49:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbcab211700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbca406b4b0 0x7fbca4145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbcab211700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbca40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbcab211700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca40d16e0 con 0x7fbca4145cd0 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbcab211700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca40cd050 con 0x7fbca406b4b0 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbcab211700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40cc1d0 con 0x7fbca40d0e70 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbca4145cd0 0x7fbca40d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54602/0 (socket says 172.21.15.43:54602) 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca3fff700 1 -- 172.21.15.43:0/1766411117 learned_addr learned my addr 172.21.15.43:0/1766411117 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca97ae700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbca40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca8fad700 1 --2- 172.21.15.43:0/1766411117 >> v2:172.21.15.135:3300/0 conn(0x7fbca406b4b0 0x7fbca4145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027023880 0 0) 0x7fbc90001110 con 0x7fbca4145cd0 2023-06-08T03:49:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc940035b0 con 0x7fbca4145cd0 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 379270901 0 0) 0x7fbc940035b0 con 0x7fbca4145cd0 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 msgr2=0x7fbca40caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbca40caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 >> v2:172.21.15.135:3300/0 conn(0x7fbca406b4b0 msgr2=0x7fbca4145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 --2- 172.21.15.43:0/1766411117 >> v2:172.21.15.135:3300/0 conn(0x7fbca406b4b0 0x7fbca4145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40cd2a0 con 0x7fbca4145cd0 2023-06-08T03:49:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7fbc90001800 con 0x7fbca4145cd0 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.977+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 >> v1:172.21.15.43:6789/0 conn(0x7fbca4145cd0 legacy=0x7fbca40d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc94003a00 0x7fbc94003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbc94004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc94004d90 0x7fbc94005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40cd050 con 0x7fbc94003a00 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40cc1d0 con 0x7fbc94004d90 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9400ba10 con 0x7fbca40d0e70 2023-06-08T03:49:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc94003a00 0x7fbc94003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca3fff700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbc94004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca97ae700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc94004d90 0x7fbc94005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 -- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 msgr2=0x7fbc94004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbc94004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 -- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc94004d90 msgr2=0x7fbc94005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc94004d90 0x7fbc94005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 -- 172.21.15.43:0/1766411117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940035b0 con 0x7fbc94003a00 2023-06-08T03:49:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca3fff700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40d0e70 0x7fbc94004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca8fad700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc94003a00 0x7fbc94003e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009b40 tx=0x7fbc94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8164c7acf9514da1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98005a20 con 0x7fbc94003a00 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98005b80 con 0x7fbc94003a00 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.978+0000 7fbca37fe700 1 -- 172.21.15.43:0/1766411117 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800e6c0 con 0x7fbc94003a00 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbcab211700 1 -- 172.21.15.43:0/1766411117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc94003a00 msgr2=0x7fbc94003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbcab211700 1 --2- 172.21.15.43:0/1766411117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc94003a00 0x7fbc94003e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009b40 tx=0x7fbc94005880 comp rx=0 tx=0).stop 2023-06-08T03:49:40.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbca97ae700 1 -- 172.21.15.43:0/1766411117 reap_dead start 2023-06-08T03:49:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbcab211700 1 -- 172.21.15.43:0/1766411117 shutdown_connections 2023-06-08T03:49:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbcab211700 1 -- 172.21.15.43:0/1766411117 >> 172.21.15.43:0/1766411117 conn(0x7fbca406a6d0 msgr2=0x7fbca4099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbcab211700 1 -- 172.21.15.43:0/1766411117 shutdown_connections 2023-06-08T03:49:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.979+0000 7fbcab211700 1 -- 172.21.15.43:0/1766411117 wait complete. 2023-06-08T03:49:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.980+0000 7fbcab211700 1 Processor -- start 2023-06-08T03:49:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.980+0000 7fbcab211700 1 -- start start 2023-06-08T03:49:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbcab211700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc94003a00 0x7fbca40c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbcab211700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca41f5390 0x7fbca41f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbcab211700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 0x7fbca40c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbcab211700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b42a0 con 0x7fbca41f5d40 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbcab211700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b50a0 con 0x7fbca41f5390 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbcab211700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca41f6190 con 0x7fbc94003a00 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 0x7fbca40c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 0x7fbca40c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59712/0 (socket says 172.21.15.43:59712) 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 -- 172.21.15.43:0/3556322274 learned_addr learned my addr 172.21.15.43:0/3556322274 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca8fad700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc94003a00 0x7fbca40c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca3fff700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca41f5390 0x7fbca41f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 -- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc94003a00 msgr2=0x7fbca40c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc94003a00 0x7fbca40c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 -- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca41f5390 msgr2=0x7fbca41f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca41f5390 0x7fbca41f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 -- 172.21.15.43:0/3556322274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40b4490 con 0x7fbca41f5d40 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.981+0000 7fbca97ae700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 0x7fbca40c4270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbca406dbb0 tx=0x7fbc9c0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.982+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00e070 con 0x7fbca41f5d40 2023-06-08T03:49:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.982+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c003c30 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.982+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca40b4770 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.982+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003de0 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.982+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca40b4d30 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.982+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca40b5250 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.983+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc9c011a10 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.983+0000 7fbca17fa700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc8806ace0 0x7fbc8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.983+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc9c089bc0 con 0x7fbca41f5d40 2023-06-08T03:49:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.984+0000 7fbca8fad700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc8806ace0 0x7fbc8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.984+0000 7fbca8fad700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc8806ace0 0x7fbc8806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009a60 tx=0x7fbc98008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:40.988+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbca40b5250 con 0x7fbca41f5d40 2023-06-08T03:49:41.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.188+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca40b5250 con 0x7fbca41f5d40 2023-06-08T03:49:41.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.190+0000 7fbca17fa700 1 -- 172.21.15.43:0/3556322274 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fbca40b5250 con 0x7fbca41f5d40 2023-06-08T03:49:41.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:41.193 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:41.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc8806ace0 msgr2=0x7fbc8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc8806ace0 0x7fbc8806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009a60 tx=0x7fbc98008030 comp rx=0 tx=0).stop 2023-06-08T03:49:41.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 msgr2=0x7fbca40c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 0x7fbca40c4270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbca406dbb0 tx=0x7fbc9c0114b0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 shutdown_connections 2023-06-08T03:49:41.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbc8806ace0 0x7fbc8806d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbca41f5d40 0x7fbca40c4270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc94003a00 0x7fbca40c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 --2- 172.21.15.43:0/3556322274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca41f5390 0x7fbca41f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 >> 172.21.15.43:0/3556322274 conn(0x7fbca406a6d0 msgr2=0x7fbca40ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:41.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 shutdown_connections 2023-06-08T03:49:41.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.192+0000 7fbcab211700 1 -- 172.21.15.43:0/3556322274 wait complete. 2023-06-08T03:49:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:41.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:41.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.332+0000 7f064294d700 1 Processor -- start 2023-06-08T03:49:41.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.332+0000 7f064294d700 1 -- start start 2023-06-08T03:49:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f064294d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f063c0cd840 0x7f063c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f064294d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d0d30 con 0x7f063c0ce310 2023-06-08T03:49:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f064294d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d1520 con 0x7f063c15c270 2023-06-08T03:49:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f064294d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c06aec0 con 0x7f063c0cd840 2023-06-08T03:49:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f063b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f063c0cd840 0x7f063c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f0640eea700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f063c0ce310 0x7f063c0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54624/0 (socket says 172.21.15.43:54624) 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f0640eea700 1 -- 172.21.15.43:0/3251611251 learned_addr learned my addr 172.21.15.43:0/3251611251 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f063affd700 1 -- 172.21.15.43:0/3251611251 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008254918 0 0) 0x7f063c0d0d30 con 0x7f063c0ce310 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.333+0000 7f063affd700 1 -- 172.21.15.43:0/3251611251 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06280035b0 con 0x7f063c0ce310 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063b7fe700 1 -- 172.21.15.43:0/3251611251 >> v1:172.21.15.135:6789/0 conn(0x7f063c15c270 legacy=0x7f063c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063b7fe700 1 -- 172.21.15.43:0/3251611251 >> v1:172.21.15.43:6789/0 conn(0x7f063c0ce310 legacy=0x7f063c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063b7fe700 1 -- 172.21.15.43:0/3251611251 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0cb1a0 con 0x7f063c0cd840 2023-06-08T03:49:41.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063b7fe700 1 --2- 172.21.15.43:0/3251611251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0d07f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0624009840 tx=0x7f0624009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c2bdf4117f6e90 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:41.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063affd700 1 -- 172.21.15.43:0/3251611251 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624011830 con 0x7f063c0cd840 2023-06-08T03:49:41.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063affd700 1 -- 172.21.15.43:0/3251611251 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011990 con 0x7f063c0cd840 2023-06-08T03:49:41.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f063affd700 1 -- 172.21.15.43:0/3251611251 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624011d20 con 0x7f063c0cd840 2023-06-08T03:49:41.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f064294d700 1 -- 172.21.15.43:0/3251611251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 msgr2=0x7f063c0d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f064294d700 1 --2- 172.21.15.43:0/3251611251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0d07f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0624009840 tx=0x7f0624009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:41.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f064294d700 1 -- 172.21.15.43:0/3251611251 shutdown_connections 2023-06-08T03:49:41.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f064294d700 1 --2- 172.21.15.43:0/3251611251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0d07f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.334+0000 7f064294d700 1 -- 172.21.15.43:0/3251611251 >> 172.21.15.43:0/3251611251 conn(0x7f063c069db0 msgr2=0x7f063c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:41.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.335+0000 7f064294d700 1 -- 172.21.15.43:0/3251611251 shutdown_connections 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.335+0000 7f064294d700 1 -- 172.21.15.43:0/3251611251 wait complete. 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.336+0000 7f064294d700 1 Processor -- start 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.336+0000 7f064294d700 1 -- start start 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c0ce310 0x7f063c14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063c15c270 0x7f063c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c7810 con 0x7f063c0cd840 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c14c480 con 0x7f063c15c270 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ca110 con 0x7f063c0ce310 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59722/0 (socket says 172.21.15.43:59722) 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 -- 172.21.15.43:0/4026885967 learned_addr learned my addr 172.21.15.43:0/4026885967 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063b7fe700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c0ce310 0x7f063c14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f0640eea700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063c15c270 0x7f063c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 -- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c0ce310 msgr2=0x7f063c14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c0ce310 0x7f063c14bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 -- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063c15c270 msgr2=0x7f063c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063c15c270 0x7f063c0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 -- 172.21.15.43:0/4026885967 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240094a0 con 0x7f063c0cd840 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f063bfff700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0c8260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f062c00c450 tx=0x7f062c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0052d0 con 0x7f063c0cd840 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c005430 con 0x7f063c0cd840 2023-06-08T03:49:41.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0ca3f0 con 0x7f063c0cd840 2023-06-08T03:49:41.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.337+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0038c0 con 0x7f063c0cd840 2023-06-08T03:49:41.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.338+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0c7d40 con 0x7f063c0cd840 2023-06-08T03:49:41.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.338+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c073fa0 con 0x7f063c0cd840 2023-06-08T03:49:41.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.339+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f062c003a20 con 0x7f063c0cd840 2023-06-08T03:49:41.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.339+0000 7f0638ff9700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f061c06ace0 0x7f061c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.339+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f062c088b50 con 0x7f063c0cd840 2023-06-08T03:49:41.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.340+0000 7f063b7fe700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f061c06ace0 0x7f061c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.340+0000 7f063b7fe700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f061c06ace0 0x7f061c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f063c0cdc30 tx=0x7f0624008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:41.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.344+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f062c0538d0 con 0x7f063c0cd840 2023-06-08T03:49:41.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.541+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f063c0b2790 con 0x7f063c0cd840 2023-06-08T03:49:41.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.541+0000 7f0638ff9700 1 -- 172.21.15.43:0/4026885967 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f062c056ef0 con 0x7f063c0cd840 2023-06-08T03:49:41.545 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:41.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f061c06ace0 msgr2=0x7f061c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f061c06ace0 0x7f061c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f063c0cdc30 tx=0x7f0624008030 comp rx=0 tx=0).stop 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 msgr2=0x7f063c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0c8260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f062c00c450 tx=0x7f062c00c810 comp rx=0 tx=0).stop 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 shutdown_connections 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f061c06ace0 0x7f061c06d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f063c0cd840 0x7f063c0c8260 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063c15c270 0x7f063c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 --2- 172.21.15.43:0/4026885967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c0ce310 0x7f063c14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 >> 172.21.15.43:0/4026885967 conn(0x7f063c069db0 msgr2=0x7f063c0cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:41.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 shutdown_connections 2023-06-08T03:49:41.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.543+0000 7f064294d700 1 -- 172.21.15.43:0/4026885967 wait complete. 2023-06-08T03:49:41.559 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:41.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.683+0000 7fc6413e6700 1 Processor -- start 2023-06-08T03:49:41.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.683+0000 7fc6413e6700 1 -- start start 2023-06-08T03:49:41.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc6413e6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0b43f0 0x7fc63c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc6413e6700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc63c0ccb00 0x7fc63c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc6413e6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc63c15fdf0 0x7fc63c160250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc6413e6700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0ccfc0 con 0x7fc63c15fdf0 2023-06-08T03:49:41.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc6413e6700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0b5240 con 0x7fc63c0ccb00 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc6413e6700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c15c750 con 0x7fc63c0b43f0 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc63c15fdf0 0x7fc63c160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc63c15fdf0 0x7fc63c160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59734/0 (socket says 172.21.15.43:59734) 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 -- 172.21.15.43:0/2101710239 learned_addr learned my addr 172.21.15.43:0/2101710239 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63affd700 1 --2- 172.21.15.43:0/2101710239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0b43f0 0x7fc63c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63a7fc700 1 --2- 172.21.15.43:0/2101710239 >> v2:172.21.15.135:3300/0 conn(0x7fc63c0ccb00 0x7fc63c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 -- 172.21.15.43:0/2101710239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0b43f0 msgr2=0x7fc63c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 --2- 172.21.15.43:0/2101710239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0b43f0 0x7fc63c0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 -- 172.21.15.43:0/2101710239 >> v2:172.21.15.135:3300/0 conn(0x7fc63c0ccb00 msgr2=0x7fc63c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 --2- 172.21.15.43:0/2101710239 >> v2:172.21.15.135:3300/0 conn(0x7fc63c0ccb00 0x7fc63c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 -- 172.21.15.43:0/2101710239 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0cf740 con 0x7fc63c15fdf0 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63a7fc700 1 --2- 172.21.15.43:0/2101710239 >> v2:172.21.15.135:3300/0 conn(0x7fc63c0ccb00 0x7fc63c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc63b7fe700 1 --2- 172.21.15.43:0/2101710239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c160250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0b54c0 tx=0x7fc63400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4362d33110a18f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc639ffb700 1 -- 172.21.15.43:0/2101710239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400e070 con 0x7fc63c15fdf0 2023-06-08T03:49:41.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc639ffb700 1 -- 172.21.15.43:0/2101710239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63400b910 con 0x7fc63c15fdf0 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.684+0000 7fc639ffb700 1 -- 172.21.15.43:0/2101710239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400bcc0 con 0x7fc63c15fdf0 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 -- 172.21.15.43:0/2101710239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 msgr2=0x7fc63c160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 --2- 172.21.15.43:0/2101710239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c160250 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0b54c0 tx=0x7fc63400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 -- 172.21.15.43:0/2101710239 shutdown_connections 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 --2- 172.21.15.43:0/2101710239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c160250 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 --2- 172.21.15.43:0/2101710239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0b43f0 0x7fc63c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 --2- 172.21.15.43:0/2101710239 >> v2:172.21.15.135:3300/0 conn(0x7fc63c0ccb00 0x7fc63c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 -- 172.21.15.43:0/2101710239 >> 172.21.15.43:0/2101710239 conn(0x7fc63c072120 msgr2=0x7fc63c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:41.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 -- 172.21.15.43:0/2101710239 shutdown_connections 2023-06-08T03:49:41.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.685+0000 7fc6413e6700 1 -- 172.21.15.43:0/2101710239 wait complete. 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.686+0000 7fc6413e6700 1 Processor -- start 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.686+0000 7fc6413e6700 1 -- start start 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc6413e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc63c0b43f0 0x7fc63c151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc6413e6700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0ccb00 0x7fc63c1f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc6413e6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc6413e6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1524e0 con 0x7fc63c15fdf0 2023-06-08T03:49:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc6413e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1f3300 con 0x7fc63c0b43f0 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc6413e6700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1f2d40 con 0x7fc63c0ccb00 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59740/0 (socket says 172.21.15.43:59740) 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 -- 172.21.15.43:0/1549883575 learned_addr learned my addr 172.21.15.43:0/1549883575 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63affd700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc63c0b43f0 0x7fc63c151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 -- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0ccb00 msgr2=0x7fc63c1f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0ccb00 0x7fc63c1f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 -- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc63c0b43f0 msgr2=0x7fc63c151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.687+0000 7fc63b7fe700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc63c0b43f0 0x7fc63c151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc63b7fe700 1 -- 172.21.15.43:0/1549883575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634009b30 con 0x7fc63c15fdf0 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc63b7fe700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c1528e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc63c08b7c0 tx=0x7fc634004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340099b0 con 0x7fc63c15fdf0 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634004250 con 0x7fc63c15fdf0 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634004600 con 0x7fc63c15fdf0 2023-06-08T03:49:41.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c1f3020 con 0x7fc63c15fdf0 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.688+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0c7900 con 0x7fc63c15fdf0 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.689+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c0cd500 con 0x7fc63c15fdf0 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.689+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc634004760 con 0x7fc63c15fdf0 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.690+0000 7fc6237fe700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.690+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc63408ac70 con 0x7fc63c15fdf0 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.690+0000 7fc63affd700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:41.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.690+0000 7fc63affd700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc62806ace0 0x7fc62806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0b6da0 tx=0x7fc62c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.694+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc634055a80 con 0x7fc63c15fdf0 2023-06-08T03:49:41.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.891+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc63c073fa0 con 0x7fc63c15fdf0 2023-06-08T03:49:41.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.892+0000 7fc6237fe700 1 -- 172.21.15.43:0/1549883575 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc63402a020 con 0x7fc63c15fdf0 2023-06-08T03:49:41.895 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc62806ace0 msgr2=0x7fc62806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc62806ace0 0x7fc62806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0b6da0 tx=0x7fc62c008040 comp rx=0 tx=0).stop 2023-06-08T03:49:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 msgr2=0x7fc63c1528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c1528e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc63c08b7c0 tx=0x7fc634004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 shutdown_connections 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc63c15fdf0 0x7fc63c1528e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc63c0b43f0 0x7fc63c151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 --2- 172.21.15.43:0/1549883575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc63c0ccb00 0x7fc63c1f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 >> 172.21.15.43:0/1549883575 conn(0x7fc63c072120 msgr2=0x7fc63c0b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 shutdown_connections 2023-06-08T03:49:41.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:41.894+0000 7fc6413e6700 1 -- 172.21.15.43:0/1549883575 wait complete. 2023-06-08T03:49:41.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:42.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.033+0000 7fb906867700 1 Processor -- start 2023-06-08T03:49:42.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.033+0000 7fb906867700 1 -- start start 2023-06-08T03:49:42.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb906867700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb90015d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb906867700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9000cd300 0x7fb9000ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb906867700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb9001591d0 0x7fb900071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb906867700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90006f4a0 con 0x7fb9001591d0 2023-06-08T03:49:42.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb906867700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9000716e0 con 0x7fb9000cd300 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb906867700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90015dad0 con 0x7fb9000cded0 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb904e04700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb9001591d0 0x7fb900071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb90015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb8ff7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9000cd300 0x7fb9000ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb904e04700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb9001591d0 0x7fb900071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59748/0 (socket says 172.21.15.43:59748) 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb8ff7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9000cd300 0x7fb9000ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:41360/0 (socket says 172.21.15.43:41360) 2023-06-08T03:49:42.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb904e04700 1 -- 172.21.15.43:0/1226481945 learned_addr learned my addr 172.21.15.43:0/1226481945 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.034+0000 7fb8fffff700 1 --2- 172.21.15.43:0/1226481945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb90015d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:53200/0 (socket says 172.21.15.43:53200) 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb904e04700 1 -- 172.21.15.43:0/1226481945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 msgr2=0x7fb90015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb904e04700 1 --2- 172.21.15.43:0/1226481945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb90015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb904e04700 1 -- 172.21.15.43:0/1226481945 >> v2:172.21.15.135:3300/0 conn(0x7fb9000cd300 msgr2=0x7fb9000ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb904e04700 1 --2- 172.21.15.43:0/1226481945 >> v2:172.21.15.135:3300/0 conn(0x7fb9000cd300 0x7fb9000ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb904e04700 1 -- 172.21.15.43:0/1226481945 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000ce7e0 con 0x7fb9001591d0 2023-06-08T03:49:42.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb904e04700 1 --2- 172.21.15.43:0/1226481945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9001591d0 0x7fb900071b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb9000d0700 tx=0x7fb8f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6f88aec130d672 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb8feffd700 1 -- 172.21.15.43:0/1226481945 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800e070 con 0x7fb9001591d0 2023-06-08T03:49:42.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb8feffd700 1 -- 172.21.15.43:0/1226481945 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800b910 con 0x7fb9001591d0 2023-06-08T03:49:42.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.035+0000 7fb8feffd700 1 -- 172.21.15.43:0/1226481945 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800bcc0 con 0x7fb9001591d0 2023-06-08T03:49:42.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 -- 172.21.15.43:0/1226481945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9001591d0 msgr2=0x7fb900071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 --2- 172.21.15.43:0/1226481945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9001591d0 0x7fb900071b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb9000d0700 tx=0x7fb8f800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:42.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 -- 172.21.15.43:0/1226481945 shutdown_connections 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 --2- 172.21.15.43:0/1226481945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9001591d0 0x7fb900071b70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 --2- 172.21.15.43:0/1226481945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb90015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 --2- 172.21.15.43:0/1226481945 >> v2:172.21.15.135:3300/0 conn(0x7fb9000cd300 0x7fb9000ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 -- 172.21.15.43:0/1226481945 >> 172.21.15.43:0/1226481945 conn(0x7fb90006aec0 msgr2=0x7fb90006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 -- 172.21.15.43:0/1226481945 shutdown_connections 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.036+0000 7fb906867700 1 -- 172.21.15.43:0/1226481945 wait complete. 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.037+0000 7fb906867700 1 Processor -- start 2023-06-08T03:49:42.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.037+0000 7fb906867700 1 -- start start 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb906867700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 0x7fb90014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb906867700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb9000c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb906867700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9001591d0 0x7fb9000b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb906867700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000c8ad0 con 0x7fb9000cd300 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb906867700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000c8db0 con 0x7fb9001591d0 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb906867700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000c9090 con 0x7fb9000cded0 2023-06-08T03:49:42.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 0x7fb90014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 0x7fb90014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59750/0 (socket says 172.21.15.43:59750) 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 -- 172.21.15.43:0/1898453274 learned_addr learned my addr 172.21.15.43:0/1898453274 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8ff7fe700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb9000c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb904e04700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9001591d0 0x7fb9000b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 -- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 msgr2=0x7fb9000c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb9000c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 -- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9001591d0 msgr2=0x7fb9000b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9001591d0 0x7fb9000b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb8fffff700 1 -- 172.21.15.43:0/1898453274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8009b30 con 0x7fb9000cd300 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.038+0000 7fb904e04700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9001591d0 0x7fb9000b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.039+0000 7fb8fffff700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 0x7fb90014ef00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0010bc0 tx=0x7fb8f0010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.039+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0009710 con 0x7fb9000cd300 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.039+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f000ee30 con 0x7fb9000cd300 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.039+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9000c9370 con 0x7fb9000cd300 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.039+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0011650 con 0x7fb9000cd300 2023-06-08T03:49:42.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.039+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9000c8590 con 0x7fb9000cd300 2023-06-08T03:49:42.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.040+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb900073fa0 con 0x7fb9000cd300 2023-06-08T03:49:42.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.040+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8f00117b0 con 0x7fb9000cd300 2023-06-08T03:49:42.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.041+0000 7fb8fcff9700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb8e006ace0 0x7fb8e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.041+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8f008bac0 con 0x7fb9000cd300 2023-06-08T03:49:42.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.041+0000 7fb8ff7fe700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb8e006ace0 0x7fb8e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.041+0000 7fb8ff7fe700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb8e006ace0 0x7fb8e006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9000c7de0 tx=0x7fb8e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.045+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8f00568d0 con 0x7fb9000cd300 2023-06-08T03:49:42.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.246+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9000c8810 con 0x7fb9000cd300 2023-06-08T03:49:42.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.246+0000 7fb8fcff9700 1 -- 172.21.15.43:0/1898453274 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8f0059ef0 con 0x7fb9000cd300 2023-06-08T03:49:42.250 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:42.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.248+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb8e006ace0 msgr2=0x7fb8e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb8e006ace0 0x7fb8e006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9000c7de0 tx=0x7fb8e8008040 comp rx=0 tx=0).stop 2023-06-08T03:49:42.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 msgr2=0x7fb90014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 0x7fb90014ef00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0010bc0 tx=0x7fb8f0010f80 comp rx=0 tx=0).stop 2023-06-08T03:49:42.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 shutdown_connections 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb8e006ace0 0x7fb8e006d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9000cd300 0x7fb90014ef00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9001591d0 0x7fb9000b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 --2- 172.21.15.43:0/1898453274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000cded0 0x7fb9000c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 >> 172.21.15.43:0/1898453274 conn(0x7fb90006aec0 msgr2=0x7fb90006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 shutdown_connections 2023-06-08T03:49:42.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.249+0000 7fb906867700 1 -- 172.21.15.43:0/1898453274 wait complete. 2023-06-08T03:49:42.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:42.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.389+0000 7f90c3b8c700 1 Processor -- start 2023-06-08T03:49:42.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.389+0000 7f90c3b8c700 1 -- start start 2023-06-08T03:49:42.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c3b8c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f90bc15c5c0 0x7f90bc071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c3b8c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc069db0 0x7f90bc06a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c3b8c700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc15c990 con 0x7f90bc0b1a80 2023-06-08T03:49:42.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c3b8c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc06a6f0 con 0x7f90bc15c5c0 2023-06-08T03:49:42.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c3b8c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0cd2c0 con 0x7f90bc069db0 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c1127700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f90bc0b1a80 0x7f90bc0cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54664/0 (socket says 172.21.15.43:54664) 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.390+0000 7f90c1127700 1 -- 172.21.15.43:0/1259619115 learned_addr learned my addr 172.21.15.43:0/1259619115 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c2129700 1 --2- 172.21.15.43:0/1259619115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc069db0 0x7f90bc06a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c1928700 1 --2- 172.21.15.43:0/1259619115 >> v2:172.21.15.135:3300/0 conn(0x7f90bc15c5c0 0x7f90bc071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c0926700 1 -- 172.21.15.43:0/1259619115 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005133888 0 0) 0x7f90bc15c990 con 0x7f90bc0b1a80 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c0926700 1 -- 172.21.15.43:0/1259619115 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a80035b0 con 0x7f90bc0b1a80 2023-06-08T03:49:42.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c2129700 1 -- 172.21.15.43:0/1259619115 >> v2:172.21.15.135:3300/0 conn(0x7f90bc15c5c0 msgr2=0x7f90bc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c2129700 1 --2- 172.21.15.43:0/1259619115 >> v2:172.21.15.135:3300/0 conn(0x7f90bc15c5c0 0x7f90bc071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c2129700 1 -- 172.21.15.43:0/1259619115 >> v1:172.21.15.43:6789/0 conn(0x7f90bc0b1a80 legacy=0x7f90bc0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c0926700 1 -- 172.21.15.43:0/1259619115 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2960044803 0 0) 0x7f90a80035b0 con 0x7f90bc0b1a80 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c2129700 1 -- 172.21.15.43:0/1259619115 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc0cd5a0 con 0x7f90bc069db0 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c1928700 1 --2- 172.21.15.43:0/1259619115 >> v2:172.21.15.135:3300/0 conn(0x7f90bc15c5c0 0x7f90bc071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c2129700 1 --2- 172.21.15.43:0/1259619115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc069db0 0x7f90bc06a1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009d90 tx=0x7f90b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbb91e513e20396 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c0926700 1 -- 172.21.15.43:0/1259619115 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400e070 con 0x7f90bc069db0 2023-06-08T03:49:42.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c0926700 1 -- 172.21.15.43:0/1259619115 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4003a20 con 0x7f90bc069db0 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.391+0000 7f90c0926700 1 -- 172.21.15.43:0/1259619115 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8001670 con 0x7f90bc069db0 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 -- 172.21.15.43:0/1259619115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc069db0 msgr2=0x7f90bc06a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/1259619115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc069db0 0x7f90bc06a1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009d90 tx=0x7f90b400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 -- 172.21.15.43:0/1259619115 shutdown_connections 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/1259619115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc069db0 0x7f90bc06a1b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/1259619115 >> v2:172.21.15.135:3300/0 conn(0x7f90bc15c5c0 0x7f90bc071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 -- 172.21.15.43:0/1259619115 >> 172.21.15.43:0/1259619115 conn(0x7f90bc06aec0 msgr2=0x7f90bc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:42.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 -- 172.21.15.43:0/1259619115 shutdown_connections 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.392+0000 7f90c3b8c700 1 -- 172.21.15.43:0/1259619115 wait complete. 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.393+0000 7f90c3b8c700 1 Processor -- start 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.393+0000 7f90c3b8c700 1 -- start start 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c3b8c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 0x7f90bc150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c3b8c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc0b1a80 0x7f90bc0b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c3b8c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc15c5c0 0x7f90bc0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c3b8c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0b3d90 con 0x7f90bc069db0 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c3b8c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc15e2f0 con 0x7f90bc0b1a80 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c3b8c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc15e590 con 0x7f90bc15c5c0 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 0x7f90bc150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 0x7f90bc150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59764/0 (socket says 172.21.15.43:59764) 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 -- 172.21.15.43:0/52778727 learned_addr learned my addr 172.21.15.43:0/52778727 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c2129700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc15c5c0 0x7f90bc0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1127700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc0b1a80 0x7f90bc0b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 -- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc15c5c0 msgr2=0x7f90bc0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc15c5c0 0x7f90bc0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 -- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc0b1a80 msgr2=0x7f90bc0b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc0b1a80 0x7f90bc0b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.394+0000 7f90c1928700 1 -- 172.21.15.43:0/52778727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0094a0 con 0x7f90bc069db0 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.395+0000 7f90c1928700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 0x7f90bc150a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00ebe0 tx=0x7f90ac009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.395+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00c8b0 con 0x7f90bc069db0 2023-06-08T03:49:42.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.395+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00ca10 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.395+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00cda0 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.395+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b4009a70 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.395+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc0b35a0 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.396+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc073fa0 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.396+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90ac013470 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.397+0000 7f90b27fc700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f90a006ace0 0x7f90a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.397+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f90ac0898a0 con 0x7f90bc069db0 2023-06-08T03:49:42.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.397+0000 7f90c1127700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f90a006ace0 0x7f90a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.397+0000 7f90c1127700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f90a006ace0 0x7f90a006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f90b80011e0 tx=0x7f90b8001530 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.401+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90ac054620 con 0x7f90bc069db0 2023-06-08T03:49:42.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.597+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90bc0b3b70 con 0x7f90bc069db0 2023-06-08T03:49:42.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.597+0000 7f90b27fc700 1 -- 172.21.15.43:0/52778727 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90ac057c40 con 0x7f90bc069db0 2023-06-08T03:49:42.601 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:42.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f90a006ace0 msgr2=0x7f90a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f90a006ace0 0x7f90a006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f90b80011e0 tx=0x7f90b8001530 comp rx=0 tx=0).stop 2023-06-08T03:49:42.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 msgr2=0x7f90bc150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 0x7f90bc150a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00ebe0 tx=0x7f90ac009e20 comp rx=0 tx=0).stop 2023-06-08T03:49:42.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 shutdown_connections 2023-06-08T03:49:42.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f90a006ace0 0x7f90a006d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90bc069db0 0x7f90bc150a70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90bc15c5c0 0x7f90bc0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 --2- 172.21.15.43:0/52778727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc0b1a80 0x7f90bc0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 >> 172.21.15.43:0/52778727 conn(0x7f90bc06aec0 msgr2=0x7f90bc15b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:42.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 shutdown_connections 2023-06-08T03:49:42.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.600+0000 7f90c3b8c700 1 -- 172.21.15.43:0/52778727 wait complete. 2023-06-08T03:49:42.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:42.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.742+0000 7f7111780700 1 Processor -- start 2023-06-08T03:49:42.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.742+0000 7f7111780700 1 -- start start 2023-06-08T03:49:42.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7111780700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f710c0ccb00 0x7f710c0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7111780700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f710c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7111780700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c15c750 con 0x7f710c0b43f0 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7111780700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c0ccfc0 con 0x7f710c0ccb00 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7111780700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0cf740 con 0x7f710c0b4ed0 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f710affd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f710c0b43f0 0x7f710c0b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54676/0 (socket says 172.21.15.43:54676) 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f710affd700 1 -- 172.21.15.43:0/3601925881 learned_addr learned my addr 172.21.15.43:0/3601925881 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f710b7fe700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f710c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27229928 0 0) 0x7f7100001110 con 0x7f710c0b43f0 2023-06-08T03:49:42.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f710a7fc700 1 --2- 172.21.15.43:0/3601925881 >> v2:172.21.15.135:3300/0 conn(0x7f710c0ccb00 0x7f710c0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.743+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f40035b0 con 0x7f710c0b43f0 2023-06-08T03:49:42.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834077251 0 0) 0x7f70f40035b0 con 0x7f710c0b43f0 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 msgr2=0x7f710c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f710c0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 >> v2:172.21.15.135:3300/0 conn(0x7f710c0ccb00 msgr2=0x7f710c0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 --2- 172.21.15.43:0/3601925881 >> v2:172.21.15.135:3300/0 conn(0x7f710c0ccb00 0x7f710c0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0cd540 con 0x7f710c0b43f0 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f7100001800 con 0x7f710c0b43f0 2023-06-08T03:49:42.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 >> v1:172.21.15.43:6789/0 conn(0x7f710c0b43f0 legacy=0x7f710c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f70f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f4004850 0x7f70f4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f70f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0ccfc0 con 0x7f70f4003a00 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0cf740 con 0x7f70f4004850 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f400ba40 con 0x7f710c0b4ed0 2023-06-08T03:49:42.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f70f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710a7fc700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f4004850 0x7f70f4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710b7fe700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f70f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 -- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 msgr2=0x7f70f4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f70f4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 -- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f4004850 msgr2=0x7f70f4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f4004850 0x7f70f4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 -- 172.21.15.43:0/3601925881 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40035b0 con 0x7f70f4003a00 2023-06-08T03:49:42.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710b7fe700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c0b4ed0 0x7f70f4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f710affd700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f70f4003e10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f710000c160 tx=0x7f70f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9063e5bd5b72c0ee server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100007d10 con 0x7f70f4003a00 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710000cd00 con 0x7f70f4003a00 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.744+0000 7f7109ffb700 1 -- 172.21.15.43:0/3601925881 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100005ba0 con 0x7f70f4003a00 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f7111780700 1 -- 172.21.15.43:0/3601925881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 msgr2=0x7f70f4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f7111780700 1 --2- 172.21.15.43:0/3601925881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f70f4003e10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f710000c160 tx=0x7f70f4005880 comp rx=0 tx=0).stop 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f710b7fe700 1 -- 172.21.15.43:0/3601925881 reap_dead start 2023-06-08T03:49:42.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f7111780700 1 -- 172.21.15.43:0/3601925881 shutdown_connections 2023-06-08T03:49:42.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f7111780700 1 -- 172.21.15.43:0/3601925881 >> 172.21.15.43:0/3601925881 conn(0x7f710c072120 msgr2=0x7f710c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:42.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f7111780700 1 -- 172.21.15.43:0/3601925881 shutdown_connections 2023-06-08T03:49:42.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.745+0000 7f7111780700 1 -- 172.21.15.43:0/3601925881 wait complete. 2023-06-08T03:49:42.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.746+0000 7f7111780700 1 Processor -- start 2023-06-08T03:49:42.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.746+0000 7f7111780700 1 -- start start 2023-06-08T03:49:42.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f7111780700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f710c13e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f7111780700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f710c152570 0x7f710c15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f7111780700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c15ce30 0x7f710c1409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f7111780700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c15d2d0 con 0x7f70f4003a00 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f7111780700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1417c0 con 0x7f710c152570 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f7111780700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0d1690 con 0x7f710c15ce30 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f710affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f710c13e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f710affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f710c13e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59784/0 (socket says 172.21.15.43:59784) 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f710affd700 1 -- 172.21.15.43:0/600394968 learned_addr learned my addr 172.21.15.43:0/600394968 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.747+0000 7f710a7fc700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f710c152570 0x7f710c15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710b7fe700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c15ce30 0x7f710c1409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710affd700 1 -- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c15ce30 msgr2=0x7f710c1409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710affd700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c15ce30 0x7f710c1409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710affd700 1 -- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f710c152570 msgr2=0x7f710c15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710affd700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f710c152570 0x7f710c15c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710affd700 1 -- 172.21.15.43:0/600394968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0d1970 con 0x7f70f4003a00 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710a7fc700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f710c152570 0x7f710c15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f710affd700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f710c13e8e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f710000c750 tx=0x7f7100000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000ce70 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71000070d0 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c0d1c50 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100007460 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.748+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c13ee20 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.749+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c0d2170 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.750+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7100019030 con 0x7f70f4003a00 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.750+0000 7f70f37fe700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f70f806ad10 0x7f70f806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:42.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.750+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f710008ab90 con 0x7f70f4003a00 2023-06-08T03:49:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.750+0000 7f710a7fc700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f70f806ad10 0x7f70f806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.751+0000 7f710a7fc700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f70f806ad10 0x7f70f806d1c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f710c0d3340 tx=0x7f70fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.754+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f710c0d2170 con 0x7f70f4003a00 2023-06-08T03:49:42.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.952+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f710c15c750 con 0x7f70f4003a00 2023-06-08T03:49:42.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.952+0000 7f70f37fe700 1 -- 172.21.15.43:0/600394968 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7100017020 con 0x7f70f4003a00 2023-06-08T03:49:42.956 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f70f806ad10 msgr2=0x7f70f806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f70f806ad10 0x7f70f806d1c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f710c0d3340 tx=0x7f70fc008040 comp rx=0 tx=0).stop 2023-06-08T03:49:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 msgr2=0x7f710c13e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f710c13e8e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f710000c750 tx=0x7f7100000fe0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 shutdown_connections 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f70f806ad10 0x7f70f806d1c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70f4003a00 0x7f710c13e8e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710c15ce30 0x7f710c1409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 --2- 172.21.15.43:0/600394968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f710c152570 0x7f710c15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 >> 172.21.15.43:0/600394968 conn(0x7f710c072120 msgr2=0x7f710c0c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:42.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 shutdown_connections 2023-06-08T03:49:42.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:42.954+0000 7f7111780700 1 -- 172.21.15.43:0/600394968 wait complete. 2023-06-08T03:49:42.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T03:49:43.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.092+0000 7f78a0b9e700 1 Processor -- start 2023-06-08T03:49:43.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.092+0000 7f78a0b9e700 1 -- start start 2023-06-08T03:49:43.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f78a0b9e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f789c1607d0 0x7f789c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f78a0b9e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c0715f0 0x7f789c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f78a0b9e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c160c40 con 0x7f789c15c340 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f78a0b9e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c1603b0 con 0x7f789c1607d0 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f78a0b9e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c071a70 con 0x7f789c0715f0 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f789c1607d0 0x7f789c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f789c15c340 0x7f789c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54696/0 (socket says 172.21.15.43:54696) 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f789c1607d0 0x7f789c0710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59794/0 (socket says 172.21.15.43:59794) 2023-06-08T03:49:43.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789b7fe700 1 -- 172.21.15.43:0/2712252844 learned_addr learned my addr 172.21.15.43:0/2712252844 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 -- 172.21.15.43:0/2712252844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c0715f0 msgr2=0x7f789c06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789bfff700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c0715f0 0x7f789c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c0715f0 0x7f789c06ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 -- 172.21.15.43:0/2712252844 >> v1:172.21.15.43:6789/0 conn(0x7f789c15c340 legacy=0x7f789c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789a7fc700 1 -- 172.21.15.43:0/2712252844 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219059589 0 0) 0x7f789c160c40 con 0x7f789c15c340 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 -- 172.21.15.43:0/2712252844 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c15fd10 con 0x7f789c1607d0 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789bfff700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c0715f0 0x7f789c06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:43.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789affd700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c1607d0 0x7f789c0710b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7890009840 tx=0x7f7890009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa45e8c27e538b92 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.093+0000 7f789a7fc700 1 -- 172.21.15.43:0/2712252844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890011830 con 0x7f789c1607d0 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f789a7fc700 1 -- 172.21.15.43:0/2712252844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7890011990 con 0x7f789c1607d0 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f789a7fc700 1 -- 172.21.15.43:0/2712252844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890011d20 con 0x7f789c1607d0 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 -- 172.21.15.43:0/2712252844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c1607d0 msgr2=0x7f789c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c1607d0 0x7f789c0710b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7890009840 tx=0x7f7890009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 -- 172.21.15.43:0/2712252844 shutdown_connections 2023-06-08T03:49:43.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c0715f0 0x7f789c06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/2712252844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c1607d0 0x7f789c0710b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 -- 172.21.15.43:0/2712252844 >> 172.21.15.43:0/2712252844 conn(0x7f789c06ddc0 msgr2=0x7f789c0cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:43.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 -- 172.21.15.43:0/2712252844 shutdown_connections 2023-06-08T03:49:43.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.094+0000 7f78a0b9e700 1 -- 172.21.15.43:0/2712252844 wait complete. 2023-06-08T03:49:43.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.095+0000 7f78a0b9e700 1 Processor -- start 2023-06-08T03:49:43.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 -- start start 2023-06-08T03:49:43.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 0x7f789c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c15c340 0x7f789c0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c1607d0 0x7f789c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0b1050 con 0x7f789c0715f0 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0b0440 con 0x7f789c1607d0 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f78a0b9e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0b0720 con 0x7f789c15c340 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.096+0000 7f789b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 0x7f789c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 0x7f789c0b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59798/0 (socket says 172.21.15.43:59798) 2023-06-08T03:49:43.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 -- 172.21.15.43:0/1189286225 learned_addr learned my addr 172.21.15.43:0/1189286225 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789affd700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c15c340 0x7f789c0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789bfff700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c1607d0 0x7f789c1f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 -- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c15c340 msgr2=0x7f789c0b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c15c340 0x7f789c0b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 -- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c1607d0 msgr2=0x7f789c1f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c1607d0 0x7f789c1f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 -- 172.21.15.43:0/1189286225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900094a0 con 0x7f789c0715f0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789bfff700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c1607d0 0x7f789c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f789b7fe700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 0x7f789c0b47b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f788c0011e0 tx=0x7f788c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c004c80 con 0x7f789c0715f0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c004de0 con 0x7f789c0715f0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c0b0a00 con 0x7f789c0715f0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c007310 con 0x7f789c0715f0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.097+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c0b1a20 con 0x7f789c0715f0 2023-06-08T03:49:43.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.098+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c04e8e0 con 0x7f789c0715f0 2023-06-08T03:49:43.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.099+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f788c007470 con 0x7f789c0715f0 2023-06-08T03:49:43.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.099+0000 7f7883fff700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f788806ace0 0x7f788806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.099+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f788c089480 con 0x7f789c0715f0 2023-06-08T03:49:43.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.100+0000 7f789affd700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f788806ace0 0x7f788806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.100+0000 7f789affd700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f788806ace0 0x7f788806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f78900090b0 tx=0x7f789001d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:43.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.104+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f788c054200 con 0x7f789c0715f0 2023-06-08T03:49:43.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.320+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f789c0b54f0 con 0x7f789c0715f0 2023-06-08T03:49:43.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.321+0000 7f7883fff700 1 -- 172.21.15.43:0/1189286225 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f788c057820 con 0x7f789c0715f0 2023-06-08T03:49:43.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f788806ace0 msgr2=0x7f788806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f788806ace0 0x7f788806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f78900090b0 tx=0x7f789001d040 comp rx=0 tx=0).stop 2023-06-08T03:49:43.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 msgr2=0x7f789c0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 0x7f789c0b47b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f788c0011e0 tx=0x7f788c00ca30 comp rx=0 tx=0).stop 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 shutdown_connections 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f788806ace0 0x7f788806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f789c0715f0 0x7f789c0b47b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f789c1607d0 0x7f789c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 --2- 172.21.15.43:0/1189286225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f789c15c340 0x7f789c0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 >> 172.21.15.43:0/1189286225 conn(0x7f789c06ddc0 msgr2=0x7f789c159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:43.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 shutdown_connections 2023-06-08T03:49:43.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.323+0000 7f78a0b9e700 1 -- 172.21.15.43:0/1189286225 wait complete. 2023-06-08T03:49:43.328 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T03:49:43.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-08T03:49:43.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:43.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-08T03:49:43.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T03:49:43.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:43.378 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-08T03:49:43.434 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:43.435 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:43.455 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:43.456 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:43.516 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T03:49:43.516 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:49:43.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:43.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 Processor -- start 2023-06-08T03:49:43.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 -- start start 2023-06-08T03:49:43.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f897c0b4e10 0x7f897c071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c069db0 0x7f897c06a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c072300 con 0x7f897c0ae9f0 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0b2180 con 0x7f897c0b4e10 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.697+0000 7f89821d9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c06a770 con 0x7f897c069db0 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f897c0b4e10 0x7f897c071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f897c0b4e10 0x7f897c071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59806/0 (socket says 172.21.15.43:59806) 2023-06-08T03:49:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 -- 172.21.15.43:0/2471809490 learned_addr learned my addr 172.21.15.43:0/2471809490 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897bfff700 1 --2- 172.21.15.43:0/2471809490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c069db0 0x7f897c06a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 -- 172.21.15.43:0/2471809490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c069db0 msgr2=0x7f897c06a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 --2- 172.21.15.43:0/2471809490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c069db0 0x7f897c06a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 -- 172.21.15.43:0/2471809490 >> v1:172.21.15.135:6789/0 conn(0x7f897c0ae9f0 legacy=0x7f897c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 -- 172.21.15.43:0/2471809490 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c071180 con 0x7f897c0b4e10 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897b7fe700 1 --2- 172.21.15.43:0/2471809490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c0b4e10 0x7f897c071dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f896c0098f0 tx=0x7f896c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1622b0b3a67346be server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897a7fc700 1 -- 172.21.15.43:0/2471809490 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c004230 con 0x7f897c0b4e10 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897a7fc700 1 -- 172.21.15.43:0/2471809490 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c004390 con 0x7f897c0b4e10 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.698+0000 7f897a7fc700 1 -- 172.21.15.43:0/2471809490 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0036a0 con 0x7f897c0b4e10 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 -- 172.21.15.43:0/2471809490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c0b4e10 msgr2=0x7f897c071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 --2- 172.21.15.43:0/2471809490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c0b4e10 0x7f897c071dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f896c0098f0 tx=0x7f896c009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 -- 172.21.15.43:0/2471809490 shutdown_connections 2023-06-08T03:49:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 --2- 172.21.15.43:0/2471809490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c069db0 0x7f897c06a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 --2- 172.21.15.43:0/2471809490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c0b4e10 0x7f897c071dc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 -- 172.21.15.43:0/2471809490 >> 172.21.15.43:0/2471809490 conn(0x7f897c06d180 msgr2=0x7f897c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 -- 172.21.15.43:0/2471809490 shutdown_connections 2023-06-08T03:49:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.699+0000 7f89821d9700 1 -- 172.21.15.43:0/2471809490 wait complete. 2023-06-08T03:49:43.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.700+0000 7f89821d9700 1 Processor -- start 2023-06-08T03:49:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.700+0000 7f89821d9700 1 -- start start 2023-06-08T03:49:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f89821d9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 0x7f897c15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f89821d9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c0ae9f0 0x7f897c15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f89821d9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f897c0b4e10 0x7f897c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f89821d9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c15ac40 con 0x7f897c069db0 2023-06-08T03:49:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f89821d9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0c4c90 con 0x7f897c0b4e10 2023-06-08T03:49:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f89821d9700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c14e880 con 0x7f897c0ae9f0 2023-06-08T03:49:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 0x7f897c15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 0x7f897c15bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59812/0 (socket says 172.21.15.43:59812) 2023-06-08T03:49:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 -- 172.21.15.43:0/3832253759 learned_addr learned my addr 172.21.15.43:0/3832253759 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897affd700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c0ae9f0 0x7f897c15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897bfff700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f897c0b4e10 0x7f897c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 -- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c0ae9f0 msgr2=0x7f897c15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c0ae9f0 0x7f897c15c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 -- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f897c0b4e10 msgr2=0x7f897c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f897c0b4e10 0x7f897c15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897b7fe700 1 -- 172.21.15.43:0/3832253759 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c009550 con 0x7f897c069db0 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.701+0000 7f897affd700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c0ae9f0 0x7f897c15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.702+0000 7f897b7fe700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 0x7f897c15bc30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f896c009130 tx=0x7f896c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:43.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.702+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c003e30 con 0x7f897c069db0 2023-06-08T03:49:43.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.702+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c01f070 con 0x7f897c069db0 2023-06-08T03:49:43.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.702+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c15ae70 con 0x7f897c069db0 2023-06-08T03:49:43.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.702+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c00b8a0 con 0x7f897c069db0 2023-06-08T03:49:43.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.702+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c15b430 con 0x7f897c069db0 2023-06-08T03:49:43.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.703+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c073fa0 con 0x7f897c069db0 2023-06-08T03:49:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.703+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f896c021030 con 0x7f897c069db0 2023-06-08T03:49:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.704+0000 7f8973fff700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f895c06ace0 0x7f895c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.704+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f896c08ae20 con 0x7f897c069db0 2023-06-08T03:49:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.704+0000 7f897affd700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f895c06ace0 0x7f895c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.704+0000 7f897affd700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f895c06ace0 0x7f895c06d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f897c158b60 tx=0x7f8964008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.708+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f896c055c30 con 0x7f897c069db0 2023-06-08T03:49:43.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.908+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f897c073fa0 con 0x7f897c069db0 2023-06-08T03:49:43.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.909+0000 7f8973fff700 1 -- 172.21.15.43:0/3832253759 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f896c010380 con 0x7f897c069db0 2023-06-08T03:49:43.913 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:43.913 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:43.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f895c06ace0 msgr2=0x7f895c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f895c06ace0 0x7f895c06d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f897c158b60 tx=0x7f8964008040 comp rx=0 tx=0).stop 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 msgr2=0x7f897c15bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 0x7f897c15bc30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f896c009130 tx=0x7f896c004750 comp rx=0 tx=0).stop 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 shutdown_connections 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f895c06ace0 0x7f895c06d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f897c069db0 0x7f897c15bc30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f897c0b4e10 0x7f897c15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 --2- 172.21.15.43:0/3832253759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f897c0ae9f0 0x7f897c15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 >> 172.21.15.43:0/3832253759 conn(0x7f897c06d180 msgr2=0x7f897c158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 shutdown_connections 2023-06-08T03:49:43.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:43.911+0000 7f89821d9700 1 -- 172.21.15.43:0/3832253759 wait complete. 2023-06-08T03:49:43.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:43.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:44.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.052+0000 7f59dd73e700 1 Processor -- start 2023-06-08T03:49:44.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.052+0000 7f59dd73e700 1 -- start start 2023-06-08T03:49:44.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59dd73e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f59d806a4c0 0x7f59d80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59dd73e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d815c8f0 con 0x7f59d8071560 2023-06-08T03:49:44.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59dd73e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80719b0 con 0x7f59d815c520 2023-06-08T03:49:44.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59dd73e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80cd940 con 0x7f59d806a4c0 2023-06-08T03:49:44.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59d67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f59d8071560 0x7f59d8069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54724/0 (socket says 172.21.15.43:54724) 2023-06-08T03:49:44.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59d67fc700 1 -- 172.21.15.43:0/809843960 learned_addr learned my addr 172.21.15.43:0/809843960 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:44.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.053+0000 7f59d77fe700 1 --2- 172.21.15.43:0/809843960 >> v2:172.21.15.43:3300/0 conn(0x7f59d806a4c0 0x7f59d80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d5ffb700 1 -- 172.21.15.43:0/809843960 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035371744 0 0) 0x7f59c8001110 con 0x7f59d8071560 2023-06-08T03:49:44.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d5ffb700 1 -- 172.21.15.43:0/809843960 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c00035b0 con 0x7f59d8071560 2023-06-08T03:49:44.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d77fe700 1 -- 172.21.15.43:0/809843960 >> v1:172.21.15.135:6789/0 conn(0x7f59d815c520 legacy=0x7f59d80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d77fe700 1 -- 172.21.15.43:0/809843960 >> v1:172.21.15.43:6789/0 conn(0x7f59d8071560 legacy=0x7f59d8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d77fe700 1 -- 172.21.15.43:0/809843960 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80cd3c0 con 0x7f59d806a4c0 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d77fe700 1 --2- 172.21.15.43:0/809843960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d806a4c0 0x7f59d80b24a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009d90 tx=0x7f59d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b19fb87613da46 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d5ffb700 1 -- 172.21.15.43:0/809843960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000e070 con 0x7f59d806a4c0 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d5ffb700 1 -- 172.21.15.43:0/809843960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d000bae0 con 0x7f59d806a4c0 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59d5ffb700 1 -- 172.21.15.43:0/809843960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000be50 con 0x7f59d806a4c0 2023-06-08T03:49:44.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59dd73e700 1 -- 172.21.15.43:0/809843960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d806a4c0 msgr2=0x7f59d80b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.054+0000 7f59dd73e700 1 --2- 172.21.15.43:0/809843960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d806a4c0 0x7f59d80b24a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009d90 tx=0x7f59d000b330 comp rx=0 tx=0).stop 2023-06-08T03:49:44.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.055+0000 7f59dd73e700 1 -- 172.21.15.43:0/809843960 shutdown_connections 2023-06-08T03:49:44.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.055+0000 7f59dd73e700 1 --2- 172.21.15.43:0/809843960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d806a4c0 0x7f59d80b24a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.055+0000 7f59dd73e700 1 -- 172.21.15.43:0/809843960 >> 172.21.15.43:0/809843960 conn(0x7f59d806aec0 msgr2=0x7f59d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:44.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.055+0000 7f59dd73e700 1 -- 172.21.15.43:0/809843960 shutdown_connections 2023-06-08T03:49:44.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.055+0000 7f59dd73e700 1 -- 172.21.15.43:0/809843960 wait complete. 2023-06-08T03:49:44.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.056+0000 7f59dd73e700 1 Processor -- start 2023-06-08T03:49:44.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.056+0000 7f59dd73e700 1 -- start start 2023-06-08T03:49:44.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59dd73e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59d806a4c0 0x7f59d8147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59dd73e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59d8071560 0x7f59d8158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59dd73e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 0x7f59d81586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59dd73e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80b3220 con 0x7f59d815c520 2023-06-08T03:49:44.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59dd73e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8158c10 con 0x7f59d806a4c0 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59dd73e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d815e990 con 0x7f59d8071560 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 0x7f59d81586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 0x7f59d81586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59830/0 (socket says 172.21.15.43:59830) 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 -- 172.21.15.43:0/3270732927 learned_addr learned my addr 172.21.15.43:0/3270732927 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d6ffd700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59d806a4c0 0x7f59d8147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d67fc700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59d8071560 0x7f59d8158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 -- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59d8071560 msgr2=0x7f59d8158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59d8071560 0x7f59d8158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 -- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59d806a4c0 msgr2=0x7f59d8147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59d806a4c0 0x7f59d8147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 -- 172.21.15.43:0/3270732927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d0009a70 con 0x7f59d815c520 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59d77fe700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 0x7f59d81586d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f59d8071b40 tx=0x7f59d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.057+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0004830 con 0x7f59d815c520 2023-06-08T03:49:44.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.058+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0009410 con 0x7f59d815c520 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.058+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00266a0 con 0x7f59d815c520 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.058+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d80b28f0 con 0x7f59d815c520 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.058+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d80b2eb0 con 0x7f59d815c520 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.058+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d80b33d0 con 0x7f59d815c520 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.059+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59d0012430 con 0x7f59d815c520 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.059+0000 7f59bf7fe700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59c406ace0 0x7f59c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.059+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f59d008b620 con 0x7f59d815c520 2023-06-08T03:49:44.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.060+0000 7f59d6ffd700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59c406ace0 0x7f59c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.060+0000 7f59d6ffd700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59c406ace0 0x7f59c406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009960 tx=0x7f59cc0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.064+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59d80b33d0 con 0x7f59d815c520 2023-06-08T03:49:44.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.258+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59d80b33d0 con 0x7f59d815c520 2023-06-08T03:49:44.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.258+0000 7f59bf7fe700 1 -- 172.21.15.43:0/3270732927 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59d0021020 con 0x7f59d815c520 2023-06-08T03:49:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:44.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59c406ace0 msgr2=0x7f59c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59c406ace0 0x7f59c406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009960 tx=0x7f59cc0090e0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 msgr2=0x7f59d81586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 0x7f59d81586d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f59d8071b40 tx=0x7f59d0004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 shutdown_connections 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f59c406ace0 0x7f59c406d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d815c520 0x7f59d81586d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59d806a4c0 0x7f59d8147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 --2- 172.21.15.43:0/3270732927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59d8071560 0x7f59d8158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 >> 172.21.15.43:0/3270732927 conn(0x7f59d806aec0 msgr2=0x7f59d8069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 shutdown_connections 2023-06-08T03:49:44.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.261+0000 7f59dd73e700 1 -- 172.21.15.43:0/3270732927 wait complete. 2023-06-08T03:49:44.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:44.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.400+0000 7f25cd73e700 1 Processor -- start 2023-06-08T03:49:44.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.400+0000 7f25cd73e700 1 -- start start 2023-06-08T03:49:44.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25cd73e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25c815c270 0x7f25c80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25cd73e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25c80ce310 0x7f25c80cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25cd73e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c80d0d30 con 0x7f25c80cd670 2023-06-08T03:49:44.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25cd73e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c806aec0 con 0x7f25c80ce310 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25cd73e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c80d1520 con 0x7f25c815c270 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25c80ce310 0x7f25c80cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25c80ce310 0x7f25c80cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59834/0 (socket says 172.21.15.43:59834) 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 -- 172.21.15.43:0/3884801128 learned_addr learned my addr 172.21.15.43:0/3884801128 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c6ffd700 1 --2- 172.21.15.43:0/3884801128 >> v2:172.21.15.135:3300/0 conn(0x7f25c815c270 0x7f25c80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 -- 172.21.15.43:0/3884801128 >> v2:172.21.15.135:3300/0 conn(0x7f25c815c270 msgr2=0x7f25c80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 --2- 172.21.15.43:0/3884801128 >> v2:172.21.15.135:3300/0 conn(0x7f25c815c270 0x7f25c80d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 -- 172.21.15.43:0/3884801128 >> v1:172.21.15.135:6789/0 conn(0x7f25c80cd670 legacy=0x7f25c815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 -- 172.21.15.43:0/3884801128 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c80cdad0 con 0x7f25c80ce310 2023-06-08T03:49:44.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c67fc700 1 --2- 172.21.15.43:0/3884801128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80ce310 0x7f25c80cd130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f25c806f5e0 tx=0x7f25bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59edfd24c7567e8a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.401+0000 7f25c5ffb700 1 -- 172.21.15.43:0/3884801128 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00b870 con 0x7f25c80ce310 2023-06-08T03:49:44.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25c5ffb700 1 -- 172.21.15.43:0/3884801128 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc00b9d0 con 0x7f25c80ce310 2023-06-08T03:49:44.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25c5ffb700 1 -- 172.21.15.43:0/3884801128 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00bd60 con 0x7f25c80ce310 2023-06-08T03:49:44.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 -- 172.21.15.43:0/3884801128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80ce310 msgr2=0x7f25c80cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 --2- 172.21.15.43:0/3884801128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80ce310 0x7f25c80cd130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f25c806f5e0 tx=0x7f25bc009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 -- 172.21.15.43:0/3884801128 shutdown_connections 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 --2- 172.21.15.43:0/3884801128 >> v2:172.21.15.135:3300/0 conn(0x7f25c815c270 0x7f25c80d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 --2- 172.21.15.43:0/3884801128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80ce310 0x7f25c80cd130 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 -- 172.21.15.43:0/3884801128 >> 172.21.15.43:0/3884801128 conn(0x7f25c8069db0 msgr2=0x7f25c806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 -- 172.21.15.43:0/3884801128 shutdown_connections 2023-06-08T03:49:44.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.402+0000 7f25cd73e700 1 -- 172.21.15.43:0/3884801128 wait complete. 2023-06-08T03:49:44.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.403+0000 7f25cd73e700 1 Processor -- start 2023-06-08T03:49:44.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 -- start start 2023-06-08T03:49:44.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 0x7f25c815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80ce310 0x7f25c80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c815c270 0x7f25c8154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80c5280 con 0x7f25c80cd670 2023-06-08T03:49:44.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80c4fa0 con 0x7f25c80ce310 2023-06-08T03:49:44.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25cd73e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80c5c40 con 0x7f25c815c270 2023-06-08T03:49:44.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25c6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 0x7f25c815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25c6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 0x7f25c815c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59840/0 (socket says 172.21.15.43:59840) 2023-06-08T03:49:44.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.404+0000 7f25c6ffd700 1 -- 172.21.15.43:0/1002943456 learned_addr learned my addr 172.21.15.43:0/1002943456 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:44.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c67fc700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80ce310 0x7f25c80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c6ffd700 1 -- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c815c270 msgr2=0x7f25c8154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c77fe700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c815c270 0x7f25c8154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c6ffd700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c815c270 0x7f25c8154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c6ffd700 1 -- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80ce310 msgr2=0x7f25c80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c6ffd700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80ce310 0x7f25c80cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c6ffd700 1 -- 172.21.15.43:0/1002943456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009550 con 0x7f25c80cd670 2023-06-08T03:49:44.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c67fc700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80ce310 0x7f25c80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:44.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c77fe700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c815c270 0x7f25c8154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:44.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25c6ffd700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 0x7f25c815c640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25b800d800 tx=0x7f25b800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80125f0 con 0x7f25c80cd670 2023-06-08T03:49:44.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8012750 con 0x7f25c80cd670 2023-06-08T03:49:44.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c80c5f20 con 0x7f25c80cd670 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8012b00 con 0x7f25c80cd670 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.405+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c815cb80 con 0x7f25c80cd670 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.406+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c8073fa0 con 0x7f25c80cd670 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.406+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25b8012c60 con 0x7f25c80cd670 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.407+0000 7f25af7fe700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f25b406ace0 0x7f25b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.407+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f25b8089ba0 con 0x7f25c80cd670 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.407+0000 7f25c67fc700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f25b406ace0 0x7f25b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.408+0000 7f25c67fc700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f25b406ace0 0x7f25b406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25c80b6100 tx=0x7f25bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.411+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f25b8054920 con 0x7f25c80cd670 2023-06-08T03:49:44.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.607+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25c80b2790 con 0x7f25c80cd670 2023-06-08T03:49:44.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.608+0000 7f25af7fe700 1 -- 172.21.15.43:0/1002943456 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25b8057f40 con 0x7f25c80cd670 2023-06-08T03:49:44.611 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:44.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f25b406ace0 msgr2=0x7f25b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f25b406ace0 0x7f25b406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25c80b6100 tx=0x7f25bc008030 comp rx=0 tx=0).stop 2023-06-08T03:49:44.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 msgr2=0x7f25c815c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 0x7f25c815c640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25b800d800 tx=0x7f25b800dbc0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 shutdown_connections 2023-06-08T03:49:44.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f25b406ace0 0x7f25b406d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c80cd670 0x7f25c815c640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c815c270 0x7f25c8154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 --2- 172.21.15.43:0/1002943456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80ce310 0x7f25c80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 >> 172.21.15.43:0/1002943456 conn(0x7f25c8069db0 msgr2=0x7f25c806c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:44.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 shutdown_connections 2023-06-08T03:49:44.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.610+0000 7f25cd73e700 1 -- 172.21.15.43:0/1002943456 wait complete. 2023-06-08T03:49:44.626 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:44.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.751+0000 7f6dabbb2700 1 Processor -- start 2023-06-08T03:49:44.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.751+0000 7f6dabbb2700 1 -- start start 2023-06-08T03:49:44.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6dabbb2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 0x7f6da40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6dabbb2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 0x7f6da40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6dabbb2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da406f480 con 0x7f6da4071d50 2023-06-08T03:49:44.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6dabbb2700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40b10d0 con 0x7f6da40b1dc0 2023-06-08T03:49:44.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6dabbb2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40cb590 con 0x7f6da4159380 2023-06-08T03:49:44.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6da914d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 0x7f6da40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6da994e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 0x7f6da40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6da994e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 0x7f6da40716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:53304/0 (socket says 172.21.15.43:53304) 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6da914d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 0x7f6da40cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:41464/0 (socket says 172.21.15.43:41464) 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6daa14f700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6da4071d50 0x7f6da415cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:41976/0 (socket says 172.21.15.43:41976) 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.752+0000 7f6da994e700 1 -- 172.21.15.43:0/409635853 learned_addr learned my addr 172.21.15.43:0/409635853 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da994e700 1 -- 172.21.15.43:0/409635853 >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 msgr2=0x7f6da40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da994e700 1 --2- 172.21.15.43:0/409635853 >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 0x7f6da40cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da994e700 1 -- 172.21.15.43:0/409635853 >> v1:172.21.15.135:6789/0 conn(0x7f6da4071d50 legacy=0x7f6da415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da994e700 1 -- 172.21.15.43:0/409635853 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da406f760 con 0x7f6da4159380 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da914d700 1 --2- 172.21.15.43:0/409635853 >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 0x7f6da40cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da994e700 1 --2- 172.21.15.43:0/409635853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 0x7f6da40716c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400bb90 tx=0x7f6d9400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c568cf49b27938c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da894c700 1 -- 172.21.15.43:0/409635853 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400dc30 con 0x7f6da4159380 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da894c700 1 -- 172.21.15.43:0/409635853 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9400dd90 con 0x7f6da4159380 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.753+0000 7f6da894c700 1 -- 172.21.15.43:0/409635853 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94004250 con 0x7f6da4159380 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 -- 172.21.15.43:0/409635853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 msgr2=0x7f6da40716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/409635853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 0x7f6da40716c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400bb90 tx=0x7f6d9400bea0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 -- 172.21.15.43:0/409635853 shutdown_connections 2023-06-08T03:49:44.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/409635853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4159380 0x7f6da40716c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/409635853 >> v2:172.21.15.135:3300/0 conn(0x7f6da40b1dc0 0x7f6da40cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 -- 172.21.15.43:0/409635853 >> 172.21.15.43:0/409635853 conn(0x7f6da406aec0 msgr2=0x7f6da406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:44.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 -- 172.21.15.43:0/409635853 shutdown_connections 2023-06-08T03:49:44.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.754+0000 7f6dabbb2700 1 -- 172.21.15.43:0/409635853 wait complete. 2023-06-08T03:49:44.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.756+0000 7f6dabbb2700 1 Processor -- start 2023-06-08T03:49:44.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.756+0000 7f6dabbb2700 1 -- start start 2023-06-08T03:49:44.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.756+0000 7f6dabbb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 0x7f6da40b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.756+0000 7f6dabbb2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da40b1dc0 0x7f6da40b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6dabbb2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da4159380 0x7f6da40b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6dabbb2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da415c230 con 0x7f6da4071d50 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6dabbb2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da415bf50 con 0x7f6da4159380 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6dabbb2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41e1b00 con 0x7f6da40b1dc0 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 0x7f6da40b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 0x7f6da40b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59854/0 (socket says 172.21.15.43:59854) 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 -- 172.21.15.43:0/1907511745 learned_addr learned my addr 172.21.15.43:0/1907511745 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:44.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6daa14f700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da4159380 0x7f6da40b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da914d700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da40b1dc0 0x7f6da40b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 -- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da40b1dc0 msgr2=0x7f6da40b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da40b1dc0 0x7f6da40b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 -- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da4159380 msgr2=0x7f6da40b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da4159380 0x7f6da40b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 -- 172.21.15.43:0/1907511745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da00094a0 con 0x7f6da4071d50 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6da994e700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 0x7f6da40b2480 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400b340 tx=0x7f6d94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94020070 con 0x7f6da4071d50 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d940038b0 con 0x7f6da4071d50 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9400b7f0 con 0x7f6da4071d50 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94003c80 con 0x7f6da4071d50 2023-06-08T03:49:44.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.757+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da41e20c0 con 0x7f6da4071d50 2023-06-08T03:49:44.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.758+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da41e1960 con 0x7f6da4071d50 2023-06-08T03:49:44.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.759+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d940193f0 con 0x7f6da4071d50 2023-06-08T03:49:44.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.759+0000 7f6d9a7fc700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6d8806ace0 0x7f6d8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:44.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.759+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d9408cac0 con 0x7f6da4071d50 2023-06-08T03:49:44.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.760+0000 7f6da914d700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6d8806ace0 0x7f6d8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:44.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.760+0000 7f6da914d700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6d8806ace0 0x7f6d8806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6da414e230 tx=0x7f6da0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:44.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.764+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6da41e1960 con 0x7f6da4071d50 2023-06-08T03:49:44.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.959+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6da41e1960 con 0x7f6da4071d50 2023-06-08T03:49:44.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.960+0000 7f6d9a7fc700 1 -- 172.21.15.43:0/1907511745 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6da41e1960 con 0x7f6da4071d50 2023-06-08T03:49:44.963 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:44.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6d8806ace0 msgr2=0x7f6d8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6d8806ace0 0x7f6d8806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6da414e230 tx=0x7f6da0009210 comp rx=0 tx=0).stop 2023-06-08T03:49:44.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 msgr2=0x7f6da40b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 0x7f6da40b2480 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400b340 tx=0x7f6d94004750 comp rx=0 tx=0).stop 2023-06-08T03:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 shutdown_connections 2023-06-08T03:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6d8806ace0 0x7f6d8806d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da4071d50 0x7f6da40b2480 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da4159380 0x7f6da40b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 --2- 172.21.15.43:0/1907511745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da40b1dc0 0x7f6da40b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:44.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 >> 172.21.15.43:0/1907511745 conn(0x7f6da406aec0 msgr2=0x7f6da40cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:44.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 shutdown_connections 2023-06-08T03:49:44.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:44.962+0000 7f6dabbb2700 1 -- 172.21.15.43:0/1907511745 wait complete. 2023-06-08T03:49:44.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:45.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.102+0000 7f4606c29700 1 Processor -- start 2023-06-08T03:49:45.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.102+0000 7f4606c29700 1 -- start start 2023-06-08T03:49:45.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.102+0000 7f4606c29700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46000c9d10 0x7f460015e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.102+0000 7f4606c29700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f460006f660 0x7f46000711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f4606c29700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46000cba70 con 0x7f4600069db0 2023-06-08T03:49:45.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f4606c29700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460015ec10 con 0x7f460006f660 2023-06-08T03:49:45.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f4606c29700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46000cbd50 con 0x7f46000c9d10 2023-06-08T03:49:45.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f460006f660 0x7f46000711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f460006f660 0x7f46000711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59866/0 (socket says 172.21.15.43:59866) 2023-06-08T03:49:45.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 -- 172.21.15.43:0/1273956787 learned_addr learned my addr 172.21.15.43:0/1273956787 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:45.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f45fffff700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46000c9d10 0x7f460015e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 -- 172.21.15.43:0/1273956787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46000c9d10 msgr2=0x7f460015e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46000c9d10 0x7f460015e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 -- 172.21.15.43:0/1273956787 >> v1:172.21.15.135:6789/0 conn(0x7f4600069db0 legacy=0x7f460006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 -- 172.21.15.43:0/1273956787 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460006eb80 con 0x7f460006f660 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f45fffff700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46000c9d10 0x7f460015e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f46051c6700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000711f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009e50 tx=0x7f45f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac634e52a5cb995d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f45ff7fe700 1 -- 172.21.15.43:0/1273956787 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800e070 con 0x7f460006f660 2023-06-08T03:49:45.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f45ff7fe700 1 -- 172.21.15.43:0/1273956787 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f800b9c0 con 0x7f460006f660 2023-06-08T03:49:45.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.103+0000 7f45ff7fe700 1 -- 172.21.15.43:0/1273956787 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800bd70 con 0x7f460006f660 2023-06-08T03:49:45.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 -- 172.21.15.43:0/1273956787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 msgr2=0x7f46000711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000711f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009e50 tx=0x7f45f800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:45.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 -- 172.21.15.43:0/1273956787 shutdown_connections 2023-06-08T03:49:45.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000711f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 --2- 172.21.15.43:0/1273956787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46000c9d10 0x7f460015e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 -- 172.21.15.43:0/1273956787 >> 172.21.15.43:0/1273956787 conn(0x7f460006aec0 msgr2=0x7f460006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:45.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 -- 172.21.15.43:0/1273956787 shutdown_connections 2023-06-08T03:49:45.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.104+0000 7f4606c29700 1 -- 172.21.15.43:0/1273956787 wait complete. 2023-06-08T03:49:45.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.105+0000 7f4606c29700 1 Processor -- start 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.105+0000 7f4606c29700 1 -- start start 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f4606c29700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4600069db0 0x7f46001e4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f4606c29700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f4606c29700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46000c9d10 0x7f46000c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f4606c29700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000b07d0 con 0x7f460006f660 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f4606c29700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46001e6580 con 0x7f46000c9d10 2023-06-08T03:49:45.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f4606c29700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46001e4690 con 0x7f4600069db0 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f45fffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f45fffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59870/0 (socket says 172.21.15.43:59870) 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.106+0000 7f45fffff700 1 -- 172.21.15.43:0/4278804637 learned_addr learned my addr 172.21.15.43:0/4278804637 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f46051c6700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46000c9d10 0x7f46000c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f46049c5700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4600069db0 0x7f46001e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fffff700 1 -- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4600069db0 msgr2=0x7f46001e4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fffff700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4600069db0 0x7f46001e4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fffff700 1 -- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46000c9d10 msgr2=0x7f46000c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fffff700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46000c9d10 0x7f46000c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fffff700 1 -- 172.21.15.43:0/4278804637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009b30 con 0x7f460006f660 2023-06-08T03:49:45.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f46049c5700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4600069db0 0x7f46001e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:45.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f46051c6700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46000c9d10 0x7f46000c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:45.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fffff700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000c5480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00e7d0 tx=0x7f45ec00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec013610 con 0x7f460006f660 2023-06-08T03:49:45.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec013770 con 0x7f460006f660 2023-06-08T03:49:45.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46001e5c90 con 0x7f460006f660 2023-06-08T03:49:45.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec013b00 con 0x7f460006f660 2023-06-08T03:49:45.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.107+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46001e6210 con 0x7f460006f660 2023-06-08T03:49:45.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.108+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46001e6730 con 0x7f460006f660 2023-06-08T03:49:45.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.108+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45ec013c60 con 0x7f460006f660 2023-06-08T03:49:45.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.109+0000 7f45fd7fa700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f45e406ace0 0x7f45e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.109+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f45ec0893e0 con 0x7f460006f660 2023-06-08T03:49:45.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.109+0000 7f46049c5700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f45e406ace0 0x7f45e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.110+0000 7f46049c5700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f45e406ace0 0x7f45e406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f45f4000f60 tx=0x7f45f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.113+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f46001e6730 con 0x7f460006f660 2023-06-08T03:49:45.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.314+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46001e6730 con 0x7f460006f660 2023-06-08T03:49:45.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.314+0000 7f45fd7fa700 1 -- 172.21.15.43:0/4278804637 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46001e6730 con 0x7f460006f660 2023-06-08T03:49:45.317 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:45.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f45e406ace0 msgr2=0x7f45e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f45e406ace0 0x7f45e406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f45f4000f60 tx=0x7f45f4009040 comp rx=0 tx=0).stop 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 msgr2=0x7f46000c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000c5480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00e7d0 tx=0x7f45ec00eb90 comp rx=0 tx=0).stop 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 shutdown_connections 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f45e406ace0 0x7f45e406d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46000c9d10 0x7f46000c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4600069db0 0x7f46001e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 --2- 172.21.15.43:0/4278804637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f460006f660 0x7f46000c5480 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 >> 172.21.15.43:0/4278804637 conn(0x7f460006aec0 msgr2=0x7f46000710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:45.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 shutdown_connections 2023-06-08T03:49:45.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.316+0000 7f4606c29700 1 -- 172.21.15.43:0/4278804637 wait complete. 2023-06-08T03:49:45.331 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:45.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.455+0000 7f91a66a8700 1 Processor -- start 2023-06-08T03:49:45.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.455+0000 7f91a66a8700 1 -- start start 2023-06-08T03:49:45.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a66a8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91a00cf5b0 0x7f91a00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a66a8700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91a015e340 0x7f91a00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a66a8700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a00cda20 con 0x7f91a00b60a0 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a66a8700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00b6470 con 0x7f91a015e340 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a66a8700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a015e7a0 con 0x7f91a00cf5b0 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a4c45700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91a015e340 0x7f91a00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f919ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f91a00b60a0 0x7f91a015dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54780/0 (socket says 172.21.15.43:54780) 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a4c45700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91a015e340 0x7f91a00cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59880/0 (socket says 172.21.15.43:59880) 2023-06-08T03:49:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f919ffff700 1 -- 172.21.15.43:0/3774301652 learned_addr learned my addr 172.21.15.43:0/3774301652 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f919f7fe700 1 --2- 172.21.15.43:0/3774301652 >> v2:172.21.15.135:3300/0 conn(0x7f91a00cf5b0 0x7f91a00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a4c45700 1 -- 172.21.15.43:0/3774301652 >> v2:172.21.15.135:3300/0 conn(0x7f91a00cf5b0 msgr2=0x7f91a00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a4c45700 1 --2- 172.21.15.43:0/3774301652 >> v2:172.21.15.135:3300/0 conn(0x7f91a00cf5b0 0x7f91a00cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a4c45700 1 -- 172.21.15.43:0/3774301652 >> v1:172.21.15.43:6789/0 conn(0x7f91a00b60a0 legacy=0x7f91a015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f919effd700 1 -- 172.21.15.43:0/3774301652 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527766829 0 0) 0x7f91a00cda20 con 0x7f91a00b60a0 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f91a4c45700 1 -- 172.21.15.43:0/3774301652 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a015a520 con 0x7f91a015e340 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.456+0000 7f919f7fe700 1 --2- 172.21.15.43:0/3774301652 >> v2:172.21.15.135:3300/0 conn(0x7f91a00cf5b0 0x7f91a00cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a4c45700 1 --2- 172.21.15.43:0/3774301652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a015e340 0x7f91a00cfb00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91a00cbd90 tx=0x7f919800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a868fefd68d827b7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f919effd700 1 -- 172.21.15.43:0/3774301652 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800e070 con 0x7f91a015e340 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f919effd700 1 -- 172.21.15.43:0/3774301652 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800bbd0 con 0x7f91a015e340 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f919effd700 1 -- 172.21.15.43:0/3774301652 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198012430 con 0x7f91a015e340 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 -- 172.21.15.43:0/3774301652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a015e340 msgr2=0x7f91a00cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 --2- 172.21.15.43:0/3774301652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a015e340 0x7f91a00cfb00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91a00cbd90 tx=0x7f919800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 -- 172.21.15.43:0/3774301652 shutdown_connections 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 --2- 172.21.15.43:0/3774301652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a015e340 0x7f91a00cfb00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 --2- 172.21.15.43:0/3774301652 >> v2:172.21.15.135:3300/0 conn(0x7f91a00cf5b0 0x7f91a00cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 -- 172.21.15.43:0/3774301652 >> 172.21.15.43:0/3774301652 conn(0x7f91a0069db0 msgr2=0x7f91a006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:45.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 -- 172.21.15.43:0/3774301652 shutdown_connections 2023-06-08T03:49:45.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.457+0000 7f91a66a8700 1 -- 172.21.15.43:0/3774301652 wait complete. 2023-06-08T03:49:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 Processor -- start 2023-06-08T03:49:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 -- start start 2023-06-08T03:49:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91a00b60a0 0x7f91a0147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 0x7f91a00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91a015e340 0x7f91a00cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01480e0 con 0x7f91a00cf5b0 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015d590 con 0x7f91a015e340 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.459+0000 7f91a66a8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015c4f0 con 0x7f91a00b60a0 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 0x7f91a00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 0x7f91a00b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59884/0 (socket says 172.21.15.43:59884) 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 -- 172.21.15.43:0/1141320825 learned_addr learned my addr 172.21.15.43:0/1141320825 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919ffff700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91a00b60a0 0x7f91a0147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f91a4c45700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91a015e340 0x7f91a00cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 -- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91a00b60a0 msgr2=0x7f91a0147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91a00b60a0 0x7f91a0147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 -- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91a015e340 msgr2=0x7f91a00cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91a015e340 0x7f91a00cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 -- 172.21.15.43:0/1141320825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198009a70 con 0x7f91a00cf5b0 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919f7fe700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 0x7f91a00b1750 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f918800e760 tx=0x7f918800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800c070 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188013610 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a015c7d0 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188013980 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.460+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a015cd90 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.461+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a0073fa0 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.462+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9188013ae0 con 0x7f91a00cf5b0 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.462+0000 7f919cff9700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f918006ad10 0x7f918006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.462+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9188089450 con 0x7f91a00cf5b0 2023-06-08T03:49:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.462+0000 7f919ffff700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f918006ad10 0x7f918006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.463+0000 7f919ffff700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f918006ad10 0x7f918006d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9190000f60 tx=0x7f9190007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.467+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9188057c60 con 0x7f91a00cf5b0 2023-06-08T03:49:45.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.664+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f91a00b2790 con 0x7f91a00cf5b0 2023-06-08T03:49:45.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.664+0000 7f919cff9700 1 -- 172.21.15.43:0/1141320825 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f91880577f0 con 0x7f91a00cf5b0 2023-06-08T03:49:45.668 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:45.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f918006ad10 msgr2=0x7f918006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f918006ad10 0x7f918006d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9190000f60 tx=0x7f9190007e70 comp rx=0 tx=0).stop 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 msgr2=0x7f91a00b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 0x7f91a00b1750 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f918800e760 tx=0x7f918800ea70 comp rx=0 tx=0).stop 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 shutdown_connections 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f918006ad10 0x7f918006d1c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91a015e340 0x7f91a00cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91a00b60a0 0x7f91a0147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 --2- 172.21.15.43:0/1141320825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91a00cf5b0 0x7f91a00b1750 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 >> 172.21.15.43:0/1141320825 conn(0x7f91a0069db0 msgr2=0x7f91a0158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:45.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 shutdown_connections 2023-06-08T03:49:45.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.666+0000 7f91a66a8700 1 -- 172.21.15.43:0/1141320825 wait complete. 2023-06-08T03:49:45.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T03:49:45.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.803+0000 7f97b3a1b700 1 Processor -- start 2023-06-08T03:49:45.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.803+0000 7f97b3a1b700 1 -- start start 2023-06-08T03:49:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b3a1b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac0ccc10 0x7f97ac164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b3a1b700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0cdb80 con 0x7f97ac15e420 2023-06-08T03:49:45.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b3a1b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0ce310 con 0x7f97ac15e050 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b3a1b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0ce5f0 con 0x7f97ac0ccc10 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b0fb6700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f97ac15e420 0x7f97ac0cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54796/0 (socket says 172.21.15.43:54796) 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b0fb6700 1 -- 172.21.15.43:0/3644740647 learned_addr learned my addr 172.21.15.43:0/3644740647 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.804+0000 7f97b1fb8700 1 --2- 172.21.15.43:0/3644740647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac0ccc10 0x7f97ac164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.805+0000 7f97b1fb8700 1 -- 172.21.15.43:0/3644740647 >> v1:172.21.15.135:6789/0 conn(0x7f97ac15e050 legacy=0x7f97ac0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.805+0000 7f97b1fb8700 1 -- 172.21.15.43:0/3644740647 >> v1:172.21.15.43:6789/0 conn(0x7f97ac15e420 legacy=0x7f97ac0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.805+0000 7f97b1fb8700 1 -- 172.21.15.43:0/3644740647 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0ce8d0 con 0x7f97ac0ccc10 2023-06-08T03:49:45.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.805+0000 7f97b1fb8700 1 --2- 172.21.15.43:0/3644740647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac0ccc10 0x7f97ac164bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009dc0 tx=0x7f97a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c159404e933bf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.807+0000 7f97a3fff700 1 -- 172.21.15.43:0/3644740647 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400e070 con 0x7f97ac0ccc10 2023-06-08T03:49:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97a3fff700 1 -- 172.21.15.43:0/3644740647 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a400bbd0 con 0x7f97ac0ccc10 2023-06-08T03:49:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97a3fff700 1 -- 172.21.15.43:0/3644740647 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4012430 con 0x7f97ac0ccc10 2023-06-08T03:49:45.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 -- 172.21.15.43:0/3644740647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac0ccc10 msgr2=0x7f97ac164bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/3644740647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac0ccc10 0x7f97ac164bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009dc0 tx=0x7f97a400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 -- 172.21.15.43:0/3644740647 shutdown_connections 2023-06-08T03:49:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/3644740647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac0ccc10 0x7f97ac164bb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 -- 172.21.15.43:0/3644740647 >> 172.21.15.43:0/3644740647 conn(0x7f97ac069db0 msgr2=0x7f97ac06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:45.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 -- 172.21.15.43:0/3644740647 shutdown_connections 2023-06-08T03:49:45.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.808+0000 7f97b3a1b700 1 -- 172.21.15.43:0/3644740647 wait complete. 2023-06-08T03:49:45.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 Processor -- start 2023-06-08T03:49:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 -- start start 2023-06-08T03:49:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 0x7f97ac06bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac15e050 0x7f97ac151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97ac15e420 0x7f97ac151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac152400 con 0x7f97ac0ccc10 2023-06-08T03:49:45.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0b2050 con 0x7f97ac15e420 2023-06-08T03:49:45.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b3a1b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac157d40 con 0x7f97ac15e050 2023-06-08T03:49:45.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b17b7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 0x7f97ac06bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.810+0000 7f97b17b7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 0x7f97ac06bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59896/0 (socket says 172.21.15.43:59896) 2023-06-08T03:49:45.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 -- 172.21.15.43:0/273355193 learned_addr learned my addr 172.21.15.43:0/273355193 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:45.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b0fb6700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac15e050 0x7f97ac151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b1fb8700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97ac15e420 0x7f97ac151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 -- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac15e050 msgr2=0x7f97ac151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac15e050 0x7f97ac151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 -- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97ac15e420 msgr2=0x7f97ac151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:45.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97ac15e420 0x7f97ac151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:45.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 -- 172.21.15.43:0/273355193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4009a70 con 0x7f97ac0ccc10 2023-06-08T03:49:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b17b7700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 0x7f97ac06bfc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c4e0 tx=0x7f979c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0052d0 con 0x7f97ac0ccc10 2023-06-08T03:49:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c005430 con 0x7f97ac0ccc10 2023-06-08T03:49:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0038c0 con 0x7f97ac0ccc10 2023-06-08T03:49:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac0b1290 con 0x7f97ac0ccc10 2023-06-08T03:49:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.811+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac0b1850 con 0x7f97ac0ccc10 2023-06-08T03:49:45.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.812+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac073fa0 con 0x7f97ac0ccc10 2023-06-08T03:49:45.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.812+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f979c003a20 con 0x7f97ac0ccc10 2023-06-08T03:49:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.813+0000 7f97a1ffb700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f979006ace0 0x7f979006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.813+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f979c088b10 con 0x7f97ac0ccc10 2023-06-08T03:49:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.813+0000 7f97b0fb6700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f979006ace0 0x7f979006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.814+0000 7f97b0fb6700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f979006ace0 0x7f979006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0c7a10 tx=0x7f97a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:45.817+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f979c053890 con 0x7f97ac0ccc10 2023-06-08T03:49:46.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.032+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97ac15e8a0 con 0x7f97ac0ccc10 2023-06-08T03:49:46.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.032+0000 7f97a1ffb700 1 -- 172.21.15.43:0/273355193 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f979c056eb0 con 0x7f97ac0ccc10 2023-06-08T03:49:46.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f979006ace0 msgr2=0x7f979006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f979006ace0 0x7f979006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0c7a10 tx=0x7f97a8009040 comp rx=0 tx=0).stop 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 msgr2=0x7f97ac06bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 0x7f97ac06bfc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c4e0 tx=0x7f979c00c7f0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 shutdown_connections 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f979006ace0 0x7f979006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ac0ccc10 0x7f97ac06bfc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97ac15e420 0x7f97ac151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 --2- 172.21.15.43:0/273355193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97ac15e050 0x7f97ac151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 >> 172.21.15.43:0/273355193 conn(0x7f97ac069db0 msgr2=0x7f97ac072930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:46.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 shutdown_connections 2023-06-08T03:49:46.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.034+0000 7f97b3a1b700 1 -- 172.21.15.43:0/273355193 wait complete. 2023-06-08T03:49:46.039 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T03:49:46.049 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-08T03:49:46.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:46.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-08T03:49:46.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T03:49:46.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:49:46.092 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-08T03:49:46.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-08T03:49:46.151 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:46.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.273+0000 7f2e0419e700 1 Processor -- start 2023-06-08T03:49:46.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.273+0000 7f2e0419e700 1 -- start start 2023-06-08T03:49:46.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0419e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2dfc158fc0 0x7f2dfc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0419e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 0x7f2dfc0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0419e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dfc159390 con 0x7f2dfc06c8f0 2023-06-08T03:49:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0419e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dfc0caee0 con 0x7f2dfc158fc0 2023-06-08T03:49:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0419e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0ae770 con 0x7f2dfc06d9d0 2023-06-08T03:49:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0273b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 0x7f2dfc0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0273b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 0x7f2dfc0cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:53364/0 (socket says 172.21.15.43:53364) 2023-06-08T03:49:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e0273b700 1 -- 172.21.15.43:0/1898771732 learned_addr learned my addr 172.21.15.43:0/1898771732 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.274+0000 7f2e01f3a700 1 --2- 172.21.15.43:0/1898771732 >> v2:172.21.15.135:3300/0 conn(0x7f2dfc158fc0 0x7f2dfc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e0273b700 1 -- 172.21.15.43:0/1898771732 >> v2:172.21.15.135:3300/0 conn(0x7f2dfc158fc0 msgr2=0x7f2dfc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e0273b700 1 --2- 172.21.15.43:0/1898771732 >> v2:172.21.15.135:3300/0 conn(0x7f2dfc158fc0 0x7f2dfc069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e0273b700 1 -- 172.21.15.43:0/1898771732 >> v1:172.21.15.135:6789/0 conn(0x7f2dfc06c8f0 legacy=0x7f2dfc06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e0273b700 1 -- 172.21.15.43:0/1898771732 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0ca920 con 0x7f2dfc06d9d0 2023-06-08T03:49:46.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e0273b700 1 --2- 172.21.15.43:0/1898771732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 0x7f2dfc0cd440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d150 tx=0x7f2df400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36bf984a5e50e07e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:46.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e00f38700 1 -- 172.21.15.43:0/1898771732 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4010070 con 0x7f2dfc06d9d0 2023-06-08T03:49:46.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e00f38700 1 -- 172.21.15.43:0/1898771732 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df400dd10 con 0x7f2dfc06d9d0 2023-06-08T03:49:46.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.275+0000 7f2e00f38700 1 -- 172.21.15.43:0/1898771732 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400b310 con 0x7f2dfc06d9d0 2023-06-08T03:49:46.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 -- 172.21.15.43:0/1898771732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 msgr2=0x7f2dfc0cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 --2- 172.21.15.43:0/1898771732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 0x7f2dfc0cd440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d150 tx=0x7f2df400d460 comp rx=0 tx=0).stop 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 -- 172.21.15.43:0/1898771732 shutdown_connections 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 --2- 172.21.15.43:0/1898771732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06d9d0 0x7f2dfc0cd440 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 --2- 172.21.15.43:0/1898771732 >> v2:172.21.15.135:3300/0 conn(0x7f2dfc158fc0 0x7f2dfc069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 -- 172.21.15.43:0/1898771732 >> 172.21.15.43:0/1898771732 conn(0x7f2dfc0ceed0 msgr2=0x7f2dfc0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 -- 172.21.15.43:0/1898771732 shutdown_connections 2023-06-08T03:49:46.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.276+0000 7f2e0419e700 1 -- 172.21.15.43:0/1898771732 wait complete. 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.277+0000 7f2e0419e700 1 Processor -- start 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.277+0000 7f2e0419e700 1 -- start start 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0419e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06c8f0 0x7f2dfc155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0419e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc06d9d0 0x7f2dfc154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0419e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 0x7f2dfc152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0419e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0c3460 con 0x7f2dfc158fc0 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0419e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc154c40 con 0x7f2dfc06d9d0 2023-06-08T03:49:46.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0419e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0c39e0 con 0x7f2dfc06c8f0 2023-06-08T03:49:46.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 0x7f2dfc152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 0x7f2dfc152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59912/0 (socket says 172.21.15.43:59912) 2023-06-08T03:49:46.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 -- 172.21.15.43:0/3863429065 learned_addr learned my addr 172.21.15.43:0/3863429065 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:46.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e01739700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc06d9d0 0x7f2dfc154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e01f3a700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06c8f0 0x7f2dfc155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 -- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06c8f0 msgr2=0x7f2dfc155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06c8f0 0x7f2dfc155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 -- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc06d9d0 msgr2=0x7f2dfc154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc06d9d0 0x7f2dfc154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.278+0000 7f2e0273b700 1 -- 172.21.15.43:0/3863429065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df400bd40 con 0x7f2dfc158fc0 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.279+0000 7f2e0273b700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 0x7f2dfc152330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0ae8b0 tx=0x7f2df4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.279+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4009a10 con 0x7f2dfc158fc0 2023-06-08T03:49:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.279+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df4009b70 con 0x7f2dfc158fc0 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.279+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc1556b0 con 0x7f2dfc158fc0 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.279+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400b4c0 con 0x7f2dfc158fc0 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.279+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc0c3670 con 0x7f2dfc158fc0 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.280+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc0c3b50 con 0x7f2dfc158fc0 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.280+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2df4004040 con 0x7f2dfc158fc0 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.281+0000 7f2df27fc700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2de006ad10 0x7f2de006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.281+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2df408b0f0 con 0x7f2dfc158fc0 2023-06-08T03:49:46.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.281+0000 7f2e01f3a700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2de006ad10 0x7f2de006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.281+0000 7f2e01f3a700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2de006ad10 0x7f2de006d1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009be0 tx=0x7f2dec009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:46.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.285+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2df4055f00 con 0x7f2dfc158fc0 2023-06-08T03:49:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.526+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dfc073fa0 con 0x7f2dfc158fc0 2023-06-08T03:49:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.526+0000 7f2df27fc700 1 -- 172.21.15.43:0/3863429065 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f2df4059520 con 0x7f2dfc158fc0 2023-06-08T03:49:46.530 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:46.530 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2de006ad10 msgr2=0x7f2de006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2de006ad10 0x7f2de006d1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009be0 tx=0x7f2dec009210 comp rx=0 tx=0).stop 2023-06-08T03:49:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 msgr2=0x7f2dfc152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 0x7f2dfc152330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0ae8b0 tx=0x7f2df4004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 shutdown_connections 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f2de006ad10 0x7f2de006d1c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dfc158fc0 0x7f2dfc152330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc06c8f0 0x7f2dfc155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 --2- 172.21.15.43:0/3863429065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc06d9d0 0x7f2dfc154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 >> 172.21.15.43:0/3863429065 conn(0x7f2dfc0ceed0 msgr2=0x7f2dfc0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 shutdown_connections 2023-06-08T03:49:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.528+0000 7f2e0419e700 1 -- 172.21.15.43:0/3863429065 wait complete. 2023-06-08T03:49:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:46.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:46.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.664+0000 7f4bacfad700 1 Processor -- start 2023-06-08T03:49:46.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.664+0000 7f4bacfad700 1 -- start start 2023-06-08T03:49:46.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.665+0000 7f4bacfad700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4ba815d650 0x7f4ba80af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.665+0000 7f4bacfad700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815e1a0 0x7f4ba80cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.665+0000 7f4bacfad700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba815e8c0 con 0x7f4ba815d280 2023-06-08T03:49:46.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.665+0000 7f4bacfad700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80afeb0 con 0x7f4ba815d650 2023-06-08T03:49:46.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.665+0000 7f4bacfad700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80b3fa0 con 0x7f4ba815e1a0 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.665+0000 7f4ba5d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4ba815d650 0x7f4ba80af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4ba815d650 0x7f4ba80af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59920/0 (socket says 172.21.15.43:59920) 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 -- 172.21.15.43:0/3799514403 learned_addr learned my addr 172.21.15.43:0/3799514403 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba6d9d700 1 --2- 172.21.15.43:0/3799514403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815e1a0 0x7f4ba80cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 -- 172.21.15.43:0/3799514403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815e1a0 msgr2=0x7f4ba80cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 --2- 172.21.15.43:0/3799514403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815e1a0 0x7f4ba80cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 -- 172.21.15.43:0/3799514403 >> v1:172.21.15.135:6789/0 conn(0x7f4ba815d280 legacy=0x7f4ba815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 -- 172.21.15.43:0/3799514403 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80cdb10 con 0x7f4ba815d650 2023-06-08T03:49:46.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba559a700 1 -- 172.21.15.43:0/3799514403 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277426149 0 0) 0x7f4ba815e8c0 con 0x7f4ba815d280 2023-06-08T03:49:46.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba5d9b700 1 --2- 172.21.15.43:0/3799514403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815d650 0x7f4ba80af970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4b900098f0 tx=0x7f4b90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad9e86784ecf145 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:46.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba559a700 1 -- 172.21.15.43:0/3799514403 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90011830 con 0x7f4ba815d650 2023-06-08T03:49:46.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba559a700 1 -- 172.21.15.43:0/3799514403 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90011990 con 0x7f4ba815d650 2023-06-08T03:49:46.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.666+0000 7f4ba559a700 1 -- 172.21.15.43:0/3799514403 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90011d20 con 0x7f4ba815d650 2023-06-08T03:49:46.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 -- 172.21.15.43:0/3799514403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815d650 msgr2=0x7f4ba80af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 --2- 172.21.15.43:0/3799514403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815d650 0x7f4ba80af970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4b900098f0 tx=0x7f4b90009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:46.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 -- 172.21.15.43:0/3799514403 shutdown_connections 2023-06-08T03:49:46.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 --2- 172.21.15.43:0/3799514403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815e1a0 0x7f4ba80cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 --2- 172.21.15.43:0/3799514403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815d650 0x7f4ba80af970 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 -- 172.21.15.43:0/3799514403 >> 172.21.15.43:0/3799514403 conn(0x7f4ba8069db0 msgr2=0x7f4ba806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:46.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 -- 172.21.15.43:0/3799514403 shutdown_connections 2023-06-08T03:49:46.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.667+0000 7f4bacfad700 1 -- 172.21.15.43:0/3799514403 wait complete. 2023-06-08T03:49:46.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.668+0000 7f4bacfad700 1 Processor -- start 2023-06-08T03:49:46.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.668+0000 7f4bacfad700 1 -- start start 2023-06-08T03:49:46.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4bacfad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ba815d280 0x7f4ba814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4bacfad700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815d650 0x7f4ba80c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4bacfad700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 0x7f4ba80c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4bacfad700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba81f09f0 con 0x7f4ba815e1a0 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4bacfad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba814e0d0 con 0x7f4ba815d280 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4bacfad700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba81efe70 con 0x7f4ba815d650 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 0x7f4ba80c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 0x7f4ba80c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59928/0 (socket says 172.21.15.43:59928) 2023-06-08T03:49:46.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 -- 172.21.15.43:0/2999322461 learned_addr learned my addr 172.21.15.43:0/2999322461 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:46.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba659c700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ba815d280 0x7f4ba814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba5d9b700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815d650 0x7f4ba80c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 -- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815d650 msgr2=0x7f4ba80c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815d650 0x7f4ba80c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 -- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ba815d280 msgr2=0x7f4ba814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ba815d280 0x7f4ba814db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 -- 172.21.15.43:0/2999322461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90009550 con 0x7f4ba815e1a0 2023-06-08T03:49:46.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.669+0000 7f4ba6d9d700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 0x7f4ba80c85f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000efc0 tx=0x7f4ba000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:46.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.670+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000cc90 con 0x7f4ba815e1a0 2023-06-08T03:49:46.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.670+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000f040 con 0x7f4ba815e1a0 2023-06-08T03:49:46.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.670+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba81f0150 con 0x7f4ba815e1a0 2023-06-08T03:49:46.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.670+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00146c0 con 0x7f4ba815e1a0 2023-06-08T03:49:46.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.670+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba81f0710 con 0x7f4ba815e1a0 2023-06-08T03:49:46.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.671+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba8073fa0 con 0x7f4ba815e1a0 2023-06-08T03:49:46.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.671+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ba0014820 con 0x7f4ba815e1a0 2023-06-08T03:49:46.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.672+0000 7f4b9effd700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4b8806ace0 0x7f4b8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:46.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.672+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ba008a2f0 con 0x7f4ba815e1a0 2023-06-08T03:49:46.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.672+0000 7f4ba659c700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4b8806ace0 0x7f4b8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:46.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.672+0000 7f4ba659c700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4b8806ace0 0x7f4b8806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b98000f60 tx=0x7f4b98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:46.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.676+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ba0055100 con 0x7f4ba815e1a0 2023-06-08T03:49:46.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.879+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ba80b2720 con 0x7f4ba815e1a0 2023-06-08T03:49:46.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.880+0000 7f4b9effd700 1 -- 172.21.15.43:0/2999322461 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f4ba0009ca0 con 0x7f4ba815e1a0 2023-06-08T03:49:46.884 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:46.884 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:46.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4b8806ace0 msgr2=0x7f4b8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4b8806ace0 0x7f4b8806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b98000f60 tx=0x7f4b98009040 comp rx=0 tx=0).stop 2023-06-08T03:49:46.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 msgr2=0x7f4ba80c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:46.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 0x7f4ba80c85f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000efc0 tx=0x7f4ba000c3a0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 shutdown_connections 2023-06-08T03:49:46.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f4b8806ace0 0x7f4b8806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba815e1a0 0x7f4ba80c85f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ba815d280 0x7f4ba814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 --2- 172.21.15.43:0/2999322461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ba815d650 0x7f4ba80c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:46.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 >> 172.21.15.43:0/2999322461 conn(0x7f4ba8069db0 msgr2=0x7f4ba80b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:46.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 shutdown_connections 2023-06-08T03:49:46.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:46.882+0000 7f4bacfad700 1 -- 172.21.15.43:0/2999322461 wait complete. 2023-06-08T03:49:46.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:48:44.487563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:48:45.654058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-08T03:48:48.745687+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-08T03:49:46.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:49:47.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.023+0000 7f92c6909700 1 Processor -- start 2023-06-08T03:49:47.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.023+0000 7f92c6909700 1 -- start start 2023-06-08T03:49:47.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c6909700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92c01588a0 0x7f92c006b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c6909700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f92c0071010 0x7f92c015c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c6909700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00cb5f0 con 0x7f92c006c2b0 2023-06-08T03:49:47.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c6909700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c00caec0 con 0x7f92c0071010 2023-06-08T03:49:47.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c6909700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c006dbd0 con 0x7f92c01588a0 2023-06-08T03:49:47.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c4ea6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f92c0071010 0x7f92c015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92bf7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f92c006c2b0 0x7f92c0070900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54836/0 (socket says 172.21.15.43:54836) 2023-06-08T03:49:47.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92bf7fe700 1 -- 172.21.15.43:0/3961483907 learned_addr learned my addr 172.21.15.43:0/3961483907 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:47.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92bffff700 1 --2- 172.21.15.43:0/3961483907 >> v2:172.21.15.135:3300/0 conn(0x7f92c01588a0 0x7f92c006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c4ea6700 1 -- 172.21.15.43:0/3961483907 >> v2:172.21.15.135:3300/0 conn(0x7f92c01588a0 msgr2=0x7f92c006b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:47.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c4ea6700 1 --2- 172.21.15.43:0/3961483907 >> v2:172.21.15.135:3300/0 conn(0x7f92c01588a0 0x7f92c006b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c4ea6700 1 -- 172.21.15.43:0/3961483907 >> v1:172.21.15.43:6789/0 conn(0x7f92c006c2b0 legacy=0x7f92c0070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92c4ea6700 1 -- 172.21.15.43:0/3961483907 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c006deb0 con 0x7f92c0071010 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.024+0000 7f92beffd700 1 -- 172.21.15.43:0/3961483907 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778163187 0 0) 0x7f92c00cb5f0 con 0x7f92c006c2b0 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c4ea6700 1 --2- 172.21.15.43:0/3961483907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c015c820 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f92c00cff30 tx=0x7f92b800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0302d3215116ef6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92beffd700 1 -- 172.21.15.43:0/3961483907 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8010070 con 0x7f92c0071010 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92beffd700 1 -- 172.21.15.43:0/3961483907 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800b2e0 con 0x7f92c0071010 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92beffd700 1 -- 172.21.15.43:0/3961483907 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800dcc0 con 0x7f92c0071010 2023-06-08T03:49:47.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 -- 172.21.15.43:0/3961483907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 msgr2=0x7f92c015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 --2- 172.21.15.43:0/3961483907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c015c820 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f92c00cff30 tx=0x7f92b800d330 comp rx=0 tx=0).stop 2023-06-08T03:49:47.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 -- 172.21.15.43:0/3961483907 shutdown_connections 2023-06-08T03:49:47.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 --2- 172.21.15.43:0/3961483907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c015c820 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 --2- 172.21.15.43:0/3961483907 >> v2:172.21.15.135:3300/0 conn(0x7f92c01588a0 0x7f92c006b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 -- 172.21.15.43:0/3961483907 >> 172.21.15.43:0/3961483907 conn(0x7f92c00cee30 msgr2=0x7f92c00cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:47.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 -- 172.21.15.43:0/3961483907 shutdown_connections 2023-06-08T03:49:47.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.025+0000 7f92c6909700 1 -- 172.21.15.43:0/3961483907 wait complete. 2023-06-08T03:49:47.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.026+0000 7f92c6909700 1 Processor -- start 2023-06-08T03:49:47.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 -- start start 2023-06-08T03:49:47.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c006c2b0 0x7f92c015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c0156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c01588a0 0x7f92c00b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01ed9c0 con 0x7f92c0071010 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0158070 con 0x7f92c01588a0 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92c6909700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c015bbf0 con 0x7f92c006c2b0 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.027+0000 7f92bf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c0156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c0156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59940/0 (socket says 172.21.15.43:59940) 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 -- 172.21.15.43:0/3928797485 learned_addr learned my addr 172.21.15.43:0/3928797485 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bffff700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c006c2b0 0x7f92c015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92c4ea6700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c01588a0 0x7f92c00b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 -- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c006c2b0 msgr2=0x7f92c015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c006c2b0 0x7f92c015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 -- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c01588a0 msgr2=0x7f92c00b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c01588a0 0x7f92c00b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 -- 172.21.15.43:0/3928797485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b800bc80 con 0x7f92c0071010 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bf7fe700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c0156fd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f92b00011e0 tx=0x7f92b000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0004c80 con 0x7f92c0071010 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0004e00 con 0x7f92c0071010 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0007310 con 0x7f92c0071010 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c015bed0 con 0x7f92c0071010 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.028+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c01edeb0 con 0x7f92c0071010 2023-06-08T03:49:47.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.029+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c01ee0d0 con 0x7f92c0071010 2023-06-08T03:49:47.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.030+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92b0007470 con 0x7f92c0071010 2023-06-08T03:49:47.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.030+0000 7f92bcff9700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f92a006ace0 0x7f92a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.030+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f92b0089440 con 0x7f92c0071010 2023-06-08T03:49:47.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.030+0000 7f92bffff700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f92a006ace0 0x7f92a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.031+0000 7f92bffff700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f92a006ace0 0x7f92a006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92a8006b20 tx=0x7f92a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.035+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92b00541c0 con 0x7f92c0071010 2023-06-08T03:49:47.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.231+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92c00cd030 con 0x7f92c0071010 2023-06-08T03:49:47.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.231+0000 7f92bcff9700 1 -- 172.21.15.43:0/3928797485 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92b00577e0 con 0x7f92c0071010 2023-06-08T03:49:47.235 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:49:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f92a006ace0 msgr2=0x7f92a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f92a006ace0 0x7f92a006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92a8006b20 tx=0x7f92a8008040 comp rx=0 tx=0).stop 2023-06-08T03:49:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 msgr2=0x7f92c0156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c0156fd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f92b00011e0 tx=0x7f92b000ca30 comp rx=0 tx=0).stop 2023-06-08T03:49:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 shutdown_connections 2023-06-08T03:49:47.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f92a006ace0 0x7f92a006d190 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92a8006b20 tx=0x7f92a8008040 comp rx=0 tx=0).stop 2023-06-08T03:49:47.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c01588a0 0x7f92c00b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c006c2b0 0x7f92c015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 --2- 172.21.15.43:0/3928797485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92c0071010 0x7f92c0156fd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 >> 172.21.15.43:0/3928797485 conn(0x7f92c00cee30 msgr2=0x7f92c00c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:47.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 shutdown_connections 2023-06-08T03:49:47.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.233+0000 7f92c6909700 1 -- 172.21.15.43:0/3928797485 wait complete. 2023-06-08T03:49:47.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:49:47.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.372+0000 7f3537c68700 1 Processor -- start 2023-06-08T03:49:47.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.373+0000 7f3537c68700 1 -- start start 2023-06-08T03:49:47.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.373+0000 7f3537c68700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f35300b60a0 0x7f35300cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.373+0000 7f3537c68700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f353015e340 0x7f35300cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.373+0000 7f3537c68700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300cda20 con 0x7f35300cf5b0 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.373+0000 7f3537c68700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300b6470 con 0x7f35300b60a0 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.373+0000 7f3537c68700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353015e7a0 con 0x7f353015e340 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f35300b60a0 0x7f35300cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f35300b60a0 0x7f35300cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59946/0 (socket says 172.21.15.43:59946) 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 -- 172.21.15.43:0/2015237545 learned_addr learned my addr 172.21.15.43:0/2015237545 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:47.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3536205700 1 --2- 172.21.15.43:0/2015237545 >> v2:172.21.15.135:3300/0 conn(0x7f353015e340 0x7f35300cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 -- 172.21.15.43:0/2015237545 >> v2:172.21.15.135:3300/0 conn(0x7f353015e340 msgr2=0x7f35300cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 --2- 172.21.15.43:0/2015237545 >> v2:172.21.15.135:3300/0 conn(0x7f353015e340 0x7f35300cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 -- 172.21.15.43:0/2015237545 >> v1:172.21.15.135:6789/0 conn(0x7f35300cf5b0 legacy=0x7f353015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 -- 172.21.15.43:0/2015237545 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353015a520 con 0x7f35300b60a0 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3535a04700 1 --2- 172.21.15.43:0/2015237545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35300b60a0 0x7f35300cad90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3530071ff0 tx=0x7f3520009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7812eb486419d47 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3534a02700 1 -- 172.21.15.43:0/2015237545 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520011830 con 0x7f35300b60a0 2023-06-08T03:49:47.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3534a02700 1 -- 172.21.15.43:0/2015237545 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520011990 con 0x7f35300b60a0 2023-06-08T03:49:47.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.374+0000 7f3534a02700 1 -- 172.21.15.43:0/2015237545 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520011d20 con 0x7f35300b60a0 2023-06-08T03:49:47.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 -- 172.21.15.43:0/2015237545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35300b60a0 msgr2=0x7f35300cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 --2- 172.21.15.43:0/2015237545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35300b60a0 0x7f35300cad90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3530071ff0 tx=0x7f3520009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 -- 172.21.15.43:0/2015237545 shutdown_connections 2023-06-08T03:49:47.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 --2- 172.21.15.43:0/2015237545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35300b60a0 0x7f35300cad90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 --2- 172.21.15.43:0/2015237545 >> v2:172.21.15.135:3300/0 conn(0x7f353015e340 0x7f35300cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 -- 172.21.15.43:0/2015237545 >> 172.21.15.43:0/2015237545 conn(0x7f3530069db0 msgr2=0x7f353006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 -- 172.21.15.43:0/2015237545 shutdown_connections 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.375+0000 7f3537c68700 1 -- 172.21.15.43:0/2015237545 wait complete. 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.376+0000 7f3537c68700 1 Processor -- start 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.376+0000 7f3537c68700 1 -- start start 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3537c68700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35300b60a0 0x7f35301f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3537c68700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35300cf5b0 0x7f35300a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3537c68700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 0x7f3530157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3537c68700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300a74e0 con 0x7f353015e340 2023-06-08T03:49:47.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3537c68700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35301f3cf0 con 0x7f35300cf5b0 2023-06-08T03:49:47.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3537c68700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35301f3fd0 con 0x7f35300b60a0 2023-06-08T03:49:47.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3536205700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 0x7f3530157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3536205700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 0x7f3530157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59956/0 (socket says 172.21.15.43:59956) 2023-06-08T03:49:47.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3536205700 1 -- 172.21.15.43:0/381380706 learned_addr learned my addr 172.21.15.43:0/381380706 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:47.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.377+0000 7f3535203700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35300cf5b0 0x7f35300a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3535a04700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35300b60a0 0x7f35301f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3536205700 1 -- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35300b60a0 msgr2=0x7f35301f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3536205700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35300b60a0 0x7f35301f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3536205700 1 -- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35300cf5b0 msgr2=0x7f35300a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3536205700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35300cf5b0 0x7f35300a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3536205700 1 -- 172.21.15.43:0/381380706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009550 con 0x7f353015e340 2023-06-08T03:49:47.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3535a04700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35300b60a0 0x7f35301f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:47.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3536205700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 0x7f3530157ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f352800efc0 tx=0x7f352800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528009ba0 con 0x7f353015e340 2023-06-08T03:49:47.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800f040 con 0x7f353015e340 2023-06-08T03:49:47.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35301f42b0 con 0x7f353015e340 2023-06-08T03:49:47.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528014480 con 0x7f353015e340 2023-06-08T03:49:47.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.378+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35301f3a00 con 0x7f353015e340 2023-06-08T03:49:47.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.379+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300a7970 con 0x7f353015e340 2023-06-08T03:49:47.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.379+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35280145e0 con 0x7f353015e340 2023-06-08T03:49:47.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.380+0000 7f35267fc700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f351406ace0 0x7f351406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.380+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f352808a3a0 con 0x7f353015e340 2023-06-08T03:49:47.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.380+0000 7f3535a04700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f351406ace0 0x7f351406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.380+0000 7f3535a04700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f351406ace0 0x7f351406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3520014040 tx=0x7f3520008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.384+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3528055110 con 0x7f353015e340 2023-06-08T03:49:47.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.580+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3530073fa0 con 0x7f353015e340 2023-06-08T03:49:47.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.581+0000 7f35267fc700 1 -- 172.21.15.43:0/381380706 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3528058730 con 0x7f353015e340 2023-06-08T03:49:47.584 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:49:47.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f351406ace0 msgr2=0x7f351406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f351406ace0 0x7f351406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3520014040 tx=0x7f3520008030 comp rx=0 tx=0).stop 2023-06-08T03:49:47.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 msgr2=0x7f3530157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 0x7f3530157ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f352800efc0 tx=0x7f352800c3a0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 shutdown_connections 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f351406ace0 0x7f351406d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f353015e340 0x7f3530157ec0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35300b60a0 0x7f35301f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 --2- 172.21.15.43:0/381380706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35300cf5b0 0x7f35300a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 >> 172.21.15.43:0/381380706 conn(0x7f3530069db0 msgr2=0x7f35301598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:47.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 shutdown_connections 2023-06-08T03:49:47.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.583+0000 7f3537c68700 1 -- 172.21.15.43:0/381380706 wait complete. 2023-06-08T03:49:47.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T03:49:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.722+0000 7fa19ab05700 1 Processor -- start 2023-06-08T03:49:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.722+0000 7fa19ab05700 1 -- start start 2023-06-08T03:49:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.722+0000 7fa19ab05700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa194159380 0x7fa1940716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.722+0000 7fa19ab05700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1940b1dc0 0x7fa1940cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.722+0000 7fa19ab05700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1940cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa19ab05700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1940b10d0 con 0x7fa194159380 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa19ab05700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19406f480 con 0x7fa1940b1dc0 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa19ab05700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19406f760 con 0x7fa194071d50 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa194159380 0x7fa1940716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa194159380 0x7fa1940716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59960/0 (socket says 172.21.15.43:59960) 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 -- 172.21.15.43:0/1975567042 learned_addr learned my addr 172.21.15.43:0/1975567042 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1990a2700 1 --2- 172.21.15.43:0/1975567042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1940cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa193fff700 1 --2- 172.21.15.43:0/1975567042 >> v2:172.21.15.135:3300/0 conn(0x7fa1940b1dc0 0x7fa1940cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 -- 172.21.15.43:0/1975567042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 msgr2=0x7fa1940cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 --2- 172.21.15.43:0/1975567042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1940cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 -- 172.21.15.43:0/1975567042 >> v2:172.21.15.135:3300/0 conn(0x7fa1940b1dc0 msgr2=0x7fa1940cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 --2- 172.21.15.43:0/1975567042 >> v2:172.21.15.135:3300/0 conn(0x7fa1940b1dc0 0x7fa1940cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 -- 172.21.15.43:0/1975567042 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940b12e0 con 0x7fa194159380 2023-06-08T03:49:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1988a1700 1 --2- 172.21.15.43:0/1975567042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940716c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa194070ca0 tx=0x7fa188009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52109079b2b94a65 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1937fe700 1 -- 172.21.15.43:0/1975567042 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188011830 con 0x7fa194159380 2023-06-08T03:49:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1937fe700 1 -- 172.21.15.43:0/1975567042 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188011990 con 0x7fa194159380 2023-06-08T03:49:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.723+0000 7fa1937fe700 1 -- 172.21.15.43:0/1975567042 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188011d20 con 0x7fa194159380 2023-06-08T03:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 -- 172.21.15.43:0/1975567042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 msgr2=0x7fa1940716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 --2- 172.21.15.43:0/1975567042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940716c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa194070ca0 tx=0x7fa188009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 -- 172.21.15.43:0/1975567042 shutdown_connections 2023-06-08T03:49:47.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 --2- 172.21.15.43:0/1975567042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1940cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 --2- 172.21.15.43:0/1975567042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940716c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 --2- 172.21.15.43:0/1975567042 >> v2:172.21.15.135:3300/0 conn(0x7fa1940b1dc0 0x7fa1940cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 -- 172.21.15.43:0/1975567042 >> 172.21.15.43:0/1975567042 conn(0x7fa19406aec0 msgr2=0x7fa19406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 -- 172.21.15.43:0/1975567042 shutdown_connections 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.724+0000 7fa19ab05700 1 -- 172.21.15.43:0/1975567042 wait complete. 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.725+0000 7fa19ab05700 1 Processor -- start 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.725+0000 7fa19ab05700 1 -- start start 2023-06-08T03:49:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa19ab05700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1941545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa19ab05700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1940b1dc0 0x7fa1940c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa19ab05700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa19ab05700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940c5970 con 0x7fa194159380 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa19ab05700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940c4d60 con 0x7fa1940b1dc0 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa19ab05700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940c5040 con 0x7fa194071d50 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa1990a2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa1990a2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59970/0 (socket says 172.21.15.43:59970) 2023-06-08T03:49:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa1990a2700 1 -- 172.21.15.43:0/920049161 learned_addr learned my addr 172.21.15.43:0/920049161 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa1988a1700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1941545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.726+0000 7fa1990a2700 1 -- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 msgr2=0x7fa1941545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa193fff700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1940b1dc0 0x7fa1940c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1990a2700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1941545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1990a2700 1 -- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1940b1dc0 msgr2=0x7fa1940c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1990a2700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1940b1dc0 0x7fa1940c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1990a2700 1 -- 172.21.15.43:0/920049161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009550 con 0x7fa194159380 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1990a2700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940c9240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00e500 tx=0x7fa18c00e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c013650 con 0x7fa194159380 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c0137d0 con 0x7fa194159380 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1940c5320 con 0x7fa194159380 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c013b80 con 0x7fa194159380 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.727+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa194154e30 con 0x7fa194159380 2023-06-08T03:49:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.728+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa194073fa0 con 0x7fa194159380 2023-06-08T03:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.728+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa18c013ce0 con 0x7fa194159380 2023-06-08T03:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.729+0000 7fa1917fa700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa17806ace0 0x7fa17806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.729+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa18c08c430 con 0x7fa194159380 2023-06-08T03:49:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.729+0000 7fa1988a1700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa17806ace0 0x7fa17806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.730+0000 7fa1988a1700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa17806ace0 0x7fa17806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa188014040 tx=0x7fa188008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.733+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa18c0571b0 con 0x7fa194159380 2023-06-08T03:49:47.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.932+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1940c63d0 con 0x7fa194159380 2023-06-08T03:49:47.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.933+0000 7fa1917fa700 1 -- 172.21.15.43:0/920049161 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa18c05a7d0 con 0x7fa194159380 2023-06-08T03:49:47.936 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:47.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa17806ace0 msgr2=0x7fa17806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa17806ace0 0x7fa17806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa188014040 tx=0x7fa188008030 comp rx=0 tx=0).stop 2023-06-08T03:49:47.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 msgr2=0x7fa1940c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:47.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940c9240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00e500 tx=0x7fa18c00e8c0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 shutdown_connections 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa17806ace0 0x7fa17806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa194159380 0x7fa1940c9240 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa194071d50 0x7fa1941545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 --2- 172.21.15.43:0/920049161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1940b1dc0 0x7fa1940c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 >> 172.21.15.43:0/920049161 conn(0x7fa19406aec0 msgr2=0x7fa1940b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 shutdown_connections 2023-06-08T03:49:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:47.935+0000 7fa19ab05700 1 -- 172.21.15.43:0/920049161 wait complete. 2023-06-08T03:49:47.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T03:49:48.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.074+0000 7fbb24b44700 1 Processor -- start 2023-06-08T03:49:48.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.074+0000 7fbb24b44700 1 -- start start 2023-06-08T03:49:48.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb24b44700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb20069db0 0x7fbb200c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb24b44700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbb2015a400 0x7fbb2006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb24b44700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200720f0 con 0x7fbb200ccc00 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb24b44700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200ca1e0 con 0x7fbb2015a400 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb24b44700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2006a6c0 con 0x7fbb20069db0 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbb2015a400 0x7fbb2006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbb2015a400 0x7fbb2006a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59974/0 (socket says 172.21.15.43:59974) 2023-06-08T03:49:48.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/1734859473 learned_addr learned my addr 172.21.15.43:0/1734859473 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1e59c700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb20069db0 0x7fbb200c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/1734859473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb20069db0 msgr2=0x7fbb200c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb20069db0 0x7fbb200c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/1734859473 >> v1:172.21.15.135:6789/0 conn(0x7fbb200ccc00 legacy=0x7fbb200b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/1734859473 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200cb960 con 0x7fbb2015a400 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1e59c700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb20069db0 0x7fbb200c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:48.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1dd9b700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb2015a400 0x7fbb2006a180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbb100098f0 tx=0x7fbb10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4469291f96a7e6f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1d59a700 1 -- 172.21.15.43:0/1734859473 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10004230 con 0x7fbb2015a400 2023-06-08T03:49:48.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.075+0000 7fbb1d59a700 1 -- 172.21.15.43:0/1734859473 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb10004390 con 0x7fbb2015a400 2023-06-08T03:49:48.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb1d59a700 1 -- 172.21.15.43:0/1734859473 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100036a0 con 0x7fbb2015a400 2023-06-08T03:49:48.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 -- 172.21.15.43:0/1734859473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb2015a400 msgr2=0x7fbb2006a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb2015a400 0x7fbb2006a180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbb100098f0 tx=0x7fbb10009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:48.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 -- 172.21.15.43:0/1734859473 shutdown_connections 2023-06-08T03:49:48.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb20069db0 0x7fbb200c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 --2- 172.21.15.43:0/1734859473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb2015a400 0x7fbb2006a180 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 -- 172.21.15.43:0/1734859473 >> 172.21.15.43:0/1734859473 conn(0x7fbb2006aec0 msgr2=0x7fbb2006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 -- 172.21.15.43:0/1734859473 shutdown_connections 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.076+0000 7fbb24b44700 1 -- 172.21.15.43:0/1734859473 wait complete. 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.077+0000 7fbb24b44700 1 Processor -- start 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 -- start start 2023-06-08T03:49:48.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb20069db0 0x7fbb200ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 0x7fbb200ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb2015a400 0x7fbb200c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200c4de0 con 0x7fbb200ccc00 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb201570d0 con 0x7fbb20069db0 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb24b44700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200c4160 con 0x7fbb2015a400 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb1dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 0x7fbb200ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb1dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 0x7fbb200ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59982/0 (socket says 172.21.15.43:59982) 2023-06-08T03:49:48.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.078+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/2427172065 learned_addr learned my addr 172.21.15.43:0/2427172065 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1e59c700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb20069db0 0x7fbb200ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1ed9d700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb2015a400 0x7fbb200c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb2015a400 msgr2=0x7fbb200c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1dd9b700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb2015a400 0x7fbb200c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb20069db0 msgr2=0x7fbb200ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1dd9b700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb20069db0 0x7fbb200ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1dd9b700 1 -- 172.21.15.43:0/2427172065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009550 con 0x7fbb200ccc00 2023-06-08T03:49:48.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1e59c700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb20069db0 0x7fbb200ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1ed9d700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb2015a400 0x7fbb200c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb1dd9b700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 0x7fbb200ce190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009130 tx=0x7fbb10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10003e30 con 0x7fbb200ccc00 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb200c4440 con 0x7fbb200ccc00 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb200c4a00 con 0x7fbb200ccc00 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1001f070 con 0x7fbb200ccc00 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.079+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000b860 con 0x7fbb200ccc00 2023-06-08T03:49:48.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.080+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb200c4f20 con 0x7fbb200ccc00 2023-06-08T03:49:48.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.080+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb10021030 con 0x7fbb200ccc00 2023-06-08T03:49:48.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.081+0000 7fbb0effd700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb0006ace0 0x7fbb0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.081+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb1008b000 con 0x7fbb200ccc00 2023-06-08T03:49:48.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.081+0000 7fbb1e59c700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb0006ace0 0x7fbb0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.082+0000 7fbb1e59c700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb0006ace0 0x7fbb0006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbb14008910 tx=0x7fbb14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.085+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb200c4f20 con 0x7fbb200ccc00 2023-06-08T03:49:48.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.281+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb200c4f20 con 0x7fbb200ccc00 2023-06-08T03:49:48.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.282+0000 7fbb0effd700 1 -- 172.21.15.43:0/2427172065 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb200c4f20 con 0x7fbb200ccc00 2023-06-08T03:49:48.285 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T03:49:48.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb0006ace0 msgr2=0x7fbb0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb0006ace0 0x7fbb0006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbb14008910 tx=0x7fbb14008040 comp rx=0 tx=0).stop 2023-06-08T03:49:48.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 msgr2=0x7fbb200ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 0x7fbb200ce190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009130 tx=0x7fbb10004750 comp rx=0 tx=0).stop 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 shutdown_connections 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fbb0006ace0 0x7fbb0006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb2015a400 0x7fbb200c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb20069db0 0x7fbb200ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 --2- 172.21.15.43:0/2427172065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb200ccc00 0x7fbb200ce190 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 >> 172.21.15.43:0/2427172065 conn(0x7fbb2006aec0 msgr2=0x7fbb200b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:48.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 shutdown_connections 2023-06-08T03:49:48.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.284+0000 7fbb24b44700 1 -- 172.21.15.43:0/2427172065 wait complete. 2023-06-08T03:49:48.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-08T03:49:48.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.423+0000 7f875a8db700 1 Processor -- start 2023-06-08T03:49:48.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.423+0000 7f875a8db700 1 -- start start 2023-06-08T03:49:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f875a8db700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87540b60a0 0x7f87540cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f875a8db700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87540cf5b0 0x7f875415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f875a8db700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f875415e170 0x7f87540ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f875a8db700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87540b6470 con 0x7f87540b60a0 2023-06-08T03:49:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f875a8db700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87540cda20 con 0x7f875415e170 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f875a8db700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875415a520 con 0x7f87540cf5b0 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87540b60a0 0x7f87540cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87540b60a0 0x7f87540cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59988/0 (socket says 172.21.15.43:59988) 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 -- 172.21.15.43:0/1509952028 learned_addr learned my addr 172.21.15.43:0/1509952028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8758e78700 1 --2- 172.21.15.43:0/1509952028 >> v2:172.21.15.135:3300/0 conn(0x7f875415e170 0x7f87540ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f87537fe700 1 --2- 172.21.15.43:0/1509952028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87540cf5b0 0x7f875415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 -- 172.21.15.43:0/1509952028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87540cf5b0 msgr2=0x7f875415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 --2- 172.21.15.43:0/1509952028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87540cf5b0 0x7f875415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 -- 172.21.15.43:0/1509952028 >> v2:172.21.15.135:3300/0 conn(0x7f875415e170 msgr2=0x7f87540ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 --2- 172.21.15.43:0/1509952028 >> v2:172.21.15.135:3300/0 conn(0x7f875415e170 0x7f87540ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.424+0000 7f8753fff700 1 -- 172.21.15.43:0/1509952028 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875415ea40 con 0x7f87540b60a0 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f8753fff700 1 --2- 172.21.15.43:0/1509952028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f87540cad90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f875406ad70 tx=0x7f8744009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9a32a6767f3e3d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f8752ffd700 1 -- 172.21.15.43:0/1509952028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874400b870 con 0x7f87540b60a0 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f8752ffd700 1 -- 172.21.15.43:0/1509952028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874400b9d0 con 0x7f87540b60a0 2023-06-08T03:49:48.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f8752ffd700 1 -- 172.21.15.43:0/1509952028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874400bd60 con 0x7f87540b60a0 2023-06-08T03:49:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 -- 172.21.15.43:0/1509952028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 msgr2=0x7f87540cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 --2- 172.21.15.43:0/1509952028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f87540cad90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f875406ad70 tx=0x7f8744009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 -- 172.21.15.43:0/1509952028 shutdown_connections 2023-06-08T03:49:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 --2- 172.21.15.43:0/1509952028 >> v2:172.21.15.135:3300/0 conn(0x7f875415e170 0x7f87540ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 --2- 172.21.15.43:0/1509952028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f87540cad90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 --2- 172.21.15.43:0/1509952028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87540cf5b0 0x7f875415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 -- 172.21.15.43:0/1509952028 >> 172.21.15.43:0/1509952028 conn(0x7f8754069db0 msgr2=0x7f875406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 -- 172.21.15.43:0/1509952028 shutdown_connections 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.425+0000 7f875a8db700 1 -- 172.21.15.43:0/1509952028 wait complete. 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.427+0000 7f875a8db700 1 Processor -- start 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.427+0000 7f875a8db700 1 -- start start 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f875414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87540cf5b0 0x7f87540b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f875415e170 0x7f87540b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875415c2d0 con 0x7f87540b60a0 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540c8660 con 0x7f87540cf5b0 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87541f3da0 con 0x7f875415e170 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f875414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f875414eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59992/0 (socket says 172.21.15.43:59992) 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 -- 172.21.15.43:0/3995132432 learned_addr learned my addr 172.21.15.43:0/3995132432 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8758e78700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f875415e170 0x7f87540b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f87537fe700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87540cf5b0 0x7f87540b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 -- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f875415e170 msgr2=0x7f87540b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f875415e170 0x7f87540b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 -- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87540cf5b0 msgr2=0x7f87540b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87540cf5b0 0x7f87540b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 -- 172.21.15.43:0/3995132432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744009550 con 0x7f87540b60a0 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8753fff700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f875414eac0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744004520 con 0x7f87540b60a0 2023-06-08T03:49:48.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874401e070 con 0x7f87540b60a0 2023-06-08T03:49:48.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87440038c0 con 0x7f87540b60a0 2023-06-08T03:49:48.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87541f4080 con 0x7f87540b60a0 2023-06-08T03:49:48.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.428+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875415bf60 con 0x7f87540b60a0 2023-06-08T03:49:48.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.429+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875415c120 con 0x7f87540b60a0 2023-06-08T03:49:48.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.430+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8744003a20 con 0x7f87540b60a0 2023-06-08T03:49:48.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.430+0000 7f8750ff9700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f873406ace0 0x7f873406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.430+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8744020070 con 0x7f87540b60a0 2023-06-08T03:49:48.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.430+0000 7f87537fe700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f873406ace0 0x7f873406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.431+0000 7f87537fe700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f873406ace0 0x7f873406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87540b22d0 tx=0x7f873c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.435+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8744055ad0 con 0x7f87540b60a0 2023-06-08T03:49:48.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.632+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8754073fa0 con 0x7f87540b60a0 2023-06-08T03:49:48.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.632+0000 7f8750ff9700 1 -- 172.21.15.43:0/3995132432 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f87440590f0 con 0x7f87540b60a0 2023-06-08T03:49:48.636 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T03:49:48.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f873406ace0 msgr2=0x7f873406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f873406ace0 0x7f873406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87540b22d0 tx=0x7f873c008040 comp rx=0 tx=0).stop 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 msgr2=0x7f875414eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f875414eac0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744004750 comp rx=0 tx=0).stop 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 shutdown_connections 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f873406ace0 0x7f873406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87540b60a0 0x7f875414eac0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f875415e170 0x7f87540b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 --2- 172.21.15.43:0/3995132432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87540cf5b0 0x7f87540b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 >> 172.21.15.43:0/3995132432 conn(0x7f8754069db0 msgr2=0x7f8754159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:48.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 shutdown_connections 2023-06-08T03:49:48.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.634+0000 7f875a8db700 1 -- 172.21.15.43:0/3995132432 wait complete. 2023-06-08T03:49:48.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:48.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.771+0000 7fda5c9a8700 1 Processor -- start 2023-06-08T03:49:48.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.771+0000 7fda5c9a8700 1 -- start start 2023-06-08T03:49:48.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5c9a8700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda58157c90 0x7fda5815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5c9a8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580cc730 0x7fda580ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5c9a8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fda5815b400 0x7fda580cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5c9a8700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5815ecc0 con 0x7fda58157c90 2023-06-08T03:49:48.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5c9a8700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda580ccc60 con 0x7fda5815b400 2023-06-08T03:49:48.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5c9a8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5815a920 con 0x7fda580cc730 2023-06-08T03:49:48.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda58157c90 0x7fda5815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda58157c90 0x7fda5815e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60000/0 (socket says 172.21.15.43:60000) 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 -- 172.21.15.43:0/3050727354 learned_addr learned my addr 172.21.15.43:0/3050727354 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda56d9d700 1 --2- 172.21.15.43:0/3050727354 >> v2:172.21.15.135:3300/0 conn(0x7fda5815b400 0x7fda580cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda55d9b700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580cc730 0x7fda580ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 -- 172.21.15.43:0/3050727354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580cc730 msgr2=0x7fda580ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580cc730 0x7fda580ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 -- 172.21.15.43:0/3050727354 >> v2:172.21.15.135:3300/0 conn(0x7fda5815b400 msgr2=0x7fda580cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 --2- 172.21.15.43:0/3050727354 >> v2:172.21.15.135:3300/0 conn(0x7fda5815b400 0x7fda580cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 -- 172.21.15.43:0/3050727354 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5815ac00 con 0x7fda58157c90 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda55d9b700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580cc730 0x7fda580ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5659c700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58157c90 0x7fda5815e780 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fda580721f0 tx=0x7fda48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8830752aa9f8f506 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.772+0000 7fda5559a700 1 -- 172.21.15.43:0/3050727354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48011830 con 0x7fda58157c90 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5559a700 1 -- 172.21.15.43:0/3050727354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda48011990 con 0x7fda58157c90 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5559a700 1 -- 172.21.15.43:0/3050727354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48011d20 con 0x7fda58157c90 2023-06-08T03:49:48.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 -- 172.21.15.43:0/3050727354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58157c90 msgr2=0x7fda5815e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58157c90 0x7fda5815e780 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fda580721f0 tx=0x7fda48009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 -- 172.21.15.43:0/3050727354 shutdown_connections 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/3050727354 >> v2:172.21.15.135:3300/0 conn(0x7fda5815b400 0x7fda580cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda58157c90 0x7fda5815e780 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/3050727354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda580cc730 0x7fda580ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 -- 172.21.15.43:0/3050727354 >> 172.21.15.43:0/3050727354 conn(0x7fda5806fd90 msgr2=0x7fda58070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:48.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 -- 172.21.15.43:0/3050727354 shutdown_connections 2023-06-08T03:49:48.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.773+0000 7fda5c9a8700 1 -- 172.21.15.43:0/3050727354 wait complete. 2023-06-08T03:49:48.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 Processor -- start 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 -- start start 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 0x7fda58152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58157c90 0x7fda580af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda5815b400 0x7fda580c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5815dd20 con 0x7fda580cc730 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5815d7f0 con 0x7fda58157c90 2023-06-08T03:49:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5c9a8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580c6940 con 0x7fda5815b400 2023-06-08T03:49:48.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.775+0000 7fda5659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 0x7fda58152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 0x7fda58152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60006/0 (socket says 172.21.15.43:60006) 2023-06-08T03:49:48.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 -- 172.21.15.43:0/1963425746 learned_addr learned my addr 172.21.15.43:0/1963425746 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:48.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda56d9d700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda5815b400 0x7fda580c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda55d9b700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58157c90 0x7fda580af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 -- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda5815b400 msgr2=0x7fda580c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda5815b400 0x7fda580c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 -- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58157c90 msgr2=0x7fda580af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58157c90 0x7fda580af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 -- 172.21.15.43:0/1963425746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009550 con 0x7fda580cc730 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5659c700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 0x7fda58152600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fda48014040 tx=0x7fda48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48004450 con 0x7fda580cc730 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4801e070 con 0x7fda580cc730 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5815da40 con 0x7fda580cc730 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda480038e0 con 0x7fda580cc730 2023-06-08T03:49:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.776+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda580c65d0 con 0x7fda580cc730 2023-06-08T03:49:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.777+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda58073fa0 con 0x7fda580cc730 2023-06-08T03:49:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.778+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda48003a40 con 0x7fda580cc730 2023-06-08T03:49:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.778+0000 7fda46ffd700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3806ace0 0x7fda3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.778+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda4808a530 con 0x7fda580cc730 2023-06-08T03:49:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.778+0000 7fda55d9b700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3806ace0 0x7fda3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.779+0000 7fda55d9b700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3806ace0 0x7fda3806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda58159d60 tx=0x7fda4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:48.783+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda48055340 con 0x7fda580cc730 2023-06-08T03:49:49.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.021+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda580cad60 con 0x7fda580cc730 2023-06-08T03:49:49.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.022+0000 7fda46ffd700 1 -- 172.21.15.43:0/1963425746 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fda48058960 con 0x7fda580cc730 2023-06-08T03:49:49.025 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:49.025 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3806ace0 msgr2=0x7fda3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3806ace0 0x7fda3806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda58159d60 tx=0x7fda4c008040 comp rx=0 tx=0).stop 2023-06-08T03:49:49.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 msgr2=0x7fda58152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 0x7fda58152600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fda48014040 tx=0x7fda48004750 comp rx=0 tx=0).stop 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 shutdown_connections 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fda3806ace0 0x7fda3806d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda580cc730 0x7fda58152600 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda5815b400 0x7fda580c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 --2- 172.21.15.43:0/1963425746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda58157c90 0x7fda580af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 >> 172.21.15.43:0/1963425746 conn(0x7fda5806fd90 msgr2=0x7fda5815bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:49.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 shutdown_connections 2023-06-08T03:49:49.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.024+0000 7fda5c9a8700 1 -- 172.21.15.43:0/1963425746 wait complete. 2023-06-08T03:49:49.029 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:49.039 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:49.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.160+0000 7f93a364e700 1 Processor -- start 2023-06-08T03:49:49.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.161+0000 7f93a364e700 1 -- start start 2023-06-08T03:49:49.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.161+0000 7f93a364e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f939c0cd680 0x7f939c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.161+0000 7f93a364e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c160110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.161+0000 7f93a364e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c160650 con 0x7f939c15c0b0 2023-06-08T03:49:49.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.161+0000 7f93a364e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0b2f60 con 0x7f939c0cd680 2023-06-08T03:49:49.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.161+0000 7f93a364e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0cdc60 con 0x7f939c15fcb0 2023-06-08T03:49:49.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a13ea700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f939c15c0b0 0x7f939c0cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54918/0 (socket says 172.21.15.43:54918) 2023-06-08T03:49:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a13ea700 1 -- 172.21.15.43:0/3444886591 learned_addr learned my addr 172.21.15.43:0/3444886591 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a1beb700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a0be9700 1 --2- 172.21.15.43:0/3444886591 >> v2:172.21.15.135:3300/0 conn(0x7f939c0cd680 0x7f939c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f9393fff700 1 -- 172.21.15.43:0/3444886591 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540886843 0 0) 0x7f939c160650 con 0x7f939c15c0b0 2023-06-08T03:49:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f9393fff700 1 -- 172.21.15.43:0/3444886591 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93880035b0 con 0x7f939c15c0b0 2023-06-08T03:49:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a0be9700 1 -- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 msgr2=0x7f939c160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a0be9700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a0be9700 1 -- 172.21.15.43:0/3444886591 >> v1:172.21.15.43:6789/0 conn(0x7f939c15c0b0 legacy=0x7f939c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a0be9700 1 -- 172.21.15.43:0/3444886591 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0cb4a0 con 0x7f939c0cd680 2023-06-08T03:49:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a1beb700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.162+0000 7f93a0be9700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c0cd680 0x7f939c0b2a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9398009840 tx=0x7f9398009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe87109eb0ca386 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f9393fff700 1 -- 172.21.15.43:0/3444886591 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398011830 con 0x7f939c0cd680 2023-06-08T03:49:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f9393fff700 1 -- 172.21.15.43:0/3444886591 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398011990 con 0x7f939c0cd680 2023-06-08T03:49:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f9393fff700 1 -- 172.21.15.43:0/3444886591 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398011d20 con 0x7f939c0cd680 2023-06-08T03:49:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 -- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c0cd680 msgr2=0x7f939c0b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c0cd680 0x7f939c0b2a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9398009840 tx=0x7f9398009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 -- 172.21.15.43:0/3444886591 shutdown_connections 2023-06-08T03:49:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 --2- 172.21.15.43:0/3444886591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c0cd680 0x7f939c0b2a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 -- 172.21.15.43:0/3444886591 >> 172.21.15.43:0/3444886591 conn(0x7f939c069db0 msgr2=0x7f939c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 -- 172.21.15.43:0/3444886591 shutdown_connections 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.163+0000 7f93a364e700 1 -- 172.21.15.43:0/3444886591 wait complete. 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.164+0000 7f93a364e700 1 Processor -- start 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 -- start start 2023-06-08T03:49:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 0x7f939c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c15c0b0 0x7f939c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c155580 con 0x7f939c0cd680 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0c8f20 con 0x7f939c15c0b0 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a364e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0c9200 con 0x7f939c15fcb0 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a13ea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 0x7f939c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a13ea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 0x7f939c0b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60020/0 (socket says 172.21.15.43:60020) 2023-06-08T03:49:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.165+0000 7f93a13ea700 1 -- 172.21.15.43:0/2590393803 learned_addr learned my addr 172.21.15.43:0/2590393803 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a0be9700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c15c0b0 0x7f939c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a1beb700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a13ea700 1 -- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 msgr2=0x7f939c0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a13ea700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c0c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a13ea700 1 -- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c15c0b0 msgr2=0x7f939c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a13ea700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c15c0b0 0x7f939c155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a13ea700 1 -- 172.21.15.43:0/2590393803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394009a70 con 0x7f939c0cd680 2023-06-08T03:49:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a13ea700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 0x7f939c0b4990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c700 tx=0x7f938c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c005d70 con 0x7f939c0cd680 2023-06-08T03:49:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c0070d0 con 0x7f939c0cd680 2023-06-08T03:49:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93980094a0 con 0x7f939c0cd680 2023-06-08T03:49:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c007460 con 0x7f939c0cd680 2023-06-08T03:49:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.166+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c0c97c0 con 0x7f939c0cd680 2023-06-08T03:49:49.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.167+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c073fa0 con 0x7f939c0cd680 2023-06-08T03:49:49.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.168+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f938c0075c0 con 0x7f939c0cd680 2023-06-08T03:49:49.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.168+0000 7f9391ffb700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.168+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f938c088c80 con 0x7f939c0cd680 2023-06-08T03:49:49.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.168+0000 7f93a0be9700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.169+0000 7f93a0be9700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9398000c00 tx=0x7f9398008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.172+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f938c053a00 con 0x7f939c0cd680 2023-06-08T03:49:49.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.371+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f939c0b2720 con 0x7f939c0cd680 2023-06-08T03:49:49.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.372+0000 7f9391ffb700 1 -- 172.21.15.43:0/2590393803 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f938c057020 con 0x7f939c0cd680 2023-06-08T03:49:49.376 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:49.376 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:49.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 msgr2=0x7f938006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9398000c00 tx=0x7f9398008030 comp rx=0 tx=0).stop 2023-06-08T03:49:49.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 msgr2=0x7f939c0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 0x7f939c0b4990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c700 tx=0x7f938c00ca10 comp rx=0 tx=0).stop 2023-06-08T03:49:49.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 shutdown_connections 2023-06-08T03:49:49.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f938006ace0 0x7f938006d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939c0cd680 0x7f939c0b4990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f939c15fcb0 0x7f939c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 --2- 172.21.15.43:0/2590393803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f939c15c0b0 0x7f939c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 >> 172.21.15.43:0/2590393803 conn(0x7f939c069db0 msgr2=0x7f939c15cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:49.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 shutdown_connections 2023-06-08T03:49:49.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.374+0000 7f93a364e700 1 -- 172.21.15.43:0/2590393803 wait complete. 2023-06-08T03:49:49.390 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-08T03:49:49.390 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:49.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.511+0000 7f774798e700 1 Processor -- start 2023-06-08T03:49:49.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.512+0000 7f774798e700 1 -- start start 2023-06-08T03:49:49.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.512+0000 7f774798e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77400af220 0x7f77400ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.512+0000 7f774798e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400af050 con 0x7f774006a4c0 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.512+0000 7f774798e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400af800 con 0x7f774015c590 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.512+0000 7f774798e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77400afae0 con 0x7f77400af220 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7744f29700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f774006a4c0 0x7f77400ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54934/0 (socket says 172.21.15.43:54934) 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7744f29700 1 -- 172.21.15.43:0/829312151 learned_addr learned my addr 172.21.15.43:0/829312151 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7745f2b700 1 --2- 172.21.15.43:0/829312151 >> v2:172.21.15.135:3300/0 conn(0x7f77400af220 0x7f77400ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7737fff700 1 -- 172.21.15.43:0/829312151 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670282818 0 0) 0x7f77400af050 con 0x7f774006a4c0 2023-06-08T03:49:49.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7737fff700 1 -- 172.21.15.43:0/829312151 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f772c0035b0 con 0x7f774006a4c0 2023-06-08T03:49:49.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7745f2b700 1 -- 172.21.15.43:0/829312151 >> v1:172.21.15.135:6789/0 conn(0x7f774015c590 legacy=0x7f7740069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7737fff700 1 -- 172.21.15.43:0/829312151 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917238292 0 0) 0x7f77400af800 con 0x7f774015c590 2023-06-08T03:49:49.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7745f2b700 1 -- 172.21.15.43:0/829312151 >> v1:172.21.15.43:6789/0 conn(0x7f774006a4c0 legacy=0x7f77400ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7745f2b700 1 -- 172.21.15.43:0/829312151 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400cc0c0 con 0x7f77400af220 2023-06-08T03:49:49.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7745f2b700 1 --2- 172.21.15.43:0/829312151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400ccba0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7738009d90 tx=0x7f773800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f32c49e7f4a2e0a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7737fff700 1 -- 172.21.15.43:0/829312151 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800e070 con 0x7f77400af220 2023-06-08T03:49:49.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7737fff700 1 -- 172.21.15.43:0/829312151 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738003a20 con 0x7f77400af220 2023-06-08T03:49:49.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.513+0000 7f7737fff700 1 -- 172.21.15.43:0/829312151 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738003db0 con 0x7f77400af220 2023-06-08T03:49:49.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 -- 172.21.15.43:0/829312151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 msgr2=0x7f77400ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 --2- 172.21.15.43:0/829312151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400ccba0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7738009d90 tx=0x7f773800b330 comp rx=0 tx=0).stop 2023-06-08T03:49:49.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 -- 172.21.15.43:0/829312151 shutdown_connections 2023-06-08T03:49:49.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 --2- 172.21.15.43:0/829312151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400ccba0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 -- 172.21.15.43:0/829312151 >> 172.21.15.43:0/829312151 conn(0x7f774006b7e0 msgr2=0x7f77400cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:49.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 -- 172.21.15.43:0/829312151 shutdown_connections 2023-06-08T03:49:49.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.514+0000 7f774798e700 1 -- 172.21.15.43:0/829312151 wait complete. 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.515+0000 7f774798e700 1 Processor -- start 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.515+0000 7f774798e700 1 -- start start 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774798e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f774006a4c0 0x7f77400c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774798e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774798e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 0x7f77400c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774798e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400af620 con 0x7f774015c590 2023-06-08T03:49:49.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774798e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400c57a0 con 0x7f77400af220 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774798e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400c4700 con 0x7f774006a4c0 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 0x7f77400c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 0x7f77400c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60038/0 (socket says 172.21.15.43:60038) 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 -- 172.21.15.43:0/501956821 learned_addr learned my addr 172.21.15.43:0/501956821 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774572a700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f774006a4c0 0x7f77400c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7744f29700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 -- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f774006a4c0 msgr2=0x7f77400c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f774006a4c0 0x7f77400c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 -- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 msgr2=0x7f77400c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7745f2b700 1 -- 172.21.15.43:0/501956821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738009a70 con 0x7f774015c590 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f774572a700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f774006a4c0 0x7f77400c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.516+0000 7f7744f29700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.517+0000 7f7745f2b700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 0x7f77400c3dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f77400cd220 tx=0x7f7738004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.517+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380048d0 con 0x7f774015c590 2023-06-08T03:49:49.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.517+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738009410 con 0x7f774015c590 2023-06-08T03:49:49.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.517+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77400c49e0 con 0x7f774015c590 2023-06-08T03:49:49.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.517+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773801d6b0 con 0x7f774015c590 2023-06-08T03:49:49.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.517+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77400c4fa0 con 0x7f774015c590 2023-06-08T03:49:49.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.518+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7740073fa0 con 0x7f774015c590 2023-06-08T03:49:49.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.518+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f773801d810 con 0x7f774015c590 2023-06-08T03:49:49.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.519+0000 7f7735ffb700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772406ace0 0x7f772406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.519+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f773808b840 con 0x7f774015c590 2023-06-08T03:49:49.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.519+0000 7f774572a700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772406ace0 0x7f772406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.520+0000 7f774572a700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772406ace0 0x7f772406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f773c007fd0 tx=0x7f773c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.524+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7738056650 con 0x7f774015c590 2023-06-08T03:49:49.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.764+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7740071dc0 con 0x7f774015c590 2023-06-08T03:49:49.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.765+0000 7f7735ffb700 1 -- 172.21.15.43:0/501956821 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f7738059c70 con 0x7f774015c590 2023-06-08T03:49:49.769 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:49.769 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:49.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772406ace0 msgr2=0x7f772406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772406ace0 0x7f772406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f773c007fd0 tx=0x7f773c009040 comp rx=0 tx=0).stop 2023-06-08T03:49:49.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 msgr2=0x7f77400c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 0x7f77400c3dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f77400cd220 tx=0x7f7738004ad0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 shutdown_connections 2023-06-08T03:49:49.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f772406ace0 0x7f772406d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f774015c590 0x7f77400c3dd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f774006a4c0 0x7f77400c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 --2- 172.21.15.43:0/501956821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77400af220 0x7f77400c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 >> 172.21.15.43:0/501956821 conn(0x7f774006b7e0 msgr2=0x7f774015bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:49.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 shutdown_connections 2023-06-08T03:49:49.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.767+0000 7f774798e700 1 -- 172.21.15.43:0/501956821 wait complete. 2023-06-08T03:49:49.773 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:49.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:49:49.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.904+0000 7f102a005700 1 Processor -- start 2023-06-08T03:49:49.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f102a005700 1 -- start start 2023-06-08T03:49:49.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f102a005700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f102406a4c0 0x7f10240af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f102a005700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 0x7f10240b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f102a005700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240af050 con 0x7f102415c590 2023-06-08T03:49:49.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f102a005700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240afae0 con 0x7f102406a4c0 2023-06-08T03:49:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f102a005700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240ccfe0 con 0x7f10240ccba0 2023-06-08T03:49:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f10237fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f102415c590 0x7f1024069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54946/0 (socket says 172.21.15.43:54946) 2023-06-08T03:49:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.905+0000 7f10237fe700 1 -- 172.21.15.43:0/1190839825 learned_addr learned my addr 172.21.15.43:0/1190839825 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f1022ffd700 1 --2- 172.21.15.43:0/1190839825 >> v2:172.21.15.135:3300/0 conn(0x7f102406a4c0 0x7f10240af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f1023fff700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 0x7f10240b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813900230 0 0) 0x7f10240af050 con 0x7f102415c590 2023-06-08T03:49:49.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f100c0035b0 con 0x7f102415c590 2023-06-08T03:49:49.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348604282 0 0) 0x7f100c0035b0 con 0x7f102415c590 2023-06-08T03:49:49.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 msgr2=0x7f10240b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:49.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 0x7f10240b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 >> v2:172.21.15.135:3300/0 conn(0x7f102406a4c0 msgr2=0x7f10240af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 --2- 172.21.15.43:0/1190839825 >> v2:172.21.15.135:3300/0 conn(0x7f102406a4c0 0x7f10240af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240af800 con 0x7f102415c590 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f10140017f0 con 0x7f102415c590 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 >> v1:172.21.15.43:6789/0 conn(0x7f102415c590 legacy=0x7f1024069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 0x7f100c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c003f80 0x7f100c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c004d90 0x7f100c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240afae0 con 0x7f100c004d90 2023-06-08T03:49:49.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c00ba10 con 0x7f100c003f80 2023-06-08T03:49:49.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c00bb50 con 0x7f10240ccba0 2023-06-08T03:49:49.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f1023fff700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c004d90 0x7f100c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f10237fe700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 0x7f100c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.906+0000 7f1022ffd700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c003f80 0x7f100c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 -- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 msgr2=0x7f100c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240ccba0 0x7f100c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 -- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c003f80 msgr2=0x7f100c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c003f80 0x7f100c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 -- 172.21.15.43:0/1190839825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c0035b0 con 0x7f100c004d90 2023-06-08T03:49:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1022ffd700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c003f80 0x7f100c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c004d90 0x7f100c005200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f101c009fc0 tx=0x7f100c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac04dff7b80721ae server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00ec30 con 0x7f100c004d90 2023-06-08T03:49:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c00f040 con 0x7f100c004d90 2023-06-08T03:49:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f10227fc700 1 -- 172.21.15.43:0/1190839825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c014480 con 0x7f100c004d90 2023-06-08T03:49:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f102a005700 1 -- 172.21.15.43:0/1190839825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c004d90 msgr2=0x7f100c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f102a005700 1 --2- 172.21.15.43:0/1190839825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c004d90 0x7f100c005200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f101c009fc0 tx=0x7f100c005880 comp rx=0 tx=0).stop 2023-06-08T03:49:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f1023fff700 1 -- 172.21.15.43:0/1190839825 reap_dead start 2023-06-08T03:49:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f102a005700 1 -- 172.21.15.43:0/1190839825 shutdown_connections 2023-06-08T03:49:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f102a005700 1 -- 172.21.15.43:0/1190839825 >> 172.21.15.43:0/1190839825 conn(0x7f102406b7e0 msgr2=0x7f10240cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f102a005700 1 -- 172.21.15.43:0/1190839825 shutdown_connections 2023-06-08T03:49:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.907+0000 7f102a005700 1 -- 172.21.15.43:0/1190839825 wait complete. 2023-06-08T03:49:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.909+0000 7f102a005700 1 Processor -- start 2023-06-08T03:49:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.909+0000 7f102a005700 1 -- start start 2023-06-08T03:49:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1024154c00 0x7f10241f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240b4a70 0x7f10240c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 0x7f10240c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241f62e0 con 0x7f10240c5240 2023-06-08T03:49:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240c56c0 con 0x7f1024154c00 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10241f1ce0 con 0x7f10240b4a70 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 0x7f10240c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 0x7f10240c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60058/0 (socket says 172.21.15.43:60058) 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 -- 172.21.15.43:0/1828268984 learned_addr learned my addr 172.21.15.43:0/1828268984 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1022ffd700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240b4a70 0x7f10240c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f10237fe700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1024154c00 0x7f10241f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 -- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240b4a70 msgr2=0x7f10240c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240b4a70 0x7f10240c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 -- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1024154c00 msgr2=0x7f10241f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1024154c00 0x7f10241f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 -- 172.21.15.43:0/1828268984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10241f1f50 con 0x7f10240c5240 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f10237fe700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1024154c00 0x7f10241f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f1023fff700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 0x7f10240c31d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f101c009f60 tx=0x7f101c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c007000 con 0x7f10240c5240 2023-06-08T03:49:49.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c003e30 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c015a70 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10241f2230 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.910+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10241f27f0 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.911+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1024073fa0 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.912+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f101c024070 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.912+0000 7f100bfff700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f101006ace0 0x7f101006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.912+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f101c08ad80 con 0x7f10240c5240 2023-06-08T03:49:49.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.913+0000 7f10237fe700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f101006ace0 0x7f101006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:49.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.913+0000 7f10237fe700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f101006ace0 0x7f101006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1014000fd0 tx=0x7f1014009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:49.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:49.917+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f101c055cb0 con 0x7f10240c5240 2023-06-08T03:49:50.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.157+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1024071dc0 con 0x7f10240c5240 2023-06-08T03:49:50.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.158+0000 7f100bfff700 1 -- 172.21.15.43:0/1828268984 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f101c018090 con 0x7f10240c5240 2023-06-08T03:49:50.162 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:50.162 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2967991577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2967991577},{"type":"v1","addr":"172.21.15.135:6836","nonce":2967991577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/1222815031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1222815031},{"type":"v1","addr":"172.21.15.43:6833","nonce":1222815031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/965582891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":965582891},{"type":"v1","addr":"172.21.15.43:6835","nonce":965582891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:48:46.681077+0000","modified":"2023-06-08T03:49:03.764330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6837/2399698877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2399698877},{"type":"v1","addr":"172.21.15.135:6837","nonce":2399698877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T03:49:50.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f101006ace0 msgr2=0x7f101006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f101006ace0 0x7f101006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1014000fd0 tx=0x7f1014009040 comp rx=0 tx=0).stop 2023-06-08T03:49:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 msgr2=0x7f10240c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 0x7f10240c31d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f101c009f60 tx=0x7f101c009750 comp rx=0 tx=0).stop 2023-06-08T03:49:50.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 shutdown_connections 2023-06-08T03:49:50.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f101006ace0 0x7f101006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10240c5240 0x7f10240c31d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1024154c00 0x7f10241f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 --2- 172.21.15.43:0/1828268984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10240b4a70 0x7f10240c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 >> 172.21.15.43:0/1828268984 conn(0x7f102406b7e0 msgr2=0x7f10240ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:50.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 shutdown_connections 2023-06-08T03:49:50.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.160+0000 7f102a005700 1 -- 172.21.15.43:0/1828268984 wait complete. 2023-06-08T03:49:50.169 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2023-06-08T03:49:50.176 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:49:50.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.299+0000 7f8cbb0b0700 1 Processor -- start 2023-06-08T03:49:50.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.299+0000 7f8cbb0b0700 1 -- start start 2023-06-08T03:49:50.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cbb0b0700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb40af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cbb0b0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cb40ccba0 0x7f8cb40b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cbb0b0700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40af050 con 0x7f8cb4069db0 2023-06-08T03:49:50.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cbb0b0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40afae0 con 0x7f8cb40ccba0 2023-06-08T03:49:50.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cbb0b0700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40ccff0 con 0x7f8cb415c590 2023-06-08T03:49:50.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cb3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cb40ccba0 0x7f8cb40b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cb8e4c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb40af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cb3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cb40ccba0 0x7f8cb40b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:41678/0 (socket says 172.21.15.43:41678) 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.300+0000 7f8cb3fff700 1 -- 172.21.15.43:0/2605647162 learned_addr learned my addr 172.21.15.43:0/2605647162 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/2605647162 >> v2:172.21.15.135:3300/0 conn(0x7f8cb40ccba0 msgr2=0x7f8cb40b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb8e4c700 1 --2- 172.21.15.43:0/2605647162 >> v2:172.21.15.135:3300/0 conn(0x7f8cb40ccba0 0x7f8cb40b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/2605647162 >> v1:172.21.15.135:6789/0 conn(0x7f8cb4069db0 legacy=0x7f8cb415fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/2605647162 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40af800 con 0x7f8cb415c590 2023-06-08T03:49:50.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb8e4c700 1 --2- 172.21.15.43:0/2605647162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb40af220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009820 tx=0x7f8ca8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768514b65c132212 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb37fe700 1 -- 172.21.15.43:0/2605647162 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8005e30 con 0x7f8cb415c590 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb37fe700 1 -- 172.21.15.43:0/2605647162 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8006030 con 0x7f8cb415c590 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.301+0000 7f8cb37fe700 1 -- 172.21.15.43:0/2605647162 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80063c0 con 0x7f8cb415c590 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/2605647162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 msgr2=0x7f8cb40af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/2605647162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb40af220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009820 tx=0x7f8ca8009b30 comp rx=0 tx=0).stop 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/2605647162 shutdown_connections 2023-06-08T03:49:50.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/2605647162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb40af220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/2605647162 >> v2:172.21.15.135:3300/0 conn(0x7f8cb40ccba0 0x7f8cb40b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/2605647162 >> 172.21.15.43:0/2605647162 conn(0x7f8cb406b7e0 msgr2=0x7f8cb40cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:50.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/2605647162 shutdown_connections 2023-06-08T03:49:50.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.302+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/2605647162 wait complete. 2023-06-08T03:49:50.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.303+0000 7f8cbb0b0700 1 Processor -- start 2023-06-08T03:49:50.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.303+0000 7f8cbb0b0700 1 -- start start 2023-06-08T03:49:50.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cbb0b0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 0x7f8cb40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cbb0b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb40ccba0 0x7f8cb414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cbb0b0700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cbb0b0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414afa0 con 0x7f8cb4069db0 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cbb0b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414e220 con 0x7f8cb40ccba0 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cbb0b0700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c7e80 con 0x7f8cb415c590 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 0x7f8cb40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 0x7f8cb40c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60068/0 (socket says 172.21.15.43:60068) 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/3942676925 learned_addr learned my addr 172.21.15.43:0/3942676925 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:50.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb3fff700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb40ccba0 0x7f8cb414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb964d700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 msgr2=0x7f8cb414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb40ccba0 msgr2=0x7f8cb414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb40ccba0 0x7f8cb414aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 -- 172.21.15.43:0/3942676925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8009430 con 0x7f8cb4069db0 2023-06-08T03:49:50.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.304+0000 7f8cb8e4c700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 0x7f8cb40c77c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c00 tx=0x7f8ca8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:50.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.305+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80063a0 con 0x7f8cb4069db0 2023-06-08T03:49:50.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.305+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8020070 con 0x7f8cb4069db0 2023-06-08T03:49:50.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.305+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8006720 con 0x7f8cb4069db0 2023-06-08T03:49:50.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.305+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb40c8160 con 0x7f8cb4069db0 2023-06-08T03:49:50.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.305+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb40c8720 con 0x7f8cb4069db0 2023-06-08T03:49:50.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.306+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb4073fa0 con 0x7f8cb4069db0 2023-06-08T03:49:50.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.306+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ca8022030 con 0x7f8cb4069db0 2023-06-08T03:49:50.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.306+0000 7f8cb17fa700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8c9806ace0 0x7f8c9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.307+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8ca808aff0 con 0x7f8cb4069db0 2023-06-08T03:49:50.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.307+0000 7f8cb3fff700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8c9806ace0 0x7f8c9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.307+0000 7f8cb3fff700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8c9806ace0 0x7f8c9806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40cbd50 tx=0x7f8ca0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:50.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.311+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8ca8055f20 con 0x7f8cb4069db0 2023-06-08T03:49:50.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.506+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb4071dc0 con 0x7f8cb4069db0 2023-06-08T03:49:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.508+0000 7f8cb17fa700 1 -- 172.21.15.43:0/3942676925 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f8ca8059540 con 0x7f8cb4069db0 2023-06-08T03:49:50.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:50.512 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:34.765491+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:48:44.487563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T03:48:45.654058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-08T03:48:48.745687+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:49:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.509+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8c9806ace0 msgr2=0x7f8c9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.509+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8c9806ace0 0x7f8c9806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40cbd50 tx=0x7f8ca0008040 comp rx=0 tx=0).stop 2023-06-08T03:49:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.509+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 msgr2=0x7f8cb40c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.509+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 0x7f8cb40c77c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c00 tx=0x7f8ca8004750 comp rx=0 tx=0).stop 2023-06-08T03:49:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 shutdown_connections 2023-06-08T03:49:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f8c9806ace0 0x7f8c9806d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4069db0 0x7f8cb40c77c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cb415c590 0x7f8cb414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 --2- 172.21.15.43:0/3942676925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb40ccba0 0x7f8cb414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 >> 172.21.15.43:0/3942676925 conn(0x7f8cb406b7e0 msgr2=0x7f8cb415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:50.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 shutdown_connections 2023-06-08T03:49:50.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.510+0000 7f8cbb0b0700 1 -- 172.21.15.43:0/3942676925 wait complete. 2023-06-08T03:49:50.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-08T03:49:50.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.647+0000 7f14675af700 1 Processor -- start 2023-06-08T03:49:50.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.647+0000 7f14675af700 1 -- start start 2023-06-08T03:49:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f14675af700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 0x7f14600b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f14675af700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1460071850 con 0x7f1460069db0 2023-06-08T03:49:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f14675af700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14600cec30 con 0x7f1460072090 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f14675af700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14600b20f0 con 0x7f146015c420 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f1465b4c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1460069db0 0x7f1460160090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54984/0 (socket says 172.21.15.43:54984) 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f1465b4c700 1 -- 172.21.15.43:0/2592541476 learned_addr learned my addr 172.21.15.43:0/2592541476 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061470809 0 0) 0x7f1460071850 con 0x7f1460069db0 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f146534b700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 0x7f14600b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.648+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f144c0035b0 con 0x7f1460069db0 2023-06-08T03:49:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729622850 0 0) 0x7f144c0035b0 con 0x7f1460069db0 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 msgr2=0x7f14600b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 0x7f14600b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 >> v1:172.21.15.135:6789/0 conn(0x7f1460072090 legacy=0x7f14600cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600ceed0 con 0x7f1460069db0 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f14580019f0 con 0x7f1460069db0 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 >> v1:172.21.15.43:6789/0 conn(0x7f1460069db0 legacy=0x7f1460160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c003a30 0x7f144c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 0x7f144c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f144c004d90 0x7f144c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600b20f0 con 0x7f144c003a30 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c00bac0 con 0x7f144c004d90 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c00bc50 con 0x7f146015c420 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c003a30 0x7f144c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1464b4a700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 0x7f144c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1465b4c700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f144c004d90 0x7f144c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 -- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 msgr2=0x7f144c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f146015c420 0x7f144c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 -- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f144c004d90 msgr2=0x7f144c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f144c004d90 0x7f144c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 -- 172.21.15.43:0/2592541476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c0035b0 con 0x7f144c003a30 2023-06-08T03:49:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1465b4c700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f144c004d90 0x7f144c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f146534b700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c003a30 0x7f144c003e40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1450009b60 tx=0x7f144c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ebd989ee814bca server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000e6c0 con 0x7f144c003a30 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145000e820 con 0x7f144c003a30 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.649+0000 7f1457fff700 1 -- 172.21.15.43:0/2592541476 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000eb90 con 0x7f144c003a30 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f14675af700 1 -- 172.21.15.43:0/2592541476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c003a30 msgr2=0x7f144c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f14675af700 1 --2- 172.21.15.43:0/2592541476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c003a30 0x7f144c003e40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1450009b60 tx=0x7f144c005880 comp rx=0 tx=0).stop 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f1465b4c700 1 -- 172.21.15.43:0/2592541476 reap_dead start 2023-06-08T03:49:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f14675af700 1 -- 172.21.15.43:0/2592541476 shutdown_connections 2023-06-08T03:49:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f14675af700 1 -- 172.21.15.43:0/2592541476 >> 172.21.15.43:0/2592541476 conn(0x7f146006aec0 msgr2=0x7f146006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f14675af700 1 -- 172.21.15.43:0/2592541476 shutdown_connections 2023-06-08T03:49:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.650+0000 7f14675af700 1 -- 172.21.15.43:0/2592541476 wait complete. 2023-06-08T03:49:50.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.651+0000 7f14675af700 1 Processor -- start 2023-06-08T03:49:50.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.651+0000 7f14675af700 1 -- start start 2023-06-08T03:49:50.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f14675af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 0x7f14600c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f14675af700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14601ef750 0x7f14601f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f14675af700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14601f6100 0x7f14601f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f14675af700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600c3cc0 con 0x7f14601ef380 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f14675af700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600c3fa0 con 0x7f14601f6100 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f14675af700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14600c4280 con 0x7f14601ef750 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 0x7f14600c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 0x7f14600c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60088/0 (socket says 172.21.15.43:60088) 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 -- 172.21.15.43:0/1188346827 learned_addr learned my addr 172.21.15.43:0/1188346827 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 -- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14601ef750 msgr2=0x7f14601f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14601ef750 0x7f14601f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 -- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14601f6100 msgr2=0x7f14601f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14601f6100 0x7f14601f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.652+0000 7f146534b700 1 -- 172.21.15.43:0/1188346827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600c4560 con 0x7f14601ef380 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.653+0000 7f146534b700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 0x7f14600c33b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f144c0047a0 tx=0x7f14500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.653+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000e6c0 con 0x7f14601ef380 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.653+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14500038e0 con 0x7f14601ef380 2023-06-08T03:49:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.653+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14600c4840 con 0x7f14601ef380 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.653+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450003c90 con 0x7f14601ef380 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.653+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14601f1f70 con 0x7f14601ef380 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.654+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1460073fa0 con 0x7f14601ef380 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.654+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1450013470 con 0x7f14601ef380 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.655+0000 7f1455ffb700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f144406ad10 0x7f144406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.655+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f145008b000 con 0x7f14601ef380 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.655+0000 7f1464b4a700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f144406ad10 0x7f144406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:50.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.655+0000 7f1464b4a700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f144406ad10 0x7f144406d1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f145c000c00 tx=0x7f145c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:50.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.659+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1450055e10 con 0x7f14601ef380 2023-06-08T03:49:50.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:50.908+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14600b55d0 con 0x7f14601ef380 2023-06-08T03:49:51.827 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-06-08T03:49:51.823+0000 7f2ca7cd6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-08T03:49:51.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.829+0000 7f1455ffb700 1 -- 172.21.15.43:0/1188346827 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1450009730 con 0x7f14601ef380 2023-06-08T03:49:51.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f144406ad10 msgr2=0x7f144406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:51.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f144406ad10 0x7f144406d1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f145c000c00 tx=0x7f145c009040 comp rx=0 tx=0).stop 2023-06-08T03:49:51.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 msgr2=0x7f14600c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:51.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 0x7f14600c33b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f144c0047a0 tx=0x7f14500047c0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 shutdown_connections 2023-06-08T03:49:51.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f144406ad10 0x7f144406d1c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14601ef380 0x7f14600c33b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14601f6100 0x7f14601f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 --2- 172.21.15.43:0/1188346827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14601ef750 0x7f14601f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 >> 172.21.15.43:0/1188346827 conn(0x7f146006aec0 msgr2=0x7f146015fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:51.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 shutdown_connections 2023-06-08T03:49:51.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.832+0000 7f14675af700 1 -- 172.21.15.43:0/1188346827 wait complete. 2023-06-08T03:49:51.839 INFO:tasks.ceph.mds.d.smithi135.stderr: -5745> 2023-06-08T03:48:52.319+0000 7f8fa9feb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-08T03:49:51.840 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-08T03:49:51.852 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-08T03:49:51.869 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-06-08T03:49:51.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.982+0000 7fe545361700 1 Processor -- start 2023-06-08T03:49:51.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.982+0000 7fe545361700 1 -- start start 2023-06-08T03:49:51.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe545361700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 0x7fe5400716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe545361700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54006f480 con 0x7fe5400b1dc0 2023-06-08T03:49:51.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe545361700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54006f760 con 0x7fe540159380 2023-06-08T03:49:51.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe545361700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400b10d0 con 0x7fe5400cd930 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe5400b1dc0 0x7fe5400ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55004/0 (socket says 172.21.15.43:55004) 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53f7fe700 1 -- 172.21.15.43:0/2757369893 learned_addr learned my addr 172.21.15.43:0/2757369893 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53e7fc700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 0x7fe5400716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055159715 0 0) 0x7fe54006f480 con 0x7fe5400b1dc0 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5280035b0 con 0x7fe5400b1dc0 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218452527 0 0) 0x7fe54006f760 con 0x7fe540159380 2023-06-08T03:49:51.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe54006f480 con 0x7fe540159380 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065642267 0 0) 0x7fe5280035b0 con 0x7fe5400b1dc0 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 msgr2=0x7fe5400716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 0x7fe5400716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 >> v1:172.21.15.135:6789/0 conn(0x7fe540159380 legacy=0x7fe5400cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400b12e0 con 0x7fe5400b1dc0 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7fe5380019f0 con 0x7fe5400b1dc0 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 >> v1:172.21.15.43:6789/0 conn(0x7fe5400b1dc0 legacy=0x7fe5400ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:51.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.983+0000 7fe53dffb700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 0x7fe528003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe528004120 0x7fe528004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe528004d90 0x7fe528005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400b10d0 con 0x7fe528004d90 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52800bba0 con 0x7fe528004120 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52800bd30 con 0x7fe5400cd930 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe528004d90 0x7fe528005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:51.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53effd700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 0x7fe528003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53e7fc700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe528004120 0x7fe528004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 -- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 msgr2=0x7fe528003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cd930 0x7fe528003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 -- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe528004120 msgr2=0x7fe528004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe528004120 0x7fe528004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 -- 172.21.15.43:0/2757369893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280035b0 con 0x7fe528004d90 2023-06-08T03:49:51.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53f7fe700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe528004d90 0x7fe528005200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b21c0 tx=0x7fe528005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f723bc72b9c721e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:51.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380072d0 con 0x7fe528004d90 2023-06-08T03:49:51.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe538007430 con 0x7fe528004d90 2023-06-08T03:49:51.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.984+0000 7fe53dffb700 1 -- 172.21.15.43:0/2757369893 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380077a0 con 0x7fe528004d90 2023-06-08T03:49:51.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe545361700 1 -- 172.21.15.43:0/2757369893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe528004d90 msgr2=0x7fe528005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:51.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe545361700 1 --2- 172.21.15.43:0/2757369893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe528004d90 0x7fe528005200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b21c0 tx=0x7fe528005880 comp rx=0 tx=0).stop 2023-06-08T03:49:51.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe53f7fe700 1 -- 172.21.15.43:0/2757369893 reap_dead start 2023-06-08T03:49:51.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe545361700 1 -- 172.21.15.43:0/2757369893 shutdown_connections 2023-06-08T03:49:51.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe545361700 1 -- 172.21.15.43:0/2757369893 >> 172.21.15.43:0/2757369893 conn(0x7fe54006aec0 msgr2=0x7fe54006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:51.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe545361700 1 -- 172.21.15.43:0/2757369893 shutdown_connections 2023-06-08T03:49:51.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.985+0000 7fe545361700 1 -- 172.21.15.43:0/2757369893 wait complete. 2023-06-08T03:49:51.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.986+0000 7fe545361700 1 Processor -- start 2023-06-08T03:49:51.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.986+0000 7fe545361700 1 -- start start 2023-06-08T03:49:51.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe545361700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 0x7fe5400c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe545361700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54014dc80 0x7fe5400cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe545361700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cb5b0 0x7fe5400c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:51.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe545361700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cd790 con 0x7fe5400ca9e0 2023-06-08T03:49:51.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe545361700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cba50 con 0x7fe54014dc80 2023-06-08T03:49:51.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe545361700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54014e0f0 con 0x7fe5400cb5b0 2023-06-08T03:49:51.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 0x7fe5400c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:51.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 0x7fe5400c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60108/0 (socket says 172.21.15.43:60108) 2023-06-08T03:49:51.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 -- 172.21.15.43:0/2457437120 learned_addr learned my addr 172.21.15.43:0/2457437120 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:51.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53e7fc700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54014dc80 0x7fe5400cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:51.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53f7fe700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cb5b0 0x7fe5400c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 -- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cb5b0 msgr2=0x7fe5400c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cb5b0 0x7fe5400c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 -- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54014dc80 msgr2=0x7fe5400cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54014dc80 0x7fe5400cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53effd700 1 -- 172.21.15.43:0/2457437120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400cd4b0 con 0x7fe5400ca9e0 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.987+0000 7fe53f7fe700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cb5b0 0x7fe5400c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:52.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.988+0000 7fe53effd700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 0x7fe5400c90d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe530011b40 tx=0x7fe530011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:52.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.988+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300052e0 con 0x7fe5400ca9e0 2023-06-08T03:49:52.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.988+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530005440 con 0x7fe5400ca9e0 2023-06-08T03:49:52.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.988+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe540151e10 con 0x7fe5400ca9e0 2023-06-08T03:49:52.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.988+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300038c0 con 0x7fe5400ca9e0 2023-06-08T03:49:52.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.988+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5400cadb0 con 0x7fe5400ca9e0 2023-06-08T03:49:52.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.989+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe540151c70 con 0x7fe5400ca9e0 2023-06-08T03:49:52.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.989+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe530003a20 con 0x7fe5400ca9e0 2023-06-08T03:49:52.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.990+0000 7fe5277fe700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe52c06ace0 0x7fe52c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.990+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fe53008b930 con 0x7fe5400ca9e0 2023-06-08T03:49:52.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.990+0000 7fe53e7fc700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe52c06ace0 0x7fe52c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.990+0000 7fe53e7fc700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe52c06ace0 0x7fe52c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5400c6810 tx=0x7fe534009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:52.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:51.994+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe540151c70 con 0x7fe5400ca9e0 2023-06-08T03:49:52.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.240+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe540151c70 con 0x7fe5400ca9e0 2023-06-08T03:49:52.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.831+0000 7fe5277fe700 1 -- 172.21.15.43:0/2457437120 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe540151c70 con 0x7fe5400ca9e0 2023-06-08T03:49:52.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe52c06ace0 msgr2=0x7fe52c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe52c06ace0 0x7fe52c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5400c6810 tx=0x7fe534009210 comp rx=0 tx=0).stop 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 msgr2=0x7fe5400c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 0x7fe5400c90d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe530011b40 tx=0x7fe530011f00 comp rx=0 tx=0).stop 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 shutdown_connections 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fe52c06ace0 0x7fe52c06d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5400ca9e0 0x7fe5400c90d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5400cb5b0 0x7fe5400c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 --2- 172.21.15.43:0/2457437120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54014dc80 0x7fe5400cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 >> 172.21.15.43:0/2457437120 conn(0x7fe54006aec0 msgr2=0x7fe5400ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:52.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 shutdown_connections 2023-06-08T03:49:52.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.834+0000 7fe545361700 1 -- 172.21.15.43:0/2457437120 wait complete. 2023-06-08T03:49:52.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-08T03:49:52.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.985+0000 7fab701b3700 1 Processor -- start 2023-06-08T03:49:52.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.985+0000 7fab701b3700 1 -- start start 2023-06-08T03:49:52.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab701b3700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fab68159280 0x7fab6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab701b3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fab680ae830 0x7fab680cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab701b3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab680cd880 0x7fab680cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab701b3700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab680cdd00 con 0x7fab68159280 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab701b3700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab68159650 con 0x7fab680ae830 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab701b3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6806e100 con 0x7fab680cd880 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fab68159280 0x7fab6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fab68159280 0x7fab6806d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60116/0 (socket says 172.21.15.43:60116) 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 -- 172.21.15.43:0/1619458089 learned_addr learned my addr 172.21.15.43:0/1619458089 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6d74e700 1 --2- 172.21.15.43:0/1619458089 >> v2:172.21.15.135:3300/0 conn(0x7fab680ae830 0x7fab680cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6e750700 1 --2- 172.21.15.43:0/1619458089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab680cd880 0x7fab680cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 -- 172.21.15.43:0/1619458089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab680cd880 msgr2=0x7fab680cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 --2- 172.21.15.43:0/1619458089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab680cd880 0x7fab680cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 -- 172.21.15.43:0/1619458089 >> v2:172.21.15.135:3300/0 conn(0x7fab680ae830 msgr2=0x7fab680cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:52.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 --2- 172.21.15.43:0/1619458089 >> v2:172.21.15.135:3300/0 conn(0x7fab680ae830 0x7fab680cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.986+0000 7fab6df4f700 1 -- 172.21.15.43:0/1619458089 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6806ded0 con 0x7fab68159280 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab6df4f700 1 --2- 172.21.15.43:0/1619458089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab68159280 0x7fab6806d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fab68071250 tx=0x7fab58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d00b0bb7cd7145 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab6cf4d700 1 -- 172.21.15.43:0/1619458089 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58005e30 con 0x7fab68159280 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab6cf4d700 1 -- 172.21.15.43:0/1619458089 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58004030 con 0x7fab68159280 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab6cf4d700 1 -- 172.21.15.43:0/1619458089 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580043e0 con 0x7fab68159280 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 -- 172.21.15.43:0/1619458089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab68159280 msgr2=0x7fab6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 --2- 172.21.15.43:0/1619458089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab68159280 0x7fab6806d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fab68071250 tx=0x7fab58009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 -- 172.21.15.43:0/1619458089 shutdown_connections 2023-06-08T03:49:52.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 --2- 172.21.15.43:0/1619458089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab680cd880 0x7fab680cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 --2- 172.21.15.43:0/1619458089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab68159280 0x7fab6806d990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 --2- 172.21.15.43:0/1619458089 >> v2:172.21.15.135:3300/0 conn(0x7fab680ae830 0x7fab680cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 -- 172.21.15.43:0/1619458089 >> 172.21.15.43:0/1619458089 conn(0x7fab68098b20 msgr2=0x7fab6806b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:52.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 -- 172.21.15.43:0/1619458089 shutdown_connections 2023-06-08T03:49:52.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.987+0000 7fab701b3700 1 -- 172.21.15.43:0/1619458089 wait complete. 2023-06-08T03:49:52.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 Processor -- start 2023-06-08T03:49:52.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 -- start start 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab680ae830 0x7fab6814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 0x7fab68155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab68159280 0x7fab681563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab68165950 con 0x7fab680cd880 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6814ccd0 con 0x7fab680ae830 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.989+0000 7fab701b3700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab68164d40 con 0x7fab68159280 2023-06-08T03:49:52.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 0x7fab68155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 0x7fab68155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60124/0 (socket says 172.21.15.43:60124) 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 -- 172.21.15.43:0/3980107176 learned_addr learned my addr 172.21.15.43:0/3980107176 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6df4f700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab680ae830 0x7fab6814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6e750700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab68159280 0x7fab681563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 -- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab68159280 msgr2=0x7fab681563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab68159280 0x7fab681563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 -- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab680ae830 msgr2=0x7fab6814c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:52.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab680ae830 0x7fab6814c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 -- 172.21.15.43:0/3980107176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58009500 con 0x7fab680cd880 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab6d74e700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 0x7fab68155ea0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fab6400e930 tx=0x7fab6400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64013680 con 0x7fab680cd880 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab640137e0 con 0x7fab680cd880 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64013b70 con 0x7fab680cd880 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab68165020 con 0x7fab680cd880 2023-06-08T03:49:53.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.990+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab681655e0 con 0x7fab680cd880 2023-06-08T03:49:53.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.991+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab68165b00 con 0x7fab680cd880 2023-06-08T03:49:53.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.992+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab64013cd0 con 0x7fab680cd880 2023-06-08T03:49:53.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.992+0000 7fab5e7fc700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fab4c06ad10 0x7fab4c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:53.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.992+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fab64089720 con 0x7fab680cd880 2023-06-08T03:49:53.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.992+0000 7fab6df4f700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fab4c06ad10 0x7fab4c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:53.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.993+0000 7fab6df4f700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fab4c06ad10 0x7fab4c06d1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab58014040 tx=0x7fab58010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:53.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:52.997+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab64054450 con 0x7fab680cd880 2023-06-08T03:49:53.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.195+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fab6804e090 con 0x7fab680cd880 2023-06-08T03:49:53.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:49:53.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:49:53.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.836+0000 7fab5e7fc700 1 -- 172.21.15.43:0/3980107176 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fab64057a70 con 0x7fab680cd880 2023-06-08T03:49:53.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fab4c06ad10 msgr2=0x7fab4c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:53.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fab4c06ad10 0x7fab4c06d1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab58014040 tx=0x7fab58010000 comp rx=0 tx=0).stop 2023-06-08T03:49:53.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 msgr2=0x7fab68155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:53.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 0x7fab68155ea0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fab6400e930 tx=0x7fab6400ec40 comp rx=0 tx=0).stop 2023-06-08T03:49:53.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 shutdown_connections 2023-06-08T03:49:53.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fab4c06ad10 0x7fab4c06d1c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:53.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab68159280 0x7fab681563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:53.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab680ae830 0x7fab6814c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:53.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 --2- 172.21.15.43:0/3980107176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab680cd880 0x7fab68155ea0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:53.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 >> 172.21.15.43:0/3980107176 conn(0x7fab68098b20 msgr2=0x7fab68150960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:53.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 shutdown_connections 2023-06-08T03:49:53.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.841+0000 7fab701b3700 1 -- 172.21.15.43:0/3980107176 wait complete. 2023-06-08T03:49:53.850 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-06-08T03:49:53.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-08T03:49:53.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.992+0000 7f3340efd700 1 Processor -- start 2023-06-08T03:49:53.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.992+0000 7f3340efd700 1 -- start start 2023-06-08T03:49:54.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f3340efd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f3340efd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f333c15fd80 0x7f333c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f3340efd700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0cdec0 con 0x7f333c15f9b0 2023-06-08T03:49:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f3340efd700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0cd2b0 con 0x7f333c15fd80 2023-06-08T03:49:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f3340efd700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0cd590 con 0x7f333c06b5d0 2023-06-08T03:49:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f333ad9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f333c15fd80 0x7f333c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f333ad9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f333c15fd80 0x7f333c0ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60134/0 (socket says 172.21.15.43:60134) 2023-06-08T03:49:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.993+0000 7f333ad9d700 1 -- 172.21.15.43:0/3320625180 learned_addr learned my addr 172.21.15.43:0/3320625180 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f3339d9b700 1 --2- 172.21.15.43:0/3320625180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333ad9d700 1 -- 172.21.15.43:0/3320625180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 msgr2=0x7f333c0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333ad9d700 1 --2- 172.21.15.43:0/3320625180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c0ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333ad9d700 1 -- 172.21.15.43:0/3320625180 >> v1:172.21.15.135:6789/0 conn(0x7f333c15f9b0 legacy=0x7f333c06aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333ad9d700 1 -- 172.21.15.43:0/3320625180 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0cd870 con 0x7f333c15fd80 2023-06-08T03:49:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333ad9d700 1 --2- 172.21.15.43:0/3320625180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15fd80 0x7f333c0ceaa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3334009e50 tx=0x7f333400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300462b01fc54b6d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333959a700 1 -- 172.21.15.43:0/3320625180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400e070 con 0x7f333c15fd80 2023-06-08T03:49:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333959a700 1 -- 172.21.15.43:0/3320625180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400b9c0 con 0x7f333c15fd80 2023-06-08T03:49:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.994+0000 7f333959a700 1 -- 172.21.15.43:0/3320625180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400bd70 con 0x7f333c15fd80 2023-06-08T03:49:54.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 -- 172.21.15.43:0/3320625180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15fd80 msgr2=0x7f333c0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:54.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 --2- 172.21.15.43:0/3320625180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15fd80 0x7f333c0ceaa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3334009e50 tx=0x7f333400b330 comp rx=0 tx=0).stop 2023-06-08T03:49:54.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 -- 172.21.15.43:0/3320625180 shutdown_connections 2023-06-08T03:49:54.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 --2- 172.21.15.43:0/3320625180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15fd80 0x7f333c0ceaa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 --2- 172.21.15.43:0/3320625180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c0ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 -- 172.21.15.43:0/3320625180 >> 172.21.15.43:0/3320625180 conn(0x7f333c06a6d0 msgr2=0x7f333c099c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 -- 172.21.15.43:0/3320625180 shutdown_connections 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.995+0000 7f3340efd700 1 -- 172.21.15.43:0/3320625180 wait complete. 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.996+0000 7f3340efd700 1 Processor -- start 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.996+0000 7f3340efd700 1 -- start start 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3340efd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c1f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3340efd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 0x7f333c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3340efd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c15fd80 0x7f333c148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3340efd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c15dca0 con 0x7f333c15f9b0 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3340efd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c15df40 con 0x7f333c15fd80 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3340efd700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c15e220 con 0x7f333c06b5d0 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 0x7f333c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 0x7f333c15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60138/0 (socket says 172.21.15.43:60138) 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 -- 172.21.15.43:0/3799859670 learned_addr learned my addr 172.21.15.43:0/3799859670 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f333ad9d700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c15fd80 0x7f333c148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f333a59c700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c1f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 -- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 msgr2=0x7f333c1f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c1f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 -- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c15fd80 msgr2=0x7f333c148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c15fd80 0x7f333c148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 -- 172.21.15.43:0/3799859670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009b30 con 0x7f333c15f9b0 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f333ad9d700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c15fd80 0x7f333c148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.997+0000 7f3339d9b700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 0x7f333c15a560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e810 tx=0x7f332c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.998+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c013610 con 0x7f333c15f9b0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.998+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c013770 con 0x7f333c15f9b0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.998+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c1f5740 con 0x7f333c15f9b0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.998+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c013b00 con 0x7f333c15f9b0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.998+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c1f5d00 con 0x7f333c15f9b0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.999+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c1f5e90 con 0x7f333c15f9b0 2023-06-08T03:49:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:53.999+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f332c013c60 con 0x7f333c15f9b0 2023-06-08T03:49:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.000+0000 7f332affd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f331c06ace0 0x7f331c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.000+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f332c089330 con 0x7f333c15f9b0 2023-06-08T03:49:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.000+0000 7f333a59c700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f331c06ace0 0x7f331c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.000+0000 7f333a59c700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f331c06ace0 0x7f331c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3330000f60 tx=0x7f3330009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.004+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f332c057ca0 con 0x7f333c15f9b0 2023-06-08T03:49:54.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.200+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f333c04e090 con 0x7f333c15f9b0 2023-06-08T03:49:54.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.842+0000 7f332affd700 1 -- 172.21.15.43:0/3799859670 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f332c057830 con 0x7f333c15f9b0 2023-06-08T03:49:54.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.847+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f331c06ace0 msgr2=0x7f331c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:54.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f331c06ace0 0x7f331c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3330000f60 tx=0x7f3330009040 comp rx=0 tx=0).stop 2023-06-08T03:49:54.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 msgr2=0x7f333c15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:54.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 0x7f333c15a560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e810 tx=0x7f332c00ebd0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 shutdown_connections 2023-06-08T03:49:54.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f331c06ace0 0x7f331c06d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c15fd80 0x7f333c148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c06b5d0 0x7f333c1f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 --2- 172.21.15.43:0/3799859670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f333c15f9b0 0x7f333c15a560 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 >> 172.21.15.43:0/3799859670 conn(0x7f333c06a6d0 msgr2=0x7f333c06aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 shutdown_connections 2023-06-08T03:49:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.848+0000 7f3340efd700 1 -- 172.21.15.43:0/3799859670 wait complete. 2023-06-08T03:49:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-06-08T03:49:54.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-08T03:49:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.997+0000 7f40ead50700 1 Processor -- start 2023-06-08T03:49:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.997+0000 7f40ead50700 1 -- start start 2023-06-08T03:49:55.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40ead50700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e415c660 0x7f40e40ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40ead50700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f40e40cc180 0x7f40e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40ead50700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f40e406a2f0 0x7f40e406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40ead50700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e406a770 con 0x7f40e40cc180 2023-06-08T03:49:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40ead50700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40ac380 con 0x7f40e406a2f0 2023-06-08T03:49:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40ead50700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40acc20 con 0x7f40e415c660 2023-06-08T03:49:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f40e40cc180 0x7f40e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f40e40cc180 0x7f40e4069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60144/0 (socket says 172.21.15.43:60144) 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 -- 172.21.15.43:0/4130441961 learned_addr learned my addr 172.21.15.43:0/4130441961 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e92ed700 1 --2- 172.21.15.43:0/4130441961 >> v2:172.21.15.135:3300/0 conn(0x7f40e406a2f0 0x7f40e406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e8aec700 1 --2- 172.21.15.43:0/4130441961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e415c660 0x7f40e40ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 -- 172.21.15.43:0/4130441961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e415c660 msgr2=0x7f40e40ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 --2- 172.21.15.43:0/4130441961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e415c660 0x7f40e40ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 -- 172.21.15.43:0/4130441961 >> v2:172.21.15.135:3300/0 conn(0x7f40e406a2f0 msgr2=0x7f40e406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 --2- 172.21.15.43:0/4130441961 >> v2:172.21.15.135:3300/0 conn(0x7f40e406a2f0 0x7f40e406cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 -- 172.21.15.43:0/4130441961 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40c9dc0 con 0x7f40e40cc180 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e92ed700 1 --2- 172.21.15.43:0/4130441961 >> v2:172.21.15.135:3300/0 conn(0x7f40e406a2f0 0x7f40e406cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.998+0000 7f40e3fff700 1 --2- 172.21.15.43:0/4130441961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e40cc180 0x7f40e4069db0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40e40af160 tx=0x7f40d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1a05295c2a16ec server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40e37fe700 1 -- 172.21.15.43:0/4130441961 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000b870 con 0x7f40e40cc180 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40e37fe700 1 -- 172.21.15.43:0/4130441961 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000b9d0 con 0x7f40e40cc180 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40e37fe700 1 -- 172.21.15.43:0/4130441961 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000bd60 con 0x7f40e40cc180 2023-06-08T03:49:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 -- 172.21.15.43:0/4130441961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e40cc180 msgr2=0x7f40e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 --2- 172.21.15.43:0/4130441961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e40cc180 0x7f40e4069db0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40e40af160 tx=0x7f40d0009bd0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 -- 172.21.15.43:0/4130441961 shutdown_connections 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 --2- 172.21.15.43:0/4130441961 >> v2:172.21.15.135:3300/0 conn(0x7f40e406a2f0 0x7f40e406cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 --2- 172.21.15.43:0/4130441961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e415c660 0x7f40e40ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 --2- 172.21.15.43:0/4130441961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e40cc180 0x7f40e4069db0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 -- 172.21.15.43:0/4130441961 >> 172.21.15.43:0/4130441961 conn(0x7f40e4098b20 msgr2=0x7f40e406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 -- 172.21.15.43:0/4130441961 shutdown_connections 2023-06-08T03:49:55.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:54.999+0000 7f40ead50700 1 -- 172.21.15.43:0/4130441961 wait complete. 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.000+0000 7f40ead50700 1 Processor -- start 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 -- start start 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e406a2f0 0x7f40e41f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e40cc180 0x7f40e4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 0x7f40e41f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41f2e20 con 0x7f40e415c660 2023-06-08T03:49:55.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41f2370 con 0x7f40e40cc180 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.001+0000 7f40ead50700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41f2580 con 0x7f40e406a2f0 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 0x7f40e41f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 0x7f40e41f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60154/0 (socket says 172.21.15.43:60154) 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 -- 172.21.15.43:0/1512789045 learned_addr learned my addr 172.21.15.43:0/1512789045 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e8aec700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e406a2f0 0x7f40e41f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e3fff700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e40cc180 0x7f40e4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 -- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e406a2f0 msgr2=0x7f40e41f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e406a2f0 0x7f40e41f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 -- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e40cc180 msgr2=0x7f40e4158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e40cc180 0x7f40e4158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 -- 172.21.15.43:0/1512789045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009550 con 0x7f40e415c660 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e92ed700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 0x7f40e41f5ac0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007e10 tx=0x7f40dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00dd20 con 0x7f40e415c660 2023-06-08T03:49:55.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00f040 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc003c40 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e41f2860 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.002+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e4158670 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.003+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e41584d0 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.004+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40dc004030 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.004+0000 7f40e17fa700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f40c806ace0 0x7f40c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.004+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f40dc089470 con 0x7f40e415c660 2023-06-08T03:49:55.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.004+0000 7f40e8aec700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f40c806ace0 0x7f40c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:55.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.005+0000 7f40e8aec700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f40c806ace0 0x7f40c806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40d8006fd0 tx=0x7f40d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:55.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.008+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40e41584d0 con 0x7f40e415c660 2023-06-08T03:49:55.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.207+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40e41584d0 con 0x7f40e415c660 2023-06-08T03:49:55.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.849+0000 7f40e17fa700 1 -- 172.21.15.43:0/1512789045 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f40e41584d0 con 0x7f40e415c660 2023-06-08T03:49:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f40c806ace0 msgr2=0x7f40c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f40c806ace0 0x7f40c806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40d8006fd0 tx=0x7f40d8008040 comp rx=0 tx=0).stop 2023-06-08T03:49:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 msgr2=0x7f40e41f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 0x7f40e41f5ac0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007e10 tx=0x7f40dc00d3b0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 shutdown_connections 2023-06-08T03:49:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f40c806ace0 0x7f40c806d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40e415c660 0x7f40e41f5ac0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40e406a2f0 0x7f40e41f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 --2- 172.21.15.43:0/1512789045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e40cc180 0x7f40e4158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 >> 172.21.15.43:0/1512789045 conn(0x7f40e4098b20 msgr2=0x7f40e40af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.854+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 shutdown_connections 2023-06-08T03:49:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:55.855+0000 7f40ead50700 1 -- 172.21.15.43:0/1512789045 wait complete. 2023-06-08T03:49:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' removed 2023-06-08T03:49:55.874 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-08T03:49:55.874 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-08T03:49:55.874 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-08T03:49:55.874 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T03:49:55.875 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-08T03:49:55.875 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-08T03:49:55.875 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-08T03:49:55.875 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T03:49:55.876 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-08T03:49:55.876 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-08T03:49:55.876 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-08T03:49:55.876 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T03:49:55.877 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-08T03:49:55.877 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-08T03:49:55.877 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-08T03:49:55.877 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T03:49:55.884 INFO:tasks.ceph.mds.a:Stopped 2023-06-08T03:49:55.885 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-08T03:49:55.886 INFO:tasks.ceph.mds.c:Stopped 2023-06-08T03:49:55.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-08T03:49:55.887 INFO:tasks.ceph.mds.b:Stopped 2023-06-08T03:49:55.887 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-08T03:49:55.888 INFO:tasks.ceph.mds.d:Stopped 2023-06-08T03:49:55.888 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-08T03:49:55.927 INFO:tasks.ceph.mds.a:Started 2023-06-08T03:49:55.927 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:55.928 INFO:tasks.ceph.mds.c:Started 2023-06-08T03:49:55.928 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:55.930 INFO:tasks.ceph.mds.b:Started 2023-06-08T03:49:55.931 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:55.931 INFO:tasks.ceph.mds.d:Started 2023-06-08T03:49:55.931 DEBUG:teuthology.parallel:result is None 2023-06-08T03:49:55.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-08T03:49:56.017 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-06-08T03:49:56.017 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-06-08T03:49:56.018 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-06-08T03:49:56.018 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-06-08T03:49:56.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.077+0000 7fa51ee4e700 1 Processor -- start 2023-06-08T03:49:56.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.077+0000 7fa51ee4e700 1 -- start start 2023-06-08T03:49:56.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.077+0000 7fa51ee4e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa51815e420 0x7fa5180cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:56.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.077+0000 7fa51ee4e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5180cdb80 con 0x7fa5180cca40 2023-06-08T03:49:56.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.077+0000 7fa51ee4e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5180ce310 con 0x7fa51815e050 2023-06-08T03:49:56.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.077+0000 7fa51ee4e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180ce5f0 con 0x7fa51815e420 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa51d3eb700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa5180cca40 0x7fa518163ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55092/0 (socket says 172.21.15.43:55092) 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa51d3eb700 1 -- 172.21.15.43:0/3011463547 learned_addr learned my addr 172.21.15.43:0/3011463547 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa517fff700 1 --2- 172.21.15.43:0/3011463547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa51815e420 0x7fa5180cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986441196 0 0) 0x7fa5180ce310 con 0x7fa51815e050 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5000035b0 con 0x7fa51815e050 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125108477 0 0) 0x7fa5180cdb80 con 0x7fa5180cca40 2023-06-08T03:49:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5180ce310 con 0x7fa5180cca40 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa517fff700 1 -- 172.21.15.43:0/3011463547 >> v1:172.21.15.135:6789/0 conn(0x7fa51815e050 legacy=0x7fa5180cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa517fff700 1 -- 172.21.15.43:0/3011463547 >> v1:172.21.15.43:6789/0 conn(0x7fa5180cca40 legacy=0x7fa518163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa517fff700 1 -- 172.21.15.43:0/3011463547 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5180ce8d0 con 0x7fa51815e420 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa517fff700 1 --2- 172.21.15.43:0/3011463547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa51815e420 0x7fa5180cc500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009870 tx=0x7fa50c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8cace33f227a5e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c011830 con 0x7fa51815e420 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c011990 con 0x7fa51815e420 2023-06-08T03:49:56.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.078+0000 7fa5177fe700 1 -- 172.21.15.43:0/3011463547 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c011d00 con 0x7fa51815e420 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 -- 172.21.15.43:0/3011463547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa51815e420 msgr2=0x7fa5180cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/3011463547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa51815e420 0x7fa5180cc500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009870 tx=0x7fa50c009b80 comp rx=0 tx=0).stop 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 -- 172.21.15.43:0/3011463547 shutdown_connections 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/3011463547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa51815e420 0x7fa5180cc500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 -- 172.21.15.43:0/3011463547 >> 172.21.15.43:0/3011463547 conn(0x7fa518069db0 msgr2=0x7fa51806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 -- 172.21.15.43:0/3011463547 shutdown_connections 2023-06-08T03:49:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.079+0000 7fa51ee4e700 1 -- 172.21.15.43:0/3011463547 wait complete. 2023-06-08T03:49:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.080+0000 7fa51ee4e700 1 Processor -- start 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.080+0000 7fa51ee4e700 1 -- start start 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51ee4e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5180cca40 0x7fa5180d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51ee4e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51815e050 0x7fa518147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51ee4e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 0x7fa5180c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51ee4e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5181480e0 con 0x7fa51815e420 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51ee4e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180ca680 con 0x7fa51815e050 2023-06-08T03:49:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51ee4e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180c5d30 con 0x7fa5180cca40 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51d3eb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 0x7fa5180c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51d3eb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 0x7fa5180c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60194/0 (socket says 172.21.15.43:60194) 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51d3eb700 1 -- 172.21.15.43:0/377743789 learned_addr learned my addr 172.21.15.43:0/377743789 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa51cbea700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5180cca40 0x7fa5180d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.081+0000 7fa517fff700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51815e050 0x7fa518147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51d3eb700 1 -- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5180cca40 msgr2=0x7fa5180d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:56.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51d3eb700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5180cca40 0x7fa5180d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51d3eb700 1 -- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51815e050 msgr2=0x7fa518147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51d3eb700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51815e050 0x7fa518147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51d3eb700 1 -- 172.21.15.43:0/377743789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0094a0 con 0x7fa51815e420 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51d3eb700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 0x7fa5180c6ab0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa50800c4d0 tx=0x7fa50800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508005d70 con 0x7fa51815e420 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080070d0 con 0x7fa51815e420 2023-06-08T03:49:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5180c5fd0 con 0x7fa51815e420 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508007440 con 0x7fa51815e420 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.082+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5180c6590 con 0x7fa51815e420 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.083+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa518073fa0 con 0x7fa51815e420 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.084+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5080075a0 con 0x7fa51815e420 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.084+0000 7fa5157fa700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.084+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa5080885a0 con 0x7fa51815e420 2023-06-08T03:49:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.084+0000 7fa51cbea700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:56.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.085+0000 7fa51cbea700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa50406ace0 0x7fa50406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa51000f2b0 tx=0x7fa510009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:56.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.088+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5080538c0 con 0x7fa51815e420 2023-06-08T03:49:56.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:56.301+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa5180c4010 con 0x7fa51815e420 2023-06-08T03:49:57.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.048+0000 7fa5157fa700 1 -- 172.21.15.43:0/377743789 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa508056ee0 con 0x7fa51815e420 2023-06-08T03:49:57.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa50406ace0 msgr2=0x7fa50406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa50406ace0 0x7fa50406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa51000f2b0 tx=0x7fa510009040 comp rx=0 tx=0).stop 2023-06-08T03:49:57.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 msgr2=0x7fa5180c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 0x7fa5180c6ab0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa50800c4d0 tx=0x7fa50800c7e0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 shutdown_connections 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa50406ace0 0x7fa50406d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa51815e420 0x7fa5180c6ab0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5180cca40 0x7fa5180d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 --2- 172.21.15.43:0/377743789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51815e050 0x7fa518147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 >> 172.21.15.43:0/377743789 conn(0x7fa518069db0 msgr2=0x7fa5180b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:57.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.051+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 shutdown_connections 2023-06-08T03:49:57.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.052+0000 7fa51ee4e700 1 -- 172.21.15.43:0/377743789 wait complete. 2023-06-08T03:49:57.058 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-06-08T03:49:57.070 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-08T03:49:57.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.197+0000 7fa299bda700 1 Processor -- start 2023-06-08T03:49:57.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.197+0000 7fa299bda700 1 -- start start 2023-06-08T03:49:57.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa299bda700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2940cc530 0x7fa29415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa299bda700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940ce770 con 0x7fa294158e00 2023-06-08T03:49:57.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa299bda700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa294071180 con 0x7fa2940cc0c0 2023-06-08T03:49:57.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa299bda700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940ca4a0 con 0x7fa2940cc530 2023-06-08T03:49:57.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa293fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2940cc530 0x7fa29415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa293fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2940cc530 0x7fa29415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60204/0 (socket says 172.21.15.43:60204) 2023-06-08T03:49:57.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa293fff700 1 -- 172.21.15.43:0/3883211861 learned_addr learned my addr 172.21.15.43:0/3883211861 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:57.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa293fff700 1 -- 172.21.15.43:0/3883211861 >> v1:172.21.15.135:6789/0 conn(0x7fa2940cc0c0 legacy=0x7fa29415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:57.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa293fff700 1 -- 172.21.15.43:0/3883211861 >> v1:172.21.15.43:6789/0 conn(0x7fa294158e00 legacy=0x7fa2940cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa293fff700 1 -- 172.21.15.43:0/3883211861 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294071460 con 0x7fa2940cc530 2023-06-08T03:49:57.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.198+0000 7fa2927fc700 1 -- 172.21.15.43:0/3883211861 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359137333 0 0) 0x7fa2940ce770 con 0x7fa294158e00 2023-06-08T03:49:57.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa293fff700 1 --2- 172.21.15.43:0/3883211861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa29415d060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d150 tx=0x7fa28c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f5240b7851c510 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:57.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa2927fc700 1 -- 172.21.15.43:0/3883211861 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c010070 con 0x7fa2940cc530 2023-06-08T03:49:57.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa2927fc700 1 -- 172.21.15.43:0/3883211861 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00dd80 con 0x7fa2940cc530 2023-06-08T03:49:57.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa2927fc700 1 -- 172.21.15.43:0/3883211861 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00b310 con 0x7fa2940cc530 2023-06-08T03:49:57.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 -- 172.21.15.43:0/3883211861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 msgr2=0x7fa29415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 --2- 172.21.15.43:0/3883211861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa29415d060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d150 tx=0x7fa28c00d460 comp rx=0 tx=0).stop 2023-06-08T03:49:57.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 -- 172.21.15.43:0/3883211861 shutdown_connections 2023-06-08T03:49:57.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 --2- 172.21.15.43:0/3883211861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa29415d060 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 -- 172.21.15.43:0/3883211861 >> 172.21.15.43:0/3883211861 conn(0x7fa29406d180 msgr2=0x7fa29406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:57.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 -- 172.21.15.43:0/3883211861 shutdown_connections 2023-06-08T03:49:57.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.199+0000 7fa299bda700 1 -- 172.21.15.43:0/3883211861 wait complete. 2023-06-08T03:49:57.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.201+0000 7fa299bda700 1 Processor -- start 2023-06-08T03:49:57.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.201+0000 7fa299bda700 1 -- start start 2023-06-08T03:49:57.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.201+0000 7fa299bda700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2940cc0c0 0x7fa294153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.201+0000 7fa299bda700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa2940c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.201+0000 7fa299bda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa294158e00 0x7fa2940c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.201+0000 7fa299bda700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940c45f0 con 0x7fa2940cc530 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa299bda700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940c3720 con 0x7fa294158e00 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa299bda700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2941542f0 con 0x7fa2940cc0c0 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa2940c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa2940c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60208/0 (socket says 172.21.15.43:60208) 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 -- 172.21.15.43:0/628771252 learned_addr learned my addr 172.21.15.43:0/628771252 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:57.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa293fff700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa294158e00 0x7fa2940c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa2937fe700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2940cc0c0 0x7fa294153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 -- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2940cc0c0 msgr2=0x7fa294153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2940cc0c0 0x7fa294153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 -- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa294158e00 msgr2=0x7fa2940c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa294158e00 0x7fa2940c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 -- 172.21.15.43:0/628771252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c00bd40 con 0x7fa2940cc530 2023-06-08T03:49:57.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa292ffd700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa2940c4a10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c500 tx=0x7fa27c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c011790 con 0x7fa2940cc530 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c0118f0 con 0x7fa2940cc530 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2940c3970 con 0x7fa2940cc530 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c011ca0 con 0x7fa2940cc530 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.202+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940c3f30 con 0x7fa2940cc530 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.203+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940c4730 con 0x7fa2940cc530 2023-06-08T03:49:57.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.204+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa27c01c460 con 0x7fa2940cc530 2023-06-08T03:49:57.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.205+0000 7fa28bfff700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa27406ace0 0x7fa27406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.205+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa27c089b30 con 0x7fa2940cc530 2023-06-08T03:49:57.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.205+0000 7fa2937fe700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa27406ace0 0x7fa27406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.205+0000 7fa2937fe700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa27406ace0 0x7fa27406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa2940b1ba0 tx=0x7fa284009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:57.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.208+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa27c054e60 con 0x7fa2940cc530 2023-06-08T03:49:57.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.485+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa294073fa0 con 0x7fa2940cc530 2023-06-08T03:49:57.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.485+0000 7fa28bfff700 1 -- 172.21.15.43:0/628771252 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa27c058480 con 0x7fa2940cc530 2023-06-08T03:49:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:49:57.492 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-06-08T03:49:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-06-08T03:49:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-06-08T03:49:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBrT4FkRbqAMxAAb1xXZ6xpWX9IxphDY5qpbQ==", 2023-06-08T03:49:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-06-08T03:49:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-06-08T03:49:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBsT4FkTQBxBBAAmjFn4oMv2yOuQrgwHoQFxg==", 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-06-08T03:49:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-06-08T03:49:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBrT4FkrXXiOhAA8ge5yE3ibQ9u8gx2OcIJDA==", 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBsT4FkZhfGCxAAMX7udJGKGbW3VqGQQrSmEg==", 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBuT4Fkbc9IAhAAjcZD8BAbTkpr24sZHAbktw==", 2023-06-08T03:49:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBxT4FkOeeZARAAtqvpTgpAg7x3uHwa4JNl9g==", 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQB0T4Fk+W5AARAAHZmRacIDqlSDYcQJ7yTmwA==", 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQB3T4Fkx9A5ABAAPOuOIGIPE3usp7z1esiJHQ==", 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQB9T4FklBQQAxAApClzyQ51rJ4JtKZakgEytw==", 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-06-08T03:49:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCAT4Fk3+zzAhAAjzKxRRnDKcVL12ugDwrSiw==", 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCDT4FkNO2CARAAeNJEEseMvNRbNX8P4V6d4Q==", 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-06-08T03:49:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCGT4FkSY0eARAApjaMySd/L+omX0G2YP2QBw==", 2023-06-08T03:49:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-06-08T03:49:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBsT4FkencoEBAAcpys0kmXwP74aLrF4W9p1w==", 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-06-08T03:49:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBsT4Fkf9TZFhAAgWNrBZGBv2mqEtW9n8uLEg==", 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.2", 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBsT4FkE52GExAAbRMeRSg8R7gClkaWmbJ6ig==", 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-06-08T03:49:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-06-08T03:49:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.3", 2023-06-08T03:49:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBsT4FkkVmBHBAAyUdxTs7RLUOEeMXWpwl9mw==", 2023-06-08T03:49:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-06-08T03:49:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-06-08T03:49:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-06-08T03:49:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-06-08T03:49:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag==", 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-06-08T03:49:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-mds", 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCLT4FkkyMTOBAAU6lMITSTefocZTxPEJJ10A==", 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-mds" 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-mgr", 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCLT4FkxywTOBAArT+au5juB3x+2xikF9wj4A==", 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-osd", 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCLT4FkEzYTOBAAf1Dq1Xph6gmJBzXAT5qJ/g==", 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-osd" 2023-06-08T03:49:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rbd", 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCLT4FkYD4TOBAAP23oAg1jZY5f2w2LlJawKg==", 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-08T03:49:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-08T03:49:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCLT4Fkz0cTOBAAId9WBAjGDSgEvnswOREFMA==", 2023-06-08T03:49:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rgw", 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCLT4FkI1ATOBAAn9c3R1i3VMiv0nxp8SPrYQ==", 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBrT4Fkplz/LxAA/ARPDBVyq9+psvFze755gA==", 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-06-08T03:49:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQBrT4FkcFWbKBAAKJwsoOM1M5+SlmlDcmoRKA==", 2023-06-08T03:49:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-06-08T03:49:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-06-08T03:49:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-06-08T03:49:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-06-08T03:49:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:49:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-06-08T03:49:57.524 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-06-08T03:49:57.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa27406ace0 msgr2=0x7fa27406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa27406ace0 0x7fa27406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa2940b1ba0 tx=0x7fa284009040 comp rx=0 tx=0).stop 2023-06-08T03:49:57.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 msgr2=0x7fa2940c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa2940c4a10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c500 tx=0x7fa27c00c8c0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 shutdown_connections 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa27406ace0 0x7fa27406d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa294158e00 0x7fa2940c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2940cc0c0 0x7fa294153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 --2- 172.21.15.43:0/628771252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940cc530 0x7fa2940c4a10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 >> 172.21.15.43:0/628771252 conn(0x7fa29406d180 msgr2=0x7fa2940cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:57.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 shutdown_connections 2023-06-08T03:49:57.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.487+0000 7fa299bda700 1 -- 172.21.15.43:0/628771252 wait complete. 2023-06-08T03:49:57.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-08T03:49:57.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.648+0000 7f0b91212700 1 Processor -- start 2023-06-08T03:49:57.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b91212700 1 -- start start 2023-06-08T03:49:57.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b91212700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b8c15e050 0x7f0b8c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b91212700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c15e960 con 0x7f0b8c0ccc10 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b91212700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c0cdb80 con 0x7f0b8c0cd150 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b91212700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c0ce310 con 0x7f0b8c15e050 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b8b59e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0b8c0ccc10 0x7f0b8c163ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55120/0 (socket says 172.21.15.43:55120) 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.649+0000 7f0b8b59e700 1 -- 172.21.15.43:0/3609366825 learned_addr learned my addr 172.21.15.43:0/3609366825 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3609366825 >> v2:172.21.15.135:3300/0 conn(0x7f0b8c15e050 0x7f0b8c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927854486 0 0) 0x7f0b84001490 con 0x7f0b8c0ccc10 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b780035b0 con 0x7f0b8c0ccc10 2023-06-08T03:49:57.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210274985 0 0) 0x7f0b780035b0 con 0x7f0b8c0ccc10 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 >> v2:172.21.15.135:3300/0 conn(0x7f0b8c15e050 msgr2=0x7f0b8c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 --2- 172.21.15.43:0/3609366825 >> v2:172.21.15.135:3300/0 conn(0x7f0b8c15e050 0x7f0b8c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 >> v1:172.21.15.135:6789/0 conn(0x7f0b8c0cd150 legacy=0x7f0b8c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0ce5f0 con 0x7f0b8c0ccc10 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f0b84001b80 con 0x7f0b8c0ccc10 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 >> v1:172.21.15.43:6789/0 conn(0x7f0b8c0ccc10 legacy=0x7f0b8c163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b78003a00 0x7f0b78003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b78004850 0x7f0b78004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78005200 0x7f0b7800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0ce310 con 0x7f0b78003a00 2023-06-08T03:49:57.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7800c080 con 0x7f0b78004850 2023-06-08T03:49:57.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7800c240 con 0x7f0b78005200 2023-06-08T03:49:57.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b78003a00 0x7f0b78003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8a59c700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b78004850 0x7f0b78004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8b59e700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78005200 0x7f0b7800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8ad9d700 1 -- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78005200 msgr2=0x7f0b7800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:57.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78005200 0x7f0b7800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.650+0000 7f0b8ad9d700 1 -- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b78004850 msgr2=0x7f0b78004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:57.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b78004850 0x7f0b78004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b8ad9d700 1 -- 172.21.15.43:0/3609366825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780035b0 con 0x7f0b78003a00 2023-06-08T03:49:57.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b8b59e700 1 -- 172.21.15.43:0/3609366825 reap_dead start 2023-06-08T03:49:57.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b78003a00 0x7f0b78003e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009b60 tx=0x7f0b78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a38e3b490ff6ef server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:57.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c00e6c0 con 0x7f0b78003a00 2023-06-08T03:49:57.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c00e820 con 0x7f0b78003a00 2023-06-08T03:49:57.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b89d9b700 1 -- 172.21.15.43:0/3609366825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c00ebb0 con 0x7f0b78003a00 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 -- 172.21.15.43:0/3609366825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b78003a00 msgr2=0x7f0b78003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b78003a00 0x7f0b78003e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009b60 tx=0x7f0b78005880 comp rx=0 tx=0).stop 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 -- 172.21.15.43:0/3609366825 shutdown_connections 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 --2- 172.21.15.43:0/3609366825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b78003a00 0x7f0b78003e10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 -- 172.21.15.43:0/3609366825 >> 172.21.15.43:0/3609366825 conn(0x7f0b8c069db0 msgr2=0x7f0b8c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 -- 172.21.15.43:0/3609366825 shutdown_connections 2023-06-08T03:49:57.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.651+0000 7f0b91212700 1 -- 172.21.15.43:0/3609366825 wait complete. 2023-06-08T03:49:57.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.653+0000 7f0b91212700 1 Processor -- start 2023-06-08T03:49:57.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.653+0000 7f0b91212700 1 -- start start 2023-06-08T03:49:57.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b91212700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78003a00 0x7f0b8c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b91212700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 0x7f0b8c1e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b91212700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c1f3150 0x7f0b8c1f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b91212700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c144710 con 0x7f0b8c157e40 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b91212700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1e3c40 con 0x7f0b8c1f3150 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b91212700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1e3f20 con 0x7f0b78003a00 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 0x7f0b8c1e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 0x7f0b8c1e5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60226/0 (socket says 172.21.15.43:60226) 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 -- 172.21.15.43:0/3081535644 learned_addr learned my addr 172.21.15.43:0/3081535644 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8b59e700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c1f3150 0x7f0b8c1f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78003a00 0x7f0b8c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 -- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78003a00 msgr2=0x7f0b8c0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78003a00 0x7f0b8c0b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 -- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c1f3150 msgr2=0x7f0b8c1f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c1f3150 0x7f0b8c1f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 -- 172.21.15.43:0/3081535644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c1e4200 con 0x7f0b8c157e40 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78003a00 0x7f0b8c0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b8a59c700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 0x7f0b8c1e5ef0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400f820 tx=0x7f0b7400fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740052e0 con 0x7f0b8c157e40 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74005440 con 0x7f0b8c157e40 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.654+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740038c0 con 0x7f0b8c157e40 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.655+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c1e44e0 con 0x7f0b8c157e40 2023-06-08T03:49:57.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.655+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c1e6430 con 0x7f0b8c157e40 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.655+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c073fa0 con 0x7f0b8c157e40 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.656+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b74003a20 con 0x7f0b8c157e40 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.656+0000 7f0b837fe700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0b6c06ace0 0x7f0b6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.656+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0b740890b0 con 0x7f0b8c157e40 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.657+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0b6c06ace0 0x7f0b6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.657+0000 7f0b8ad9d700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0b6c06ace0 0x7f0b6c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0090b0 tx=0x7f0b7c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:57.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.661+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b74054370 con 0x7f0b8c157e40 2023-06-08T03:49:57.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.940+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0b8c15a0a0 con 0x7f0b8c157e40 2023-06-08T03:49:57.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.944+0000 7f0b837fe700 1 -- 172.21.15.43:0/3081535644 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0b74057990 con 0x7f0b8c157e40 2023-06-08T03:49:57.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0b6c06ace0 msgr2=0x7f0b6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0b6c06ace0 0x7f0b6c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0090b0 tx=0x7f0b7c008030 comp rx=0 tx=0).stop 2023-06-08T03:49:57.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 msgr2=0x7f0b8c1e5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 0x7f0b8c1e5ef0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400f820 tx=0x7f0b7400fbe0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 shutdown_connections 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f0b6c06ace0 0x7f0b6c06d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c1f3150 0x7f0b8c1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b78003a00 0x7f0b8c0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 --2- 172.21.15.43:0/3081535644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b8c157e40 0x7f0b8c1e5ef0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:57.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 >> 172.21.15.43:0/3081535644 conn(0x7f0b8c069db0 msgr2=0x7f0b8c0b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:57.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 shutdown_connections 2023-06-08T03:49:57.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:57.946+0000 7f0b91212700 1 -- 172.21.15.43:0/3081535644 wait complete. 2023-06-08T03:49:57.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-08T03:49:58.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.084+0000 7fcc698b2700 1 Processor -- start 2023-06-08T03:49:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.084+0000 7fcc698b2700 1 -- start start 2023-06-08T03:49:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc698b2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640d1c10 0x7fcc640ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc698b2700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcc640cd500 0x7fcc64165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc698b2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc640cf690 con 0x7fcc640b43f0 2023-06-08T03:49:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc698b2700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc640d0180 con 0x7fcc640cd500 2023-06-08T03:49:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc698b2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640d0770 con 0x7fcc640d1c10 2023-06-08T03:49:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcc640cd500 0x7fcc64165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcc640cd500 0x7fcc64165cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60236/0 (socket says 172.21.15.43:60236) 2023-06-08T03:49:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 -- 172.21.15.43:0/1601322634 learned_addr learned my addr 172.21.15.43:0/1601322634 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc627fc700 1 --2- 172.21.15.43:0/1601322634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640d1c10 0x7fcc640ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 -- 172.21.15.43:0/1601322634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640d1c10 msgr2=0x7fcc640ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 --2- 172.21.15.43:0/1601322634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640d1c10 0x7fcc640ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 -- 172.21.15.43:0/1601322634 >> v1:172.21.15.135:6789/0 conn(0x7fcc640b43f0 legacy=0x7fcc640b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 -- 172.21.15.43:0/1601322634 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc640cf8e0 con 0x7fcc640cd500 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.085+0000 7fcc637fe700 1 --2- 172.21.15.43:0/1601322634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc64165cd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009e50 tx=0x7fcc5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edeff5831202c711 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc61ffb700 1 -- 172.21.15.43:0/1601322634 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00e070 con 0x7fcc640cd500 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc61ffb700 1 -- 172.21.15.43:0/1601322634 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c00b9c0 con 0x7fcc640cd500 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc61ffb700 1 -- 172.21.15.43:0/1601322634 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00bd70 con 0x7fcc640cd500 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 -- 172.21.15.43:0/1601322634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 msgr2=0x7fcc64165cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 --2- 172.21.15.43:0/1601322634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc64165cd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009e50 tx=0x7fcc5c00b330 comp rx=0 tx=0).stop 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 -- 172.21.15.43:0/1601322634 shutdown_connections 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 --2- 172.21.15.43:0/1601322634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc64165cd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 --2- 172.21.15.43:0/1601322634 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640d1c10 0x7fcc640ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 -- 172.21.15.43:0/1601322634 >> 172.21.15.43:0/1601322634 conn(0x7fcc6406afb0 msgr2=0x7fcc6406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 -- 172.21.15.43:0/1601322634 shutdown_connections 2023-06-08T03:49:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.086+0000 7fcc698b2700 1 -- 172.21.15.43:0/1601322634 wait complete. 2023-06-08T03:49:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.087+0000 7fcc698b2700 1 Processor -- start 2023-06-08T03:49:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 -- start start 2023-06-08T03:49:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640b43f0 0x7fcc6415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc640cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc640d1c10 0x7fcc640cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640ca850 con 0x7fcc640cd500 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640cab30 con 0x7fcc640d1c10 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc698b2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640cae10 con 0x7fcc640b43f0 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc627fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc640cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc627fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc640cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60240/0 (socket says 172.21.15.43:60240) 2023-06-08T03:49:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.088+0000 7fcc627fc700 1 -- 172.21.15.43:0/131680586 learned_addr learned my addr 172.21.15.43:0/131680586 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:58.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc62ffd700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640b43f0 0x7fcc6415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc627fc700 1 -- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640b43f0 msgr2=0x7fcc6415aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc637fe700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc640d1c10 0x7fcc640cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc627fc700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640b43f0 0x7fcc6415aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc627fc700 1 -- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc640d1c10 msgr2=0x7fcc640cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc627fc700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc640d1c10 0x7fcc640cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc627fc700 1 -- 172.21.15.43:0/131680586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c009b30 con 0x7fcc640cd500 2023-06-08T03:49:58.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc627fc700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc640cc3f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400e810 tx=0x7fcc5400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54013610 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc54013770 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc640cb0f0 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54013b20 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.089+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6415af40 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.090+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc64073fa0 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.091+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc54013c80 con 0x7fcc640cd500 2023-06-08T03:49:58.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.091+0000 7fcc5bfff700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcc4406ace0 0x7fcc4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.091+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcc54088eb0 con 0x7fcc640cd500 2023-06-08T03:49:58.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.092+0000 7fcc62ffd700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcc4406ace0 0x7fcc4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.092+0000 7fcc62ffd700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcc4406ace0 0x7fcc4406d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c000fb0 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.096+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc54057c10 con 0x7fcc640cd500 2023-06-08T03:49:58.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.376+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcc640b50f0 con 0x7fcc640cd500 2023-06-08T03:49:58.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.380+0000 7fcc5bfff700 1 -- 172.21.15.43:0/131680586 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcc540577a0 con 0x7fcc640cd500 2023-06-08T03:49:58.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcc4406ace0 msgr2=0x7fcc4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcc4406ace0 0x7fcc4406d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c000fb0 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2023-06-08T03:49:58.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 msgr2=0x7fcc640cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc640cc3f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400e810 tx=0x7fcc5400ebd0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 shutdown_connections 2023-06-08T03:49:58.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcc4406ace0 0x7fcc4406d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc640d1c10 0x7fcc640cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc640b43f0 0x7fcc6415aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.382+0000 7fcc698b2700 1 --2- 172.21.15.43:0/131680586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc640cd500 0x7fcc640cc3f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.383+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 >> 172.21.15.43:0/131680586 conn(0x7fcc6406afb0 msgr2=0x7fcc640b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:58.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.383+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 shutdown_connections 2023-06-08T03:49:58.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.383+0000 7fcc698b2700 1 -- 172.21.15.43:0/131680586 wait complete. 2023-06-08T03:49:58.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-08T03:49:58.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.519+0000 7fc2e4e49700 1 Processor -- start 2023-06-08T03:49:58.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.519+0000 7fc2e4e49700 1 -- start start 2023-06-08T03:49:58.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2e4e49700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2e015c420 0x7fc2e00b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2e4e49700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0072090 0x7fc2e00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2e4e49700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e0071850 con 0x7fc2e0069db0 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2e4e49700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e00b20f0 con 0x7fc2e015c420 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2e4e49700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00cec30 con 0x7fc2e0072090 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2de59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2e015c420 0x7fc2e00b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2de59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2e015c420 0x7fc2e00b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60246/0 (socket says 172.21.15.43:60246) 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.520+0000 7fc2de59c700 1 -- 172.21.15.43:0/3009891478 learned_addr learned my addr 172.21.15.43:0/3009891478 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2ddd9b700 1 --2- 172.21.15.43:0/3009891478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0072090 0x7fc2e00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2de59c700 1 -- 172.21.15.43:0/3009891478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0072090 msgr2=0x7fc2e00cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2de59c700 1 --2- 172.21.15.43:0/3009891478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0072090 0x7fc2e00cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2de59c700 1 -- 172.21.15.43:0/3009891478 >> v1:172.21.15.135:6789/0 conn(0x7fc2e0069db0 legacy=0x7fc2e0160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2de59c700 1 -- 172.21.15.43:0/3009891478 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00ceed0 con 0x7fc2e015c420 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2de59c700 1 --2- 172.21.15.43:0/3009891478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e015c420 0x7fc2e00b1bb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00098f0 tx=0x7fc2d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c051fdb1902ca8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2dd59a700 1 -- 172.21.15.43:0/3009891478 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0011830 con 0x7fc2e015c420 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2dd59a700 1 -- 172.21.15.43:0/3009891478 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0011990 con 0x7fc2e015c420 2023-06-08T03:49:58.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.521+0000 7fc2dd59a700 1 -- 172.21.15.43:0/3009891478 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0011d20 con 0x7fc2e015c420 2023-06-08T03:49:58.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 -- 172.21.15.43:0/3009891478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e015c420 msgr2=0x7fc2e00b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/3009891478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e015c420 0x7fc2e00b1bb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00098f0 tx=0x7fc2d0009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:58.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 -- 172.21.15.43:0/3009891478 shutdown_connections 2023-06-08T03:49:58.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/3009891478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e015c420 0x7fc2e00b1bb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/3009891478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e0072090 0x7fc2e00cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 -- 172.21.15.43:0/3009891478 >> 172.21.15.43:0/3009891478 conn(0x7fc2e006aec0 msgr2=0x7fc2e006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:58.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 -- 172.21.15.43:0/3009891478 shutdown_connections 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.522+0000 7fc2e4e49700 1 -- 172.21.15.43:0/3009891478 wait complete. 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.523+0000 7fc2e4e49700 1 Processor -- start 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.523+0000 7fc2e4e49700 1 -- start start 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2e4e49700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0069db0 0x7fc2e00b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2e4e49700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 0x7fc2e015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2e4e49700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e015c420 0x7fc2e0153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2e4e49700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e015e3f0 con 0x7fc2e0072090 2023-06-08T03:49:58.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2e4e49700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e015e6d0 con 0x7fc2e0069db0 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2e4e49700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e015e9b0 con 0x7fc2e015c420 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 0x7fc2e015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 0x7fc2e015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60252/0 (socket says 172.21.15.43:60252) 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 -- 172.21.15.43:0/1014992765 learned_addr learned my addr 172.21.15.43:0/1014992765 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ded9d700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e015c420 0x7fc2e0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 -- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e015c420 msgr2=0x7fc2e0153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2de59c700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0069db0 0x7fc2e00b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e015c420 0x7fc2e0153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 -- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0069db0 msgr2=0x7fc2e00b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0069db0 0x7fc2e00b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ddd9b700 1 -- 172.21.15.43:0/1014992765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0009550 con 0x7fc2e0072090 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.524+0000 7fc2ded9d700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e015c420 0x7fc2e0153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.525+0000 7fc2ddd9b700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 0x7fc2e015da80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e980 tx=0x7fc2c800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.525+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8009710 con 0x7fc2e0072090 2023-06-08T03:49:58.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.525+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800c850 con 0x7fc2e0072090 2023-06-08T03:49:58.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.525+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e015ec90 con 0x7fc2e0072090 2023-06-08T03:49:58.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.525+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800cbe0 con 0x7fc2e0072090 2023-06-08T03:49:58.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.525+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00b3d10 con 0x7fc2e0072090 2023-06-08T03:49:58.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.526+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e00737c0 con 0x7fc2e0072090 2023-06-08T03:49:58.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.526+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2c800cd40 con 0x7fc2e0072090 2023-06-08T03:49:58.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.526+0000 7fc2d6ffd700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2c006ace0 0x7fc2c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.527+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc2c8089400 con 0x7fc2e0072090 2023-06-08T03:49:58.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.527+0000 7fc2de59c700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2c006ace0 0x7fc2c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.527+0000 7fc2de59c700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2c006ace0 0x7fc2c006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0014040 tx=0x7fc2d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.531+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2c8058190 con 0x7fc2e0072090 2023-06-08T03:49:58.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.810+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc2e0073fa0 con 0x7fc2e0072090 2023-06-08T03:49:58.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.813+0000 7fc2d6ffd700 1 -- 172.21.15.43:0/1014992765 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc2c8057d20 con 0x7fc2e0072090 2023-06-08T03:49:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.815+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2c006ace0 msgr2=0x7fc2c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.815+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2c006ace0 0x7fc2c006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0014040 tx=0x7fc2d0008030 comp rx=0 tx=0).stop 2023-06-08T03:49:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.815+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 msgr2=0x7fc2e015da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.815+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 0x7fc2e015da80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e980 tx=0x7fc2c800ed40 comp rx=0 tx=0).stop 2023-06-08T03:49:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 shutdown_connections 2023-06-08T03:49:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc2c006ace0 0x7fc2c006d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2e015c420 0x7fc2e0153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2e0069db0 0x7fc2e00b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 --2- 172.21.15.43:0/1014992765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2e0072090 0x7fc2e015da80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 >> 172.21.15.43:0/1014992765 conn(0x7fc2e006aec0 msgr2=0x7fc2e0156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 shutdown_connections 2023-06-08T03:49:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.816+0000 7fc2e4e49700 1 -- 172.21.15.43:0/1014992765 wait complete. 2023-06-08T03:49:58.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-08T03:49:58.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.952+0000 7fca113e2700 1 Processor -- start 2023-06-08T03:49:58.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.952+0000 7fca113e2700 1 -- start start 2023-06-08T03:49:58.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca113e2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fca0c0cc730 0x7fca0c071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca113e2700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0ceb10 con 0x7fca0c159260 2023-06-08T03:49:58.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca113e2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c159630 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca113e2700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c0aeee0 con 0x7fca0c0cc730 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca0affd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fca0c159260 0x7fca0c0cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55162/0 (socket says 172.21.15.43:55162) 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca0affd700 1 -- 172.21.15.43:0/4255260085 learned_addr learned my addr 172.21.15.43:0/4255260085 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.953+0000 7fca0a7fc700 1 --2- 172.21.15.43:0/4255260085 >> v2:172.21.15.135:3300/0 conn(0x7fca0c0cc730 0x7fca0c071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca09ffb700 1 -- 172.21.15.43:0/4255260085 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193868098 0 0) 0x7fca00001110 con 0x7fca0c159260 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca09ffb700 1 -- 172.21.15.43:0/4255260085 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f40035b0 con 0x7fca0c159260 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca0a7fc700 1 -- 172.21.15.43:0/4255260085 >> v1:172.21.15.135:6789/0 conn(0x7fca0c0ca5f0 legacy=0x7fca0c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca0a7fc700 1 -- 172.21.15.43:0/4255260085 >> v1:172.21.15.43:6789/0 conn(0x7fca0c159260 legacy=0x7fca0c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca0a7fc700 1 -- 172.21.15.43:0/4255260085 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0ce680 con 0x7fca0c0cc730 2023-06-08T03:49:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca0a7fc700 1 --2- 172.21.15.43:0/4255260085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c0cc730 0x7fca0c071ce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009840 tx=0x7fc9fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b296ae70be9bcb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca09ffb700 1 -- 172.21.15.43:0/4255260085 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011830 con 0x7fca0c0cc730 2023-06-08T03:49:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca09ffb700 1 -- 172.21.15.43:0/4255260085 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc011990 con 0x7fca0c0cc730 2023-06-08T03:49:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.954+0000 7fca09ffb700 1 -- 172.21.15.43:0/4255260085 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011d20 con 0x7fca0c0cc730 2023-06-08T03:49:58.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 -- 172.21.15.43:0/4255260085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c0cc730 msgr2=0x7fca0c071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 --2- 172.21.15.43:0/4255260085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c0cc730 0x7fca0c071ce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009840 tx=0x7fc9fc009b50 comp rx=0 tx=0).stop 2023-06-08T03:49:58.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 -- 172.21.15.43:0/4255260085 shutdown_connections 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 --2- 172.21.15.43:0/4255260085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c0cc730 0x7fca0c071ce0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 -- 172.21.15.43:0/4255260085 >> 172.21.15.43:0/4255260085 conn(0x7fca0c06aec0 msgr2=0x7fca0c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 -- 172.21.15.43:0/4255260085 shutdown_connections 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.955+0000 7fca113e2700 1 -- 172.21.15.43:0/4255260085 wait complete. 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.956+0000 7fca113e2700 1 Processor -- start 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.956+0000 7fca113e2700 1 -- start start 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca113e2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 0x7fca0c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca113e2700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca0c0cc730 0x7fca0c156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca113e2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c159260 0x7fca0c156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca113e2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0c96d0 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca113e2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0c99b0 con 0x7fca0c159260 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca113e2700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0c3780 con 0x7fca0c0cc730 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 0x7fca0c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 0x7fca0c0c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60264/0 (socket says 172.21.15.43:60264) 2023-06-08T03:49:58.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 -- 172.21.15.43:0/512026538 learned_addr learned my addr 172.21.15.43:0/512026538 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 -- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca0c0cc730 msgr2=0x7fca0c156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0a7fc700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca0c0cc730 0x7fca0c156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0b7fe700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c159260 0x7fca0c156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca0c0cc730 0x7fca0c156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 -- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c159260 msgr2=0x7fca0c156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c159260 0x7fca0c156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.957+0000 7fca0affd700 1 -- 172.21.15.43:0/512026538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0094a0 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.958+0000 7fca0affd700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 0x7fca0c0c69c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fca00007fd0 tx=0x7fca0000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.958+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00005d70 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.958+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca000070d0 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.958+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c0c3a60 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.958+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00007460 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.958+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c0c61b0 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.959+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c0c3f80 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.959+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca000075c0 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.960+0000 7fc9f37fe700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc9f806ace0 0x7fc9f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.960+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fca000886e0 con 0x7fca0c0ca5f0 2023-06-08T03:49:58.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.960+0000 7fca0a7fc700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc9f806ace0 0x7fc9f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:58.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.961+0000 7fca0a7fc700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc9f806ace0 0x7fc9f806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0ccb20 tx=0x7fc9fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:58.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:58.964+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca0c0c3f80 con 0x7fca0c0ca5f0 2023-06-08T03:49:59.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.243+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fca0c0ceb10 con 0x7fca0c0ca5f0 2023-06-08T03:49:59.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.247+0000 7fc9f37fe700 1 -- 172.21.15.43:0/512026538 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fca0c0ceb10 con 0x7fca0c0ca5f0 2023-06-08T03:49:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc9f806ace0 msgr2=0x7fc9f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc9f806ace0 0x7fc9f806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0ccb20 tx=0x7fc9fc008030 comp rx=0 tx=0).stop 2023-06-08T03:49:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 msgr2=0x7fca0c0c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 0x7fca0c0c69c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fca00007fd0 tx=0x7fca0000c860 comp rx=0 tx=0).stop 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 shutdown_connections 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fc9f806ace0 0x7fc9f806d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca0c0ca5f0 0x7fca0c0c69c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c159260 0x7fca0c156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 --2- 172.21.15.43:0/512026538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca0c0cc730 0x7fca0c156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 >> 172.21.15.43:0/512026538 conn(0x7fca0c06aec0 msgr2=0x7fca0c0b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 shutdown_connections 2023-06-08T03:49:59.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.249+0000 7fca113e2700 1 -- 172.21.15.43:0/512026538 wait complete. 2023-06-08T03:49:59.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-08T03:49:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.386+0000 7f65cfb3d700 1 Processor -- start 2023-06-08T03:49:59.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.386+0000 7f65cfb3d700 1 -- start start 2023-06-08T03:49:59.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cfb3d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65c8071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cfb3d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65c80ca5f0 0x7f65c80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cfb3d700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c80ceb10 con 0x7f65c8159260 2023-06-08T03:49:59.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cfb3d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80aeee0 con 0x7f65c80ca5f0 2023-06-08T03:49:59.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cfb3d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8159630 con 0x7f65c80cc730 2023-06-08T03:49:59.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cd8d9700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f65c8159260 0x7f65c80cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55176/0 (socket says 172.21.15.43:55176) 2023-06-08T03:49:59.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cd8d9700 1 -- 172.21.15.43:0/3889206487 learned_addr learned my addr 172.21.15.43:0/3889206487 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65c8071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65ce0da700 1 --2- 172.21.15.43:0/3889206487 >> v2:172.21.15.135:3300/0 conn(0x7f65c80ca5f0 0x7f65c80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.387+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879645555 0 0) 0x7f65b8001110 con 0x7f65c8159260 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b40035b0 con 0x7f65c8159260 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4022969215 0 0) 0x7f65b40035b0 con 0x7f65c8159260 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 msgr2=0x7f65c8071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65c8071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 >> v2:172.21.15.135:3300/0 conn(0x7f65c80ca5f0 msgr2=0x7f65c80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:59.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 --2- 172.21.15.43:0/3889206487 >> v2:172.21.15.135:3300/0 conn(0x7f65c80ca5f0 0x7f65c80716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80ce680 con 0x7f65c8159260 2023-06-08T03:49:59.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f65b8001800 con 0x7f65c8159260 2023-06-08T03:49:59.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65c8071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:49:59.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 >> v1:172.21.15.43:6789/0 conn(0x7f65c8159260 legacy=0x7f65c80cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b4003a00 0x7f65b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b4004850 0x7f65b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80aeee0 con 0x7f65b4004850 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8159630 con 0x7f65b4003a00 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b400ba40 con 0x7f65c80cc730 2023-06-08T03:49:59.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b4004850 0x7f65b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd8d9700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b4003a00 0x7f65b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65ce0da700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 msgr2=0x7f65b4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65c80cc730 0x7f65b4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b4003a00 msgr2=0x7f65b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65b4003a00 0x7f65b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3889206487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40094a0 con 0x7f65b4004850 2023-06-08T03:49:59.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.388+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b4004850 0x7f65b4004cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009d00 tx=0x7f65b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446064769746fa7d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4009e50 con 0x7f65b4004850 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400e940 con 0x7f65b4004850 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cc8d7700 1 -- 172.21.15.43:0/3889206487 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400ecd0 con 0x7f65b4004850 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3889206487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b4004850 msgr2=0x7f65b4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3889206487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65b4004850 0x7f65b4004cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009d00 tx=0x7f65b4005880 comp rx=0 tx=0).stop 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65ce0da700 1 -- 172.21.15.43:0/3889206487 reap_dead start 2023-06-08T03:49:59.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3889206487 shutdown_connections 2023-06-08T03:49:59.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3889206487 >> 172.21.15.43:0/3889206487 conn(0x7f65c806aec0 msgr2=0x7f65c806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:59.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3889206487 shutdown_connections 2023-06-08T03:49:59.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.389+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3889206487 wait complete. 2023-06-08T03:49:59.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.391+0000 7f65cfb3d700 1 Processor -- start 2023-06-08T03:49:59.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.391+0000 7f65cfb3d700 1 -- start start 2023-06-08T03:49:59.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cfb3d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b4004850 0x7f65c80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cfb3d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 0x7f65c80adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cfb3d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c8069db0 0x7f65c806a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cfb3d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c806a790 con 0x7f65c80c8e00 2023-06-08T03:49:59.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cfb3d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80abfd0 con 0x7f65c8069db0 2023-06-08T03:49:59.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cfb3d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80ac2b0 con 0x7f65b4004850 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 0x7f65c80adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 0x7f65c80adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60284/0 (socket says 172.21.15.43:60284) 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3050418688 learned_addr learned my addr 172.21.15.43:0/3050418688 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd8d9700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b4004850 0x7f65c80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65ce0da700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c8069db0 0x7f65c806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b4004850 msgr2=0x7f65c80ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b4004850 0x7f65c80ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c8069db0 msgr2=0x7f65c806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c8069db0 0x7f65c806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 -- 172.21.15.43:0/3050418688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80ac590 con 0x7f65c80c8e00 2023-06-08T03:49:59.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65ce0da700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c8069db0 0x7f65c806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:49:59.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.392+0000 7f65cd0d8700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 0x7f65c80adf00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f65b4004770 tx=0x7f65c40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:59.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.393+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4021070 con 0x7f65c80c8e00 2023-06-08T03:49:59.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.393+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4009e50 con 0x7f65c80c8e00 2023-06-08T03:49:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.393+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c80ac870 con 0x7f65c80c8e00 2023-06-08T03:49:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.393+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400eea0 con 0x7f65c80c8e00 2023-06-08T03:49:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.393+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c80c69d0 con 0x7f65c80c8e00 2023-06-08T03:49:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.394+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c80737c0 con 0x7f65c80c8e00 2023-06-08T03:49:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.394+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65c4025070 con 0x7f65c80c8e00 2023-06-08T03:49:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.394+0000 7f65be7fc700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f65ac06ace0 0x7f65ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.394+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f65c408a490 con 0x7f65c80c8e00 2023-06-08T03:49:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.395+0000 7f65cd8d9700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f65ac06ace0 0x7f65ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.395+0000 7f65cd8d9700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f65ac06ace0 0x7f65ac06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65b8001eb0 tx=0x7f65b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.399+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f65c40557e0 con 0x7f65c80c8e00 2023-06-08T03:49:59.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.673+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f65c8073fa0 con 0x7f65c80c8e00 2023-06-08T03:49:59.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.677+0000 7f65be7fc700 1 -- 172.21.15.43:0/3050418688 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65c4058e00 con 0x7f65c80c8e00 2023-06-08T03:49:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f65ac06ace0 msgr2=0x7f65ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f65ac06ace0 0x7f65ac06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65b8001eb0 tx=0x7f65b8009040 comp rx=0 tx=0).stop 2023-06-08T03:49:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 msgr2=0x7f65c80adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 0x7f65c80adf00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f65b4004770 tx=0x7f65c40047c0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 shutdown_connections 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f65ac06ace0 0x7f65ac06d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c8069db0 0x7f65c806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65b4004850 0x7f65c80ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 --2- 172.21.15.43:0/3050418688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c80c8e00 0x7f65c80adf00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 >> 172.21.15.43:0/3050418688 conn(0x7f65c806aec0 msgr2=0x7f65c80ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 shutdown_connections 2023-06-08T03:49:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.679+0000 7f65cfb3d700 1 -- 172.21.15.43:0/3050418688 wait complete. 2023-06-08T03:49:59.695 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-08T03:49:59.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.816+0000 7fd48fbed700 1 Processor -- start 2023-06-08T03:49:59.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.816+0000 7fd48fbed700 1 -- start start 2023-06-08T03:49:59.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48fbed700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd48815c420 0x7fd4880b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48fbed700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd488069db0 0x7fd48806a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48fbed700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48806a730 con 0x7fd488072090 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48fbed700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4880b20f0 con 0x7fd48815c420 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48fbed700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd488071850 con 0x7fd488069db0 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd48815c420 0x7fd4880b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd48815c420 0x7fd4880b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60290/0 (socket says 172.21.15.43:60290) 2023-06-08T03:49:59.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 -- 172.21.15.43:0/1753965745 learned_addr learned my addr 172.21.15.43:0/1753965745 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48e18a700 1 --2- 172.21.15.43:0/1753965745 >> v2:172.21.15.135:3300/0 conn(0x7fd488069db0 0x7fd48806a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 -- 172.21.15.43:0/1753965745 >> v2:172.21.15.135:3300/0 conn(0x7fd488069db0 msgr2=0x7fd48806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 --2- 172.21.15.43:0/1753965745 >> v2:172.21.15.135:3300/0 conn(0x7fd488069db0 0x7fd48806a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 -- 172.21.15.43:0/1753965745 >> v1:172.21.15.135:6789/0 conn(0x7fd488072090 legacy=0x7fd4880cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 -- 172.21.15.43:0/1753965745 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880cec30 con 0x7fd48815c420 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.817+0000 7fd48d989700 1 --2- 172.21.15.43:0/1753965745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd48815c420 0x7fd4880b1bb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd4840098f0 tx=0x7fd484009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f017ac95842c2c20 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48c987700 1 -- 172.21.15.43:0/1753965745 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484011830 con 0x7fd48815c420 2023-06-08T03:49:59.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48c987700 1 -- 172.21.15.43:0/1753965745 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484011990 con 0x7fd48815c420 2023-06-08T03:49:59.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48c987700 1 -- 172.21.15.43:0/1753965745 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484011d20 con 0x7fd48815c420 2023-06-08T03:49:59.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 -- 172.21.15.43:0/1753965745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd48815c420 msgr2=0x7fd4880b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1753965745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd48815c420 0x7fd4880b1bb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd4840098f0 tx=0x7fd484009c00 comp rx=0 tx=0).stop 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 -- 172.21.15.43:0/1753965745 shutdown_connections 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1753965745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd48815c420 0x7fd4880b1bb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1753965745 >> v2:172.21.15.135:3300/0 conn(0x7fd488069db0 0x7fd48806a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 -- 172.21.15.43:0/1753965745 >> 172.21.15.43:0/1753965745 conn(0x7fd48806aec0 msgr2=0x7fd48806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 -- 172.21.15.43:0/1753965745 shutdown_connections 2023-06-08T03:49:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.818+0000 7fd48fbed700 1 -- 172.21.15.43:0/1753965745 wait complete. 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.819+0000 7fd48fbed700 1 Processor -- start 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.819+0000 7fd48fbed700 1 -- start start 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48fbed700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd488069db0 0x7fd4881f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48fbed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 0x7fd4880c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48fbed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd48815c420 0x7fd4880c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48fbed700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880c4d60 con 0x7fd488072090 2023-06-08T03:49:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48fbed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48815e260 con 0x7fd48815c420 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48fbed700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880c3cc0 con 0x7fd488069db0 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48d188700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 0x7fd4880c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48d188700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 0x7fd4880c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60296/0 (socket says 172.21.15.43:60296) 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48d188700 1 -- 172.21.15.43:0/1469570582 learned_addr learned my addr 172.21.15.43:0/1469570582 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48d989700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd488069db0 0x7fd4881f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.820+0000 7fd48e18a700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd48815c420 0x7fd4880c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48d188700 1 -- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd488069db0 msgr2=0x7fd4881f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48d188700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd488069db0 0x7fd4881f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48d188700 1 -- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd48815c420 msgr2=0x7fd4880c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48d188700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd48815c420 0x7fd4880c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48d188700 1 -- 172.21.15.43:0/1469570582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009550 con 0x7fd488072090 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48d188700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 0x7fd4880c3150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd47800c4e0 tx=0x7fd47800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4780052d0 con 0x7fd488072090 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd478005430 con 0x7fd488072090 2023-06-08T03:49:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880c3fa0 con 0x7fd488072090 2023-06-08T03:49:59.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4780038c0 con 0x7fd488072090 2023-06-08T03:49:59.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.821+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4880c4560 con 0x7fd488072090 2023-06-08T03:49:59.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.822+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd488073fa0 con 0x7fd488072090 2023-06-08T03:49:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.822+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd478003a20 con 0x7fd488072090 2023-06-08T03:49:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.823+0000 7fd47e7fc700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:49:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.823+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd4780885c0 con 0x7fd488072090 2023-06-08T03:49:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.823+0000 7fd48d989700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:49:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.824+0000 7fd48d989700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd46c06ace0 0x7fd46c06d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd484014040 tx=0x7fd484008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:49:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:49:59.827+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd478053910 con 0x7fd488072090 2023-06-08T03:50:00.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.106+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd4880b55d0 con 0x7fd488072090 2023-06-08T03:50:00.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.110+0000 7fd47e7fc700 1 -- 172.21.15.43:0/1469570582 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd478056f30 con 0x7fd488072090 2023-06-08T03:50:00.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd46c06ace0 msgr2=0x7fd46c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd46c06ace0 0x7fd46c06d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd484014040 tx=0x7fd484008030 comp rx=0 tx=0).stop 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 msgr2=0x7fd4880c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 0x7fd4880c3150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd47800c4e0 tx=0x7fd47800c7f0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 shutdown_connections 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd48815c420 0x7fd4880c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd488069db0 0x7fd4881f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 --2- 172.21.15.43:0/1469570582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd488072090 0x7fd4880c3150 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 >> 172.21.15.43:0/1469570582 conn(0x7fd48806aec0 msgr2=0x7fd4880cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:00.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 shutdown_connections 2023-06-08T03:50:00.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.112+0000 7fd48fbed700 1 -- 172.21.15.43:0/1469570582 wait complete. 2023-06-08T03:50:00.128 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:50:00.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.250+0000 7fb767ee8700 1 Processor -- start 2023-06-08T03:50:00.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.250+0000 7fb767ee8700 1 -- start start 2023-06-08T03:50:00.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb767ee8700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb76015d280 0x7fb7600af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb767ee8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb76015d650 0x7fb76015da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb767ee8700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76015e8c0 con 0x7fb76015dfd0 2023-06-08T03:50:00.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb767ee8700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76015e470 con 0x7fb76015d280 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb767ee8700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7600afeb0 con 0x7fb76015d650 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb765c84700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb76015d280 0x7fb7600af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb765c84700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb76015d280 0x7fb7600af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60302/0 (socket says 172.21.15.43:60302) 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb765c84700 1 -- 172.21.15.43:0/2627031897 learned_addr learned my addr 172.21.15.43:0/2627031897 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.251+0000 7fb765483700 1 --2- 172.21.15.43:0/2627031897 >> v2:172.21.15.135:3300/0 conn(0x7fb76015d650 0x7fb76015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb765c84700 1 -- 172.21.15.43:0/2627031897 >> v2:172.21.15.135:3300/0 conn(0x7fb76015d650 msgr2=0x7fb76015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:00.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb765c84700 1 --2- 172.21.15.43:0/2627031897 >> v2:172.21.15.135:3300/0 conn(0x7fb76015d650 0x7fb76015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb765c84700 1 -- 172.21.15.43:0/2627031897 >> v1:172.21.15.135:6789/0 conn(0x7fb76015dfd0 legacy=0x7fb7600b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb765c84700 1 -- 172.21.15.43:0/2627031897 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600b3fa0 con 0x7fb76015d280 2023-06-08T03:50:00.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb765c84700 1 --2- 172.21.15.43:0/2627031897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d280 0x7fb7600af970 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb7600cc0b0 tx=0x7fb750009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d046ef1900de4e5b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb764c82700 1 -- 172.21.15.43:0/2627031897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750011830 con 0x7fb76015d280 2023-06-08T03:50:00.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb764c82700 1 -- 172.21.15.43:0/2627031897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750011990 con 0x7fb76015d280 2023-06-08T03:50:00.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.252+0000 7fb764c82700 1 -- 172.21.15.43:0/2627031897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750011d20 con 0x7fb76015d280 2023-06-08T03:50:00.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 -- 172.21.15.43:0/2627031897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d280 msgr2=0x7fb7600af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 --2- 172.21.15.43:0/2627031897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d280 0x7fb7600af970 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb7600cc0b0 tx=0x7fb750009bd0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 -- 172.21.15.43:0/2627031897 shutdown_connections 2023-06-08T03:50:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 --2- 172.21.15.43:0/2627031897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d280 0x7fb7600af970 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 --2- 172.21.15.43:0/2627031897 >> v2:172.21.15.135:3300/0 conn(0x7fb76015d650 0x7fb76015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 -- 172.21.15.43:0/2627031897 >> 172.21.15.43:0/2627031897 conn(0x7fb760069db0 msgr2=0x7fb76006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 -- 172.21.15.43:0/2627031897 shutdown_connections 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.253+0000 7fb767ee8700 1 -- 172.21.15.43:0/2627031897 wait complete. 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.254+0000 7fb767ee8700 1 Processor -- start 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.254+0000 7fb767ee8700 1 -- start start 2023-06-08T03:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb767ee8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76015d280 0x7fb760152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb767ee8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 0x7fb7600c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb767ee8700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb76015dfd0 0x7fb7600c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb767ee8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600c5aa0 con 0x7fb76015d650 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb767ee8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb760152a80 con 0x7fb76015d280 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb767ee8700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600c5540 con 0x7fb76015dfd0 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 0x7fb7600c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 0x7fb7600c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60308/0 (socket says 172.21.15.43:60308) 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 -- 172.21.15.43:0/65858833 learned_addr learned my addr 172.21.15.43:0/65858833 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb766485700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb76015dfd0 0x7fb7600c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765c84700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76015d280 0x7fb760152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 -- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb76015dfd0 msgr2=0x7fb7600c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb76015dfd0 0x7fb7600c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 -- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76015d280 msgr2=0x7fb760152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76015d280 0x7fb760152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765483700 1 -- 172.21.15.43:0/65858833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750009550 con 0x7fb76015d650 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.255+0000 7fb765c84700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76015d280 0x7fb760152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.256+0000 7fb765483700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 0x7fb7600c4bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e980 tx=0x7fb75c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.256+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c009710 con 0x7fb76015d650 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.256+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c00eed0 con 0x7fb76015d650 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.256+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00ca90 con 0x7fb76015d650 2023-06-08T03:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.256+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7600c5cf0 con 0x7fb76015d650 2023-06-08T03:50:00.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.256+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7600c62b0 con 0x7fb76015d650 2023-06-08T03:50:00.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.257+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7600c6620 con 0x7fb76015d650 2023-06-08T03:50:00.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.257+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb75c00cbf0 con 0x7fb76015d650 2023-06-08T03:50:00.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.258+0000 7fb7567fc700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb74406ace0 0x7fb74406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.258+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb75c089340 con 0x7fb76015d650 2023-06-08T03:50:00.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.258+0000 7fb765c84700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb74406ace0 0x7fb74406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.258+0000 7fb765c84700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb74406ace0 0x7fb74406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb750009c10 tx=0x7fb750008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.262+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb75c054600 con 0x7fb76015d650 2023-06-08T03:50:00.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.460+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb760073fa0 con 0x7fb76015d650 2023-06-08T03:50:00.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.461+0000 7fb7567fc700 1 -- 172.21.15.43:0/65858833 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14786 (secure 0 0 0) 0x7fb75c057c20 con 0x7fb76015d650 2023-06-08T03:50:00.465 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:00.466 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":36,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:49:57.046066+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:50:00.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb74406ace0 msgr2=0x7fb74406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb74406ace0 0x7fb74406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb750009c10 tx=0x7fb750008030 comp rx=0 tx=0).stop 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 msgr2=0x7fb7600c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 0x7fb7600c4bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e980 tx=0x7fb75c00ec90 comp rx=0 tx=0).stop 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 shutdown_connections 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb74406ace0 0x7fb74406d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb76015dfd0 0x7fb7600c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76015d280 0x7fb760152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 --2- 172.21.15.43:0/65858833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76015d650 0x7fb7600c4bf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 >> 172.21.15.43:0/65858833 conn(0x7fb760069db0 msgr2=0x7fb7600b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 shutdown_connections 2023-06-08T03:50:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.463+0000 7fb767ee8700 1 -- 172.21.15.43:0/65858833 wait complete. 2023-06-08T03:50:00.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T03:50:00.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T03:50:00.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.605+0000 7fcbd8c7d700 1 Processor -- start 2023-06-08T03:50:00.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.605+0000 7fcbd8c7d700 1 -- start start 2023-06-08T03:50:00.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd8c7d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbd415c300 0x7fcbd4071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd8c7d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcbd4069db0 0x7fcbd406a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd8c7d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40cf4c0 con 0x7fcbd415c6d0 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd8c7d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40b2090 con 0x7fcbd415c300 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd8c7d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd406a730 con 0x7fcbd4069db0 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbd415c300 0x7fcbd4071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbd415c300 0x7fcbd4071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60316/0 (socket says 172.21.15.43:60316) 2023-06-08T03:50:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 -- 172.21.15.43:0/3348804674 learned_addr learned my addr 172.21.15.43:0/3348804674 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd2d9d700 1 --2- 172.21.15.43:0/3348804674 >> v2:172.21.15.135:3300/0 conn(0x7fcbd4069db0 0x7fcbd406a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 -- 172.21.15.43:0/3348804674 >> v2:172.21.15.135:3300/0 conn(0x7fcbd4069db0 msgr2=0x7fcbd406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 --2- 172.21.15.43:0/3348804674 >> v2:172.21.15.135:3300/0 conn(0x7fcbd4069db0 0x7fcbd406a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 -- 172.21.15.43:0/3348804674 >> v1:172.21.15.135:6789/0 conn(0x7fcbd415c6d0 legacy=0x7fcbd40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 -- 172.21.15.43:0/3348804674 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40cd910 con 0x7fcbd415c300 2023-06-08T03:50:00.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd2d9d700 1 --2- 172.21.15.43:0/3348804674 >> v2:172.21.15.135:3300/0 conn(0x7fcbd4069db0 0x7fcbd406a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:00.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd259c700 1 --2- 172.21.15.43:0/3348804674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd415c300 0x7fcbd4071fc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcbd406bc90 tx=0x7fcbc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56927e38fcf106e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.606+0000 7fcbd159a700 1 -- 172.21.15.43:0/3348804674 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4004230 con 0x7fcbd415c300 2023-06-08T03:50:00.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd159a700 1 -- 172.21.15.43:0/3348804674 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4004390 con 0x7fcbd415c300 2023-06-08T03:50:00.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd159a700 1 -- 172.21.15.43:0/3348804674 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40036a0 con 0x7fcbd415c300 2023-06-08T03:50:00.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/3348804674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd415c300 msgr2=0x7fcbd4071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/3348804674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd415c300 0x7fcbd4071fc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcbd406bc90 tx=0x7fcbc4009bd0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/3348804674 shutdown_connections 2023-06-08T03:50:00.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/3348804674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd415c300 0x7fcbd4071fc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/3348804674 >> v2:172.21.15.135:3300/0 conn(0x7fcbd4069db0 0x7fcbd406a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/3348804674 >> 172.21.15.43:0/3348804674 conn(0x7fcbd406aec0 msgr2=0x7fcbd406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/3348804674 shutdown_connections 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.607+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/3348804674 wait complete. 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.608+0000 7fcbd8c7d700 1 Processor -- start 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 -- start start 2023-06-08T03:50:00.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 0x7fcbd40b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbd415c300 0x7fcbd41521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbd415c6d0 0x7fcbd40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40b5460 con 0x7fcbd4069db0 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40b2510 con 0x7fcbd415c6d0 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd8c7d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4152730 con 0x7fcbd415c300 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 0x7fcbd40b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 0x7fcbd40b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60322/0 (socket says 172.21.15.43:60322) 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.609+0000 7fcbd259c700 1 -- 172.21.15.43:0/809098731 learned_addr learned my addr 172.21.15.43:0/809098731 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd2d9d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbd415c6d0 0x7fcbd40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd1d9b700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbd415c300 0x7fcbd41521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd259c700 1 -- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbd415c300 msgr2=0x7fcbd41521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd259c700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbd415c300 0x7fcbd41521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd259c700 1 -- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbd415c6d0 msgr2=0x7fcbd40c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd259c700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbd415c6d0 0x7fcbd40c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd259c700 1 -- 172.21.15.43:0/809098731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009550 con 0x7fcbd4069db0 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd2d9d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbd415c6d0 0x7fcbd40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd259c700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 0x7fcbd40b4f20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009fd0 tx=0x7fcbc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4003d70 con 0x7fcbd4069db0 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc401f070 con 0x7fcbd4069db0 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd40c3ea0 con 0x7fcbd4069db0 2023-06-08T03:50:00.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011870 con 0x7fcbd4069db0 2023-06-08T03:50:00.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.610+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40c4460 con 0x7fcbd4069db0 2023-06-08T03:50:00.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.611+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4073fa0 con 0x7fcbd4069db0 2023-06-08T03:50:00.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.612+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbc4021030 con 0x7fcbd4069db0 2023-06-08T03:50:00.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.612+0000 7fcbc2ffd700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcbb406ace0 0x7fcbb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.612+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcbc408a970 con 0x7fcbd4069db0 2023-06-08T03:50:00.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.612+0000 7fcbd1d9b700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcbb406ace0 0x7fcbb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.613+0000 7fcbd1d9b700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcbb406ace0 0x7fcbb406d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbd41f5470 tx=0x7fcbc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.616+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbc4055cc0 con 0x7fcbd4069db0 2023-06-08T03:50:00.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.809+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcbd40c5260 con 0x7fcbd4069db0 2023-06-08T03:50:00.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.810+0000 7fcbc2ffd700 1 -- 172.21.15.43:0/809098731 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcbc4029020 con 0x7fcbd4069db0 2023-06-08T03:50:00.814 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T03:50:00.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcbb406ace0 msgr2=0x7fcbb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcbb406ace0 0x7fcbb406d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbd41f5470 tx=0x7fcbc8008040 comp rx=0 tx=0).stop 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 msgr2=0x7fcbd40b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 0x7fcbd40b4f20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009fd0 tx=0x7fcbc4004750 comp rx=0 tx=0).stop 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 shutdown_connections 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fcbb406ace0 0x7fcbb406d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd4069db0 0x7fcbd40b4f20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbd415c6d0 0x7fcbd40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 --2- 172.21.15.43:0/809098731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbd415c300 0x7fcbd41521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 >> 172.21.15.43:0/809098731 conn(0x7fcbd406aec0 msgr2=0x7fcbd4071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:00.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 shutdown_connections 2023-06-08T03:50:00.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.812+0000 7fcbd8c7d700 1 -- 172.21.15.43:0/809098731 wait complete. 2023-06-08T03:50:00.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T03:50:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.951+0000 7efcf6295700 1 Processor -- start 2023-06-08T03:50:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.951+0000 7efcf6295700 1 -- start start 2023-06-08T03:50:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcf6295700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c300 0x7efcf0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcf6295700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcf6295700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf00b2090 con 0x7efcf0069db0 2023-06-08T03:50:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcf6295700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf00cd910 con 0x7efcf015c6d0 2023-06-08T03:50:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcf6295700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00b1db0 con 0x7efcf015c300 2023-06-08T03:50:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcef7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcef7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60330/0 (socket says 172.21.15.43:60330) 2023-06-08T03:50:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efcef7fe700 1 -- 172.21.15.43:0/1611659318 learned_addr learned my addr 172.21.15.43:0/1611659318 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.952+0000 7efceffff700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c300 0x7efcf0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcef7fe700 1 -- 172.21.15.43:0/1611659318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c300 msgr2=0x7efcf0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcef7fe700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c300 0x7efcf0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcef7fe700 1 -- 172.21.15.43:0/1611659318 >> v1:172.21.15.135:6789/0 conn(0x7efcf0069db0 legacy=0x7efcf00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcef7fe700 1 -- 172.21.15.43:0/1611659318 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00cd350 con 0x7efcf015c6d0 2023-06-08T03:50:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efceffff700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c300 0x7efcf0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcef7fe700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098f0 tx=0x7efcd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5107fc6483dc72 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efceeffd700 1 -- 172.21.15.43:0/1611659318 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800b8a0 con 0x7efcf015c6d0 2023-06-08T03:50:00.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efceeffd700 1 -- 172.21.15.43:0/1611659318 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd800ba00 con 0x7efcf015c6d0 2023-06-08T03:50:00.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efceeffd700 1 -- 172.21.15.43:0/1611659318 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800bd90 con 0x7efcf015c6d0 2023-06-08T03:50:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcf6295700 1 -- 172.21.15.43:0/1611659318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf015c6d0 msgr2=0x7efcf00cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.953+0000 7efcf6295700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098f0 tx=0x7efcd8009c00 comp rx=0 tx=0).stop 2023-06-08T03:50:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.954+0000 7efcf6295700 1 -- 172.21.15.43:0/1611659318 shutdown_connections 2023-06-08T03:50:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.954+0000 7efcf6295700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c300 0x7efcf0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.954+0000 7efcf6295700 1 --2- 172.21.15.43:0/1611659318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.954+0000 7efcf6295700 1 -- 172.21.15.43:0/1611659318 >> 172.21.15.43:0/1611659318 conn(0x7efcf006aec0 msgr2=0x7efcf006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.954+0000 7efcf6295700 1 -- 172.21.15.43:0/1611659318 shutdown_connections 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.954+0000 7efcf6295700 1 -- 172.21.15.43:0/1611659318 wait complete. 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.955+0000 7efcf6295700 1 Processor -- start 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.955+0000 7efcf6295700 1 -- start start 2023-06-08T03:50:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 0x7efcf01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf015c300 0x7efcf0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00acb80 con 0x7efcf0069db0 2023-06-08T03:50:00.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf01551d0 con 0x7efcf015c300 2023-06-08T03:50:00.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf01545f0 con 0x7efcf015c6d0 2023-06-08T03:50:00.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 0x7efcf01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 0x7efcf01548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60336/0 (socket says 172.21.15.43:60336) 2023-06-08T03:50:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 -- 172.21.15.43:0/2054669965 learned_addr learned my addr 172.21.15.43:0/2054669965 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf4832700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcef7fe700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf015c300 0x7efcf0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 -- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c6d0 msgr2=0x7efcf00cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 -- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf015c300 msgr2=0x7efcf0153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf015c300 0x7efcf0153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 -- 172.21.15.43:0/2054669965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009550 con 0x7efcf0069db0 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efceffff700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 0x7efcf01548d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efce000e810 tx=0x7efce000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0013610 con 0x7efcf0069db0 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0013770 con 0x7efcf0069db0 2023-06-08T03:50:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.956+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf00acd90 con 0x7efcf0069db0 2023-06-08T03:50:00.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.957+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0013b20 con 0x7efcf0069db0 2023-06-08T03:50:00.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.957+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf00ad350 con 0x7efcf0069db0 2023-06-08T03:50:00.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.957+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf00ad6c0 con 0x7efcf0069db0 2023-06-08T03:50:00.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.958+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efce0013c80 con 0x7efcf0069db0 2023-06-08T03:50:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.959+0000 7efcecff9700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efcd006ace0 0x7efcd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.959+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efce0088d40 con 0x7efcf0069db0 2023-06-08T03:50:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.959+0000 7efcef7fe700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efcd006ace0 0x7efcd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.959+0000 7efcef7fe700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efcd006ace0 0x7efcd006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efcd8014040 tx=0x7efcd8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:00.963+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efce0057b20 con 0x7efcf0069db0 2023-06-08T03:50:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.158+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcf00b1a20 con 0x7efcf0069db0 2023-06-08T03:50:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.158+0000 7efcecff9700 1 -- 172.21.15.43:0/2054669965 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7efce00576b0 con 0x7efcf0069db0 2023-06-08T03:50:01.163 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T03:50:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efcd006ace0 msgr2=0x7efcd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efcd006ace0 0x7efcd006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efcd8014040 tx=0x7efcd8008030 comp rx=0 tx=0).stop 2023-06-08T03:50:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 msgr2=0x7efcf01548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 0x7efcf01548d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efce000e810 tx=0x7efce000eb20 comp rx=0 tx=0).stop 2023-06-08T03:50:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 shutdown_connections 2023-06-08T03:50:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7efcd006ace0 0x7efcd006d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcf0069db0 0x7efcf01548d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcf015c6d0 0x7efcf00cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 --2- 172.21.15.43:0/2054669965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf015c300 0x7efcf0153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 >> 172.21.15.43:0/2054669965 conn(0x7efcf006aec0 msgr2=0x7efcf01570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 shutdown_connections 2023-06-08T03:50:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.160+0000 7efcf6295700 1 -- 172.21.15.43:0/2054669965 wait complete. 2023-06-08T03:50:01.176 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-08T03:50:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.296+0000 7fa668a50700 1 Processor -- start 2023-06-08T03:50:01.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.296+0000 7fa668a50700 1 -- start start 2023-06-08T03:50:01.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa668a50700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa66406b4b0 0x7fa664145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa668a50700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa6640d0e70 0x7fa6640caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa668a50700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6640d16e0 con 0x7fa664145cd0 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa668a50700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640cd050 con 0x7fa6640d0e70 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa668a50700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640cc1d0 con 0x7fa66406b4b0 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa662d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa6640d0e70 0x7fa6640caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa662d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa6640d0e70 0x7fa6640caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60346/0 (socket says 172.21.15.43:60346) 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.297+0000 7fa662d9d700 1 -- 172.21.15.43:0/2837972909 learned_addr learned my addr 172.21.15.43:0/2837972909 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa66259c700 1 --2- 172.21.15.43:0/2837972909 >> v2:172.21.15.135:3300/0 conn(0x7fa66406b4b0 0x7fa664145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa662d9d700 1 -- 172.21.15.43:0/2837972909 >> v2:172.21.15.135:3300/0 conn(0x7fa66406b4b0 msgr2=0x7fa664145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa662d9d700 1 --2- 172.21.15.43:0/2837972909 >> v2:172.21.15.135:3300/0 conn(0x7fa66406b4b0 0x7fa664145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa662d9d700 1 -- 172.21.15.43:0/2837972909 >> v1:172.21.15.135:6789/0 conn(0x7fa664145cd0 legacy=0x7fa6640d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa662d9d700 1 -- 172.21.15.43:0/2837972909 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640cd2a0 con 0x7fa6640d0e70 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa662d9d700 1 --2- 172.21.15.43:0/2837972909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6640caf20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6640ce2f0 tx=0x7fa65c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bba570c9e699153 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa66159a700 1 -- 172.21.15.43:0/2837972909 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00e070 con 0x7fa6640d0e70 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa66159a700 1 -- 172.21.15.43:0/2837972909 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c003a20 con 0x7fa6640d0e70 2023-06-08T03:50:01.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa66159a700 1 -- 172.21.15.43:0/2837972909 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c003dd0 con 0x7fa6640d0e70 2023-06-08T03:50:01.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa668a50700 1 -- 172.21.15.43:0/2837972909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 msgr2=0x7fa6640caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.298+0000 7fa668a50700 1 --2- 172.21.15.43:0/2837972909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6640caf20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6640ce2f0 tx=0x7fa65c00b330 comp rx=0 tx=0).stop 2023-06-08T03:50:01.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.299+0000 7fa668a50700 1 -- 172.21.15.43:0/2837972909 shutdown_connections 2023-06-08T03:50:01.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.299+0000 7fa668a50700 1 --2- 172.21.15.43:0/2837972909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6640caf20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.299+0000 7fa668a50700 1 --2- 172.21.15.43:0/2837972909 >> v2:172.21.15.135:3300/0 conn(0x7fa66406b4b0 0x7fa664145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.299+0000 7fa668a50700 1 -- 172.21.15.43:0/2837972909 >> 172.21.15.43:0/2837972909 conn(0x7fa66406a6d0 msgr2=0x7fa664099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.299+0000 7fa668a50700 1 -- 172.21.15.43:0/2837972909 shutdown_connections 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.299+0000 7fa668a50700 1 -- 172.21.15.43:0/2837972909 wait complete. 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.300+0000 7fa668a50700 1 Processor -- start 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.300+0000 7fa668a50700 1 -- start start 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa668a50700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66406b4b0 0x7fa66415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa668a50700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6641f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa668a50700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa664145cd0 0x7fa6641f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa668a50700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6641526b0 con 0x7fa6640d0e70 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa668a50700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6641f5900 con 0x7fa66406b4b0 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa668a50700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640c8a70 con 0x7fa664145cd0 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6641f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6641f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60352/0 (socket says 172.21.15.43:60352) 2023-06-08T03:50:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 -- 172.21.15.43:0/4287415581 learned_addr learned my addr 172.21.15.43:0/4287415581 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa66259c700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66406b4b0 0x7fa66415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa662d9d700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa664145cd0 0x7fa6641f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 -- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa664145cd0 msgr2=0x7fa6641f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa664145cd0 0x7fa6641f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 -- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66406b4b0 msgr2=0x7fa66415f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66406b4b0 0x7fa66415f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 -- 172.21.15.43:0/4287415581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c009b30 con 0x7fa6640d0e70 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa66259c700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66406b4b0 0x7fa66415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa661d9b700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6641f4ce0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c4d0 tx=0x7fa64c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c011790 con 0x7fa6640d0e70 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.301+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c0118f0 con 0x7fa6640d0e70 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.302+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6641f5b30 con 0x7fa6640d0e70 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.302+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c011ca0 con 0x7fa6640d0e70 2023-06-08T03:50:01.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.302+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6641f60f0 con 0x7fa6640d0e70 2023-06-08T03:50:01.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.302+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6641f62e0 con 0x7fa6640d0e70 2023-06-08T03:50:01.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.303+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa64c01c460 con 0x7fa6640d0e70 2023-06-08T03:50:01.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.303+0000 7fa65affd700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa64406ace0 0x7fa64406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.303+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa64c089120 con 0x7fa6640d0e70 2023-06-08T03:50:01.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.304+0000 7fa66259c700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa64406ace0 0x7fa64406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.304+0000 7fa66259c700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa64406ace0 0x7fa64406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa654009820 tx=0x7fa654008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:01.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.308+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa64c0543e0 con 0x7fa6640d0e70 2023-06-08T03:50:01.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.508+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa664073fa0 con 0x7fa6640d0e70 2023-06-08T03:50:01.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.509+0000 7fa65affd700 1 -- 172.21.15.43:0/4287415581 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa64c057a00 con 0x7fa6640d0e70 2023-06-08T03:50:01.513 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:01.513 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-06-08T03:50:01.513 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-06-08T03:50:01.514 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-06-08T03:50:01.515 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-06-08T03:50:01.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa64406ace0 msgr2=0x7fa64406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa64406ace0 0x7fa64406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa654009820 tx=0x7fa654008040 comp rx=0 tx=0).stop 2023-06-08T03:50:01.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 msgr2=0x7fa6641f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6641f4ce0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c4d0 tx=0x7fa64c00c890 comp rx=0 tx=0).stop 2023-06-08T03:50:01.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 shutdown_connections 2023-06-08T03:50:01.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa64406ace0 0x7fa64406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa664145cd0 0x7fa6641f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66406b4b0 0x7fa66415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 --2- 172.21.15.43:0/4287415581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6640d0e70 0x7fa6641f4ce0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 >> 172.21.15.43:0/4287415581 conn(0x7fa66406a6d0 msgr2=0x7fa6640cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:01.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 shutdown_connections 2023-06-08T03:50:01.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.511+0000 7fa668a50700 1 -- 172.21.15.43:0/4287415581 wait complete. 2023-06-08T03:50:01.527 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-08T03:50:01.528 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-08T03:50:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.652+0000 7ff10491a700 1 Processor -- start 2023-06-08T03:50:01.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.652+0000 7ff10491a700 1 -- start start 2023-06-08T03:50:01.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.653+0000 7ff10491a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.653+0000 7ff10491a700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000d09c0 con 0x7ff1000b5f60 2023-06-08T03:50:01.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.653+0000 7ff10491a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000d0f80 con 0x7ff1000b4650 2023-06-08T03:50:01.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.653+0000 7ff10491a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10015c6f0 con 0x7ff10015c320 2023-06-08T03:50:01.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.653+0000 7ff0fdd9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff1000b5f60 0x7ff1000d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55264/0 (socket says 172.21.15.43:55264) 2023-06-08T03:50:01.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.653+0000 7ff0fdd9b700 1 -- 172.21.15.43:0/164460262 learned_addr learned my addr 172.21.15.43:0/164460262 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fe59c700 1 --2- 172.21.15.43:0/164460262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fd59a700 1 -- 172.21.15.43:0/164460262 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111918849 0 0) 0x7ff1000d09c0 con 0x7ff1000b5f60 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fd59a700 1 -- 172.21.15.43:0/164460262 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e80035b0 con 0x7ff1000b5f60 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fd59a700 1 -- 172.21.15.43:0/164460262 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236251426 0 0) 0x7ff1000d0f80 con 0x7ff1000b4650 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fe59c700 1 -- 172.21.15.43:0/164460262 >> v1:172.21.15.135:6789/0 conn(0x7ff1000b4650 legacy=0x7ff1000cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fe59c700 1 -- 172.21.15.43:0/164460262 >> v1:172.21.15.43:6789/0 conn(0x7ff1000b5f60 legacy=0x7ff1000d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fe59c700 1 -- 172.21.15.43:0/164460262 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000cfde0 con 0x7ff10015c320 2023-06-08T03:50:01.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fe59c700 1 --2- 172.21.15.43:0/164460262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000b5a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009870 tx=0x7ff0f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b5ce85653d0e85 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:01.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fd59a700 1 -- 172.21.15.43:0/164460262 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4011830 con 0x7ff10015c320 2023-06-08T03:50:01.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fd59a700 1 -- 172.21.15.43:0/164460262 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4011990 con 0x7ff10015c320 2023-06-08T03:50:01.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.654+0000 7ff0fd59a700 1 -- 172.21.15.43:0/164460262 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4011d20 con 0x7ff10015c320 2023-06-08T03:50:01.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 -- 172.21.15.43:0/164460262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 msgr2=0x7ff1000b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 --2- 172.21.15.43:0/164460262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000b5a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009870 tx=0x7ff0f4009b80 comp rx=0 tx=0).stop 2023-06-08T03:50:01.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 -- 172.21.15.43:0/164460262 shutdown_connections 2023-06-08T03:50:01.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 --2- 172.21.15.43:0/164460262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000b5a20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 -- 172.21.15.43:0/164460262 >> 172.21.15.43:0/164460262 conn(0x7ff10006bdf0 msgr2=0x7ff1000714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:01.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 -- 172.21.15.43:0/164460262 shutdown_connections 2023-06-08T03:50:01.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.655+0000 7ff10491a700 1 -- 172.21.15.43:0/164460262 wait complete. 2023-06-08T03:50:01.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.656+0000 7ff10491a700 1 Processor -- start 2023-06-08T03:50:01.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.656+0000 7ff10491a700 1 -- start start 2023-06-08T03:50:01.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff10491a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1000b4650 0x7ff10014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff10491a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 0x7ff1001f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff10491a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff10491a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000ca700 con 0x7ff1000b5f60 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff10491a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c7780 con 0x7ff1000b4650 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff10491a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c9dd0 con 0x7ff10015c320 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 0x7ff1001f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 0x7ff1001f1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60366/0 (socket says 172.21.15.43:60366) 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 -- 172.21.15.43:0/3652303531 learned_addr learned my addr 172.21.15.43:0/3652303531 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fed9d700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fe59c700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1000b4650 0x7ff10014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 -- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 msgr2=0x7ff1000c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 -- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1000b4650 msgr2=0x7ff10014df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1000b4650 0x7ff10014df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.657+0000 7ff0fdd9b700 1 -- 172.21.15.43:0/3652303531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40094a0 con 0x7ff1000b5f60 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff0fed9d700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff0fe59c700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1000b4650 0x7ff10014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:01.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff0fdd9b700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 0x7ff1001f1d30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c420 tx=0x7ff0f000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0005d70 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f00070d0 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1000ca0b0 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0007440 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.658+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10014e4d0 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.659+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1000ca870 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.659+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0f00075a0 con 0x7ff1000b5f60 2023-06-08T03:50:01.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.660+0000 7ff0eeffd700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0e006ace0 0x7ff0e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:01.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.660+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff0f00885e0 con 0x7ff1000b5f60 2023-06-08T03:50:01.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.660+0000 7ff0fe59c700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0e006ace0 0x7ff0e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:01.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.660+0000 7ff0fe59c700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0e006ace0 0x7ff0e006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40097c0 tx=0x7ff0f401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:01.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.664+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0f0053940 con 0x7ff1000b5f60 2023-06-08T03:50:01.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:01.861+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff10004e090 con 0x7ff1000b5f60 2023-06-08T03:50:02.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.862+0000 7ff0eeffd700 1 -- 172.21.15.43:0/3652303531 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff0f0056f60 con 0x7ff1000b5f60 2023-06-08T03:50:02.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0e006ace0 msgr2=0x7ff0e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:02.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0e006ace0 0x7ff0e006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40097c0 tx=0x7ff0f401c040 comp rx=0 tx=0).stop 2023-06-08T03:50:02.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 msgr2=0x7ff1001f1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:02.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 0x7ff1001f1d30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c420 tx=0x7ff0f000c7e0 comp rx=0 tx=0).stop 2023-06-08T03:50:02.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 shutdown_connections 2023-06-08T03:50:02.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7ff0e006ace0 0x7ff0e006d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:02.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10015c320 0x7ff1000c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:02.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1000b4650 0x7ff10014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:02.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 --2- 172.21.15.43:0/3652303531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1000b5f60 0x7ff1001f1d30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:02.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 >> 172.21.15.43:0/3652303531 conn(0x7ff10006bdf0 msgr2=0x7ff100160670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:02.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.867+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 shutdown_connections 2023-06-08T03:50:02.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:02.868+0000 7ff10491a700 1 -- 172.21.15.43:0/3652303531 wait complete. 2023-06-08T03:50:02.874 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-06-08T03:50:02.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-08T03:50:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.022+0000 7f403b736700 1 Processor -- start 2023-06-08T03:50:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.023+0000 7f403b736700 1 -- start start 2023-06-08T03:50:03.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.023+0000 7f403b736700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40340d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.023+0000 7f403b736700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340d0d30 con 0x7f403415c270 2023-06-08T03:50:03.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.023+0000 7f403b736700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340d1520 con 0x7f40340cd840 2023-06-08T03:50:03.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.023+0000 7f403b736700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403406aec0 con 0x7f40340ce310 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f40394d2700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f403415c270 0x7f40340cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55276/0 (socket says 172.21.15.43:55276) 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f40394d2700 1 -- 172.21.15.43:0/2219891241 learned_addr learned my addr 172.21.15.43:0/2219891241 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599460836 0 0) 0x7f40340d0d30 con 0x7f403415c270 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f4039cd3700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40340d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40200035b0 con 0x7f403415c270 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780253024 0 0) 0x7f40200035b0 con 0x7f403415c270 2023-06-08T03:50:03.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 msgr2=0x7f40340d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:03.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40340d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 >> v1:172.21.15.135:6789/0 conn(0x7f40340cd840 legacy=0x7f40340cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340cb1a0 con 0x7f403415c270 2023-06-08T03:50:03.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f4024001670 con 0x7f403415c270 2023-06-08T03:50:03.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 >> v1:172.21.15.43:6789/0 conn(0x7f403415c270 legacy=0x7f40340cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4020003a30 0x7f4020003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40200043d0 0x7f4020004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40200050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402000ba10 con 0x7f4020003a30 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402000bb50 con 0x7f40200043d0 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402000bce0 con 0x7f40340ce310 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f40394d2700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4020003a30 0x7f4020003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.024+0000 7f4038cd1700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40200043d0 0x7f4020004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f4039cd3700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40200050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f40394d2700 1 -- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 msgr2=0x7f40200050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f40394d2700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40200050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f40394d2700 1 -- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40200043d0 msgr2=0x7f4020004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f40394d2700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40200043d0 0x7f4020004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f40394d2700 1 -- 172.21.15.43:0/2219891241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200035b0 con 0x7f4020003a30 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f4039cd3700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40340ce310 0x7f40200050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:03.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f40394d2700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4020003a30 0x7f4020003e00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f402400c2f0 tx=0x7f4020005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300b8eb0cd5c86bf server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402400ce30 con 0x7f4020003a30 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024005960 con 0x7f4020003a30 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f402bfff700 1 -- 172.21.15.43:0/2219891241 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024005cf0 con 0x7f4020003a30 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f403b736700 1 -- 172.21.15.43:0/2219891241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4020003a30 msgr2=0x7f4020003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.025+0000 7f403b736700 1 --2- 172.21.15.43:0/2219891241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4020003a30 0x7f4020003e00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f402400c2f0 tx=0x7f4020005880 comp rx=0 tx=0).stop 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.026+0000 7f4039cd3700 1 -- 172.21.15.43:0/2219891241 reap_dead start 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.026+0000 7f403b736700 1 -- 172.21.15.43:0/2219891241 shutdown_connections 2023-06-08T03:50:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.026+0000 7f403b736700 1 -- 172.21.15.43:0/2219891241 >> 172.21.15.43:0/2219891241 conn(0x7f4034069db0 msgr2=0x7f403406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:03.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.026+0000 7f403b736700 1 -- 172.21.15.43:0/2219891241 shutdown_connections 2023-06-08T03:50:03.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.026+0000 7f403b736700 1 -- 172.21.15.43:0/2219891241 wait complete. 2023-06-08T03:50:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.027+0000 7f403b736700 1 Processor -- start 2023-06-08T03:50:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.027+0000 7f403b736700 1 -- start start 2023-06-08T03:50:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4020003a30 0x7f403414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 0x7f40340b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40340b39e0 0x7f40340b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4034159b40 con 0x7f40340b3570 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341f4f90 con 0x7f40340b39e0 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4034158fc0 con 0x7f4020003a30 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 0x7f40340b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 0x7f40340b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60386/0 (socket says 172.21.15.43:60386) 2023-06-08T03:50:03.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 -- 172.21.15.43:0/1847061900 learned_addr learned my addr 172.21.15.43:0/1847061900 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f40394d2700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4020003a30 0x7f403414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 -- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4020003a30 msgr2=0x7f403414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4020003a30 0x7f403414cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4039cd3700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40340b39e0 0x7f40340b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 -- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40340b39e0 msgr2=0x7f40340b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40340b39e0 0x7f40340b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 -- 172.21.15.43:0/1847061900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40341592a0 con 0x7f40340b3570 2023-06-08T03:50:03.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f40394d2700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4020003a30 0x7f403414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4038cd1700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 0x7f40340b5d70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f403000f7f0 tx=0x7f403000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300052e0 con 0x7f40340b3570 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030005440 con 0x7f40340b3570 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4034159580 con 0x7f40340b3570 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.028+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300038c0 con 0x7f40340b3570 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.029+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403414d0e0 con 0x7f40340b3570 2023-06-08T03:50:03.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.030+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40341f5100 con 0x7f40340b3570 2023-06-08T03:50:03.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.030+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4030003a20 con 0x7f40340b3570 2023-06-08T03:50:03.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.031+0000 7f4029ffb700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f401806ace0 0x7f401806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:03.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.031+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f4030089220 con 0x7f40340b3570 2023-06-08T03:50:03.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.031+0000 7f40394d2700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f401806ace0 0x7f401806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:03.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.031+0000 7f40394d2700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f401806ace0 0x7f401806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f403415f860 tx=0x7f4024007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:03.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.035+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40341f5100 con 0x7f40340b3570 2023-06-08T03:50:03.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.231+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f40341f5100 con 0x7f40340b3570 2023-06-08T03:50:03.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.865+0000 7f4029ffb700 1 -- 172.21.15.43:0/1847061900 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f40341f5100 con 0x7f40340b3570 2023-06-08T03:50:03.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.870+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f401806ace0 msgr2=0x7f401806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.870+0000 7f403b736700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f401806ace0 0x7f401806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f403415f860 tx=0x7f4024007000 comp rx=0 tx=0).stop 2023-06-08T03:50:03.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.870+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 msgr2=0x7f40340b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:03.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.870+0000 7f403b736700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 0x7f40340b5d70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f403000f7f0 tx=0x7f403000fbb0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.872+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 shutdown_connections 2023-06-08T03:50:03.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.872+0000 7f403b736700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f401806ace0 0x7f401806d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.872+0000 7f403b736700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40340b39e0 0x7f40340b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.872+0000 7f403b736700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4020003a30 0x7f403414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.872+0000 7f403b736700 1 --2- 172.21.15.43:0/1847061900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40340b3570 0x7f40340b5d70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:03.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.872+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 >> 172.21.15.43:0/1847061900 conn(0x7f4034069db0 msgr2=0x7f403415fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:03.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.876+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 shutdown_connections 2023-06-08T03:50:03.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:03.876+0000 7f403b736700 1 -- 172.21.15.43:0/1847061900 wait complete. 2023-06-08T03:50:03.892 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-06-08T03:50:03.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-08T03:50:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.030+0000 7f0425595700 1 Processor -- start 2023-06-08T03:50:04.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.030+0000 7f0425595700 1 -- start start 2023-06-08T03:50:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f0425595700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 0x7f04200d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f0425595700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042015c750 con 0x7f04200b4ed0 2023-06-08T03:50:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f0425595700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200cf740 con 0x7f04200b43f0 2023-06-08T03:50:04.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f0425595700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200ccfc0 con 0x7f04200ccb00 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f04200b4ed0 0x7f04200d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55300/0 (socket says 172.21.15.43:55300) 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041f7fe700 1 -- 172.21.15.43:0/2655054565 learned_addr learned my addr 172.21.15.43:0/2655054565 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041e7fc700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 0x7f04200d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495833580 0 0) 0x7f0418001490 con 0x7f04200b4ed0 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04080035b0 con 0x7f04200b4ed0 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186143580 0 0) 0x7f04080035b0 con 0x7f04200b4ed0 2023-06-08T03:50:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 msgr2=0x7f04200d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 0x7f04200d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 >> v1:172.21.15.135:6789/0 conn(0x7f04200b43f0 legacy=0x7f04200b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200cd540 con 0x7f04200b4ed0 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f0418001b80 con 0x7f04200b4ed0 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 >> v1:172.21.15.43:6789/0 conn(0x7f04200b4ed0 legacy=0x7f04200d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 0x7f0408003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0408003f70 0x7f0408004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0408004d90 0x7f0408005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200ccfc0 con 0x7f0408003f70 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040800baf0 con 0x7f0408004d90 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.031+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040800bcb0 con 0x7f04200ccb00 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0408003f70 0x7f0408004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041effd700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 0x7f0408003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041f7fe700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0408004d90 0x7f0408005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 -- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 msgr2=0x7f0408003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04200ccb00 0x7f0408003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 -- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0408004d90 msgr2=0x7f0408005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0408004d90 0x7f0408005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 -- 172.21.15.43:0/2655054565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080035b0 con 0x7f0408003f70 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041e7fc700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0408003f70 0x7f0408004850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f04200ccf70 tx=0x7f0408005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918f25f353cef3bd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400e6c0 con 0x7f0408003f70 2023-06-08T03:50:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041400e820 con 0x7f0408003f70 2023-06-08T03:50:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.032+0000 7f041dffb700 1 -- 172.21.15.43:0/2655054565 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400eb90 con 0x7f0408003f70 2023-06-08T03:50:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f0425595700 1 -- 172.21.15.43:0/2655054565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0408003f70 msgr2=0x7f0408004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f0425595700 1 --2- 172.21.15.43:0/2655054565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0408003f70 0x7f0408004850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f04200ccf70 tx=0x7f0408005880 comp rx=0 tx=0).stop 2023-06-08T03:50:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f041f7fe700 1 -- 172.21.15.43:0/2655054565 reap_dead start 2023-06-08T03:50:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f0425595700 1 -- 172.21.15.43:0/2655054565 shutdown_connections 2023-06-08T03:50:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f0425595700 1 -- 172.21.15.43:0/2655054565 >> 172.21.15.43:0/2655054565 conn(0x7f0420072120 msgr2=0x7f042006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:04.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f0425595700 1 -- 172.21.15.43:0/2655054565 shutdown_connections 2023-06-08T03:50:04.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.033+0000 7f0425595700 1 -- 172.21.15.43:0/2655054565 wait complete. 2023-06-08T03:50:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.034+0000 7f0425595700 1 Processor -- start 2023-06-08T03:50:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.034+0000 7f0425595700 1 -- start start 2023-06-08T03:50:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f0425595700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0408003f70 0x7f04201f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f0425595700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0420156e60 0x7f04200c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f0425595700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 0x7f042015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f0425595700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200c8940 con 0x7f04200c6ef0 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f0425595700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200c64a0 con 0x7f0420156e60 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f0425595700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04201f4f70 con 0x7f0408003f70 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 0x7f042015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 0x7f042015ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60408/0 (socket says 172.21.15.43:60408) 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 -- 172.21.15.43:0/3646725655 learned_addr learned my addr 172.21.15.43:0/3646725655 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041e7fc700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0420156e60 0x7f04200c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041effd700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0408003f70 0x7f04201f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 -- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0408003f70 msgr2=0x7f04201f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0408003f70 0x7f04201f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 -- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0420156e60 msgr2=0x7f04200c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0420156e60 0x7f04200c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 -- 172.21.15.43:0/3646725655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200c8380 con 0x7f04200c6ef0 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.035+0000 7f041f7fe700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 0x7f042015ab30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f042008b7c0 tx=0x7f0418007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.036+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418007a30 con 0x7f04200c6ef0 2023-06-08T03:50:04.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.036+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180133f0 con 0x7f04200c6ef0 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.036+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04200c8660 con 0x7f04200c6ef0 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.036+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180137a0 con 0x7f04200c6ef0 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.036+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04200c69d0 con 0x7f04200c6ef0 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.036+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420073fa0 con 0x7f04200c6ef0 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.037+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0418013900 con 0x7f04200c6ef0 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.037+0000 7f04077fe700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f040c06ace0 0x7f040c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.038+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f0418089db0 con 0x7f04200c6ef0 2023-06-08T03:50:04.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.038+0000 7f041effd700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f040c06ace0 0x7f040c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.038+0000 7f041effd700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f040c06ace0 0x7f040c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0410000c00 tx=0x7f0410009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.042+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f041808e070 con 0x7f04200c6ef0 2023-06-08T03:50:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.288+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f042015c750 con 0x7f04200c6ef0 2023-06-08T03:50:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.298+0000 7f04077fe700 1 -- 172.21.15.43:0/3646725655 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f042015c750 con 0x7f04200c6ef0 2023-06-08T03:50:04.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.310+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f040c06ace0 msgr2=0x7f040c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.310+0000 7f0425595700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f040c06ace0 0x7f040c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0410000c00 tx=0x7f0410009040 comp rx=0 tx=0).stop 2023-06-08T03:50:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.310+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 msgr2=0x7f042015ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.310+0000 7f0425595700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 0x7f042015ab30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f042008b7c0 tx=0x7f0418007340 comp rx=0 tx=0).stop 2023-06-08T03:50:04.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.312+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 shutdown_connections 2023-06-08T03:50:04.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.312+0000 7f0425595700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f040c06ace0 0x7f040c06d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.312+0000 7f0425595700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04200c6ef0 0x7f042015ab30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.312+0000 7f0425595700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0408003f70 0x7f04201f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.312+0000 7f0425595700 1 --2- 172.21.15.43:0/3646725655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0420156e60 0x7f04200c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.312+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 >> 172.21.15.43:0/3646725655 conn(0x7f0420072120 msgr2=0x7f04200b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:04.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.314+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 shutdown_connections 2023-06-08T03:50:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.317+0000 7f0425595700 1 -- 172.21.15.43:0/3646725655 wait complete. 2023-06-08T03:50:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 6 and data pool 7 2023-06-08T03:50:04.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:50:04.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.457+0000 7fae75207700 1 Processor -- start 2023-06-08T03:50:04.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.458+0000 7fae75207700 1 -- start start 2023-06-08T03:50:04.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.458+0000 7fae75207700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 0x7fae700b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.458+0000 7fae75207700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae70160110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.458+0000 7fae75207700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae70160650 con 0x7fae7015c0b0 2023-06-08T03:50:04.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.458+0000 7fae75207700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700b2f60 con 0x7fae700cd680 2023-06-08T03:50:04.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.458+0000 7fae75207700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700cdc60 con 0x7fae7015fcb0 2023-06-08T03:50:04.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae70160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6e59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 0x7fae700b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae70160110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:53886/0 (socket says 172.21.15.43:53886) 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6e59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 0x7fae700b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:42044/0 (socket says 172.21.15.43:42044) 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 -- 172.21.15.43:0/4165663862 learned_addr learned my addr 172.21.15.43:0/4165663862 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 -- 172.21.15.43:0/4165663862 >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 msgr2=0x7fae700b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 --2- 172.21.15.43:0/4165663862 >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 0x7fae700b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 -- 172.21.15.43:0/4165663862 >> v1:172.21.15.135:6789/0 conn(0x7fae7015c0b0 legacy=0x7fae700cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 -- 172.21.15.43:0/4165663862 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700cb4a0 con 0x7fae7015fcb0 2023-06-08T03:50:04.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6e59c700 1 --2- 172.21.15.43:0/4165663862 >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 0x7fae700b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:50:04.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6dd9b700 1 -- 172.21.15.43:0/4165663862 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521031490 0 0) 0x7fae70160650 con 0x7fae7015c0b0 2023-06-08T03:50:04.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6f59e700 1 --2- 172.21.15.43:0/4165663862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae70160110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae68009e50 tx=0x7fae6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd9afc2f9deefdf server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6dd9b700 1 -- 172.21.15.43:0/4165663862 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800e070 con 0x7fae7015fcb0 2023-06-08T03:50:04.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6dd9b700 1 -- 172.21.15.43:0/4165663862 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800b910 con 0x7fae7015fcb0 2023-06-08T03:50:04.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.459+0000 7fae6dd9b700 1 -- 172.21.15.43:0/4165663862 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800bcc0 con 0x7fae7015fcb0 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 -- 172.21.15.43:0/4165663862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 msgr2=0x7fae70160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 --2- 172.21.15.43:0/4165663862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae70160110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae68009e50 tx=0x7fae6800b330 comp rx=0 tx=0).stop 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 -- 172.21.15.43:0/4165663862 shutdown_connections 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 --2- 172.21.15.43:0/4165663862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae70160110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 --2- 172.21.15.43:0/4165663862 >> v2:172.21.15.135:3300/0 conn(0x7fae700cd680 0x7fae700b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 -- 172.21.15.43:0/4165663862 >> 172.21.15.43:0/4165663862 conn(0x7fae70069db0 msgr2=0x7fae7006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:04.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 -- 172.21.15.43:0/4165663862 shutdown_connections 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.460+0000 7fae75207700 1 -- 172.21.15.43:0/4165663862 wait complete. 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.461+0000 7fae75207700 1 Processor -- start 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 -- start start 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 0x7fae7015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae7015c0b0 0x7fae700b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae700c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700b23f0 con 0x7fae700cd680 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae701f61b0 con 0x7fae7015c0b0 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae75207700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae701f7180 con 0x7fae7015fcb0 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae6ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 0x7fae7015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae6ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 0x7fae7015ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60432/0 (socket says 172.21.15.43:60432) 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.462+0000 7fae6ed9d700 1 -- 172.21.15.43:0/474963089 learned_addr learned my addr 172.21.15.43:0/474963089 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6f59e700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae700c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6e59c700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae7015c0b0 0x7fae700b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6ed9d700 1 -- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 msgr2=0x7fae700c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6ed9d700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae700c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6ed9d700 1 -- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae7015c0b0 msgr2=0x7fae700b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6ed9d700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae7015c0b0 0x7fae700b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6ed9d700 1 -- 172.21.15.43:0/474963089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580094a0 con 0x7fae700cd680 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae6ed9d700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 0x7fae7015ad70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c750 tx=0x7fae6000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600054e0 con 0x7fae700cd680 2023-06-08T03:50:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae60003680 con 0x7fae700cd680 2023-06-08T03:50:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68009b30 con 0x7fae700cd680 2023-06-08T03:50:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60003a30 con 0x7fae700cd680 2023-06-08T03:50:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.463+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae701f66a0 con 0x7fae700cd680 2023-06-08T03:50:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.464+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70073fa0 con 0x7fae700cd680 2023-06-08T03:50:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.465+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae60003b90 con 0x7fae700cd680 2023-06-08T03:50:04.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.465+0000 7fae677fe700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae5006ace0 0x7fae5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.465+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fae60088a40 con 0x7fae700cd680 2023-06-08T03:50:04.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.465+0000 7fae6e59c700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae5006ace0 0x7fae5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.466+0000 7fae6e59c700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae5006ace0 0x7fae5006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae70156aa0 tx=0x7fae58009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.470+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fae6008ae60 con 0x7fae700cd680 2023-06-08T03:50:04.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.668+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae700d0680 con 0x7fae700cd680 2023-06-08T03:50:04.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.669+0000 7fae677fe700 1 -- 172.21.15.43:0/474963089 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18455 (secure 0 0 0) 0x7fae60017090 con 0x7fae700cd680 2023-06-08T03:50:04.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":39,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:50:04.289862+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:50:01.893006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-08T03:50:03.263523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:50:04.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae5006ace0 msgr2=0x7fae5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae5006ace0 0x7fae5006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae70156aa0 tx=0x7fae58009210 comp rx=0 tx=0).stop 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 msgr2=0x7fae7015ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 0x7fae7015ad70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c750 tx=0x7fae6000ca60 comp rx=0 tx=0).stop 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 shutdown_connections 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae5006ace0 0x7fae5006d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae700cd680 0x7fae7015ad70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae7015fcb0 0x7fae700c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 --2- 172.21.15.43:0/474963089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae7015c0b0 0x7fae700b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 >> 172.21.15.43:0/474963089 conn(0x7fae70069db0 msgr2=0x7fae7006c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 shutdown_connections 2023-06-08T03:50:04.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.671+0000 7fae75207700 1 -- 172.21.15.43:0/474963089 wait complete. 2023-06-08T03:50:04.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:50:04.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.811+0000 7f88d012b700 1 Processor -- start 2023-06-08T03:50:04.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.811+0000 7f88d012b700 1 -- start start 2023-06-08T03:50:04.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88d012b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88c8159380 0x7f88c80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88d012b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88c80cd930 0x7f88c80ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88d012b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c806f480 con 0x7f88c80b1dc0 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88d012b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80b10d0 con 0x7f88c8159380 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88d012b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c806f760 con 0x7f88c80cd930 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88c8159380 0x7f88c80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88c8159380 0x7f88c80716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60440/0 (socket says 172.21.15.43:60440) 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 -- 172.21.15.43:0/1686486480 learned_addr learned my addr 172.21.15.43:0/1686486480 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:04.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 -- 172.21.15.43:0/1686486480 >> v2:172.21.15.135:3300/0 conn(0x7f88c80cd930 msgr2=0x7f88c80ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88ce6c8700 1 --2- 172.21.15.43:0/1686486480 >> v2:172.21.15.135:3300/0 conn(0x7f88c80cd930 0x7f88c80ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 --2- 172.21.15.43:0/1686486480 >> v2:172.21.15.135:3300/0 conn(0x7f88c80cd930 0x7f88c80ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 -- 172.21.15.43:0/1686486480 >> v1:172.21.15.135:6789/0 conn(0x7f88c80b1dc0 legacy=0x7f88c80cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 -- 172.21.15.43:0/1686486480 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80b12e0 con 0x7f88c8159380 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88ce6c8700 1 --2- 172.21.15.43:0/1686486480 >> v2:172.21.15.135:3300/0 conn(0x7f88c80cd930 0x7f88c80ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.812+0000 7f88cdec7700 1 --2- 172.21.15.43:0/1686486480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c8159380 0x7f88c80716c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f88c80cf600 tx=0x7f88c400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b299cb3253a147 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88ccec5700 1 -- 172.21.15.43:0/1686486480 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400dcf0 con 0x7f88c8159380 2023-06-08T03:50:04.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88ccec5700 1 -- 172.21.15.43:0/1686486480 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c400de50 con 0x7f88c8159380 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88ccec5700 1 -- 172.21.15.43:0/1686486480 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4004250 con 0x7f88c8159380 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 -- 172.21.15.43:0/1686486480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c8159380 msgr2=0x7f88c80716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 --2- 172.21.15.43:0/1686486480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c8159380 0x7f88c80716c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f88c80cf600 tx=0x7f88c400be70 comp rx=0 tx=0).stop 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 -- 172.21.15.43:0/1686486480 shutdown_connections 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 --2- 172.21.15.43:0/1686486480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c8159380 0x7f88c80716c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 --2- 172.21.15.43:0/1686486480 >> v2:172.21.15.135:3300/0 conn(0x7f88c80cd930 0x7f88c80ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 -- 172.21.15.43:0/1686486480 >> 172.21.15.43:0/1686486480 conn(0x7f88c806aec0 msgr2=0x7f88c806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:04.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 -- 172.21.15.43:0/1686486480 shutdown_connections 2023-06-08T03:50:04.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.813+0000 7f88d012b700 1 -- 172.21.15.43:0/1686486480 wait complete. 2023-06-08T03:50:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.814+0000 7f88d012b700 1 Processor -- start 2023-06-08T03:50:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 -- start start 2023-06-08T03:50:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c80b1dc0 0x7f88c81f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 0x7f88c80c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88c8159380 0x7f88c81518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81f6710 con 0x7f88c80cd930 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ca540 con 0x7f88c80b1dc0 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88d012b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ca790 con 0x7f88c8159380 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88cd6c6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 0x7f88c80c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88cd6c6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 0x7f88c80c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60446/0 (socket says 172.21.15.43:60446) 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.815+0000 7f88cd6c6700 1 -- 172.21.15.43:0/3359384972 learned_addr learned my addr 172.21.15.43:0/3359384972 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88ce6c8700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88c8159380 0x7f88c81518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cdec7700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c80b1dc0 0x7f88c81f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cd6c6700 1 -- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88c8159380 msgr2=0x7f88c81518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cd6c6700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88c8159380 0x7f88c81518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cd6c6700 1 -- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c80b1dc0 msgr2=0x7f88c81f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cd6c6700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c80b1dc0 0x7f88c81f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cd6c6700 1 -- 172.21.15.43:0/3359384972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c400b7f0 con 0x7f88c80cd930 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88cd6c6700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 0x7f88c80c5910 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c4d0 tx=0x7f88b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8011790 con 0x7f88c80cd930 2023-06-08T03:50:04.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80118f0 con 0x7f88c80cd930 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80caa70 con 0x7f88c80cd930 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8011ca0 con 0x7f88c80cd930 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.816+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c80cb030 con 0x7f88c80cd930 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.817+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c8073fa0 con 0x7f88c80cd930 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.818+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88b801c460 con 0x7f88c80cd930 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.818+0000 7f88be7fc700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88ac06ace0 0x7f88ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:04.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.818+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f88b80893e0 con 0x7f88c80cd930 2023-06-08T03:50:04.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.818+0000 7f88cdec7700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88ac06ace0 0x7f88ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:04.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.819+0000 7f88cdec7700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88ac06ace0 0x7f88ac06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f88c4000c00 tx=0x7f88c4012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:04.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:04.822+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88b80543e0 con 0x7f88c80cd930 2023-06-08T03:50:05.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.023+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88c80714a0 con 0x7f88c80cd930 2023-06-08T03:50:05.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.024+0000 7f88be7fc700 1 -- 172.21.15.43:0/3359384972 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f88b8057a00 con 0x7f88c80cd930 2023-06-08T03:50:05.028 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:05.029 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":39,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:50:04.289862+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:50:01.893006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-08T03:50:03.263523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:50:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88ac06ace0 msgr2=0x7f88ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88ac06ace0 0x7f88ac06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f88c4000c00 tx=0x7f88c4012000 comp rx=0 tx=0).stop 2023-06-08T03:50:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 msgr2=0x7f88c80c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 0x7f88c80c5910 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c4d0 tx=0x7f88b800c890 comp rx=0 tx=0).stop 2023-06-08T03:50:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 shutdown_connections 2023-06-08T03:50:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f88ac06ace0 0x7f88ac06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88c8159380 0x7f88c81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c80b1dc0 0x7f88c81f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 --2- 172.21.15.43:0/3359384972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c80cd930 0x7f88c80c5910 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 >> 172.21.15.43:0/3359384972 conn(0x7f88c806aec0 msgr2=0x7f88c80b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 shutdown_connections 2023-06-08T03:50:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.026+0000 7f88d012b700 1 -- 172.21.15.43:0/3359384972 wait complete. 2023-06-08T03:50:05.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-08T03:50:05.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.166+0000 7f6fbd8bb700 1 Processor -- start 2023-06-08T03:50:05.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.166+0000 7f6fbd8bb700 1 -- start start 2023-06-08T03:50:05.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fbd8bb700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6fb8159380 0x7f6fb80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fbd8bb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 0x7f6fb80ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fbd8bb700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb806f480 con 0x7f6fb80b1dc0 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fbd8bb700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb80b10d0 con 0x7f6fb8159380 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fbd8bb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb806f760 con 0x7f6fb80cd930 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fb67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6fb80b1dc0 0x7f6fb80cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55356/0 (socket says 172.21.15.43:55356) 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.167+0000 7f6fb67fc700 1 -- 172.21.15.43:0/2171689934 learned_addr learned my addr 172.21.15.43:0/2171689934 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873542527 0 0) 0x7f6fb806f480 con 0x7f6fb80b1dc0 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/2171689934 >> v2:172.21.15.135:3300/0 conn(0x7f6fb8159380 0x7f6fb80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa00035b0 con 0x7f6fb80b1dc0 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb77fe700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 0x7f6fb80ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641411867 0 0) 0x7f6fa00035b0 con 0x7f6fb80b1dc0 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 msgr2=0x7f6fb80ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 0x7f6fb80ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 >> v2:172.21.15.135:3300/0 conn(0x7f6fb8159380 msgr2=0x7f6fb80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 --2- 172.21.15.43:0/2171689934 >> v2:172.21.15.135:3300/0 conn(0x7f6fb8159380 0x7f6fb80716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80b12e0 con 0x7f6fb80b1dc0 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f6fa8001670 con 0x7f6fb80b1dc0 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 >> v1:172.21.15.43:6789/0 conn(0x7f6fb80b1dc0 legacy=0x7f6fb80cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fa0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 0x7f6fa0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa0004d90 0x7f6fa0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80b10d0 con 0x7f6fa0003a00 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb806f760 con 0x7f6fa0004d90 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa000ba10 con 0x7f6fb80cd930 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fa0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb67fc700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 0x7f6fa0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb77fe700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa0004d90 0x7f6fa0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 msgr2=0x7f6fa0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80cd930 0x7f6fa0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa0004d90 msgr2=0x7f6fa0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa0004d90 0x7f6fa0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/2171689934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00035b0 con 0x7f6fa0003a00 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.168+0000 7f6fb77fe700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa0004d90 0x7f6fa0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fa0003e10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009b60 tx=0x7f6fa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cade5a2e6c6f3d86 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00e6c0 con 0x7f6fa0003a00 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00e820 con 0x7f6fa0003a00 2023-06-08T03:50:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fb5ffb700 1 -- 172.21.15.43:0/2171689934 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00eb90 con 0x7f6fa0003a00 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/2171689934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 msgr2=0x7f6fa0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/2171689934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fa0003e10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009b60 tx=0x7f6fa0005880 comp rx=0 tx=0).stop 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fb77fe700 1 -- 172.21.15.43:0/2171689934 reap_dead start 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/2171689934 shutdown_connections 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/2171689934 >> 172.21.15.43:0/2171689934 conn(0x7f6fb806aec0 msgr2=0x7f6fb806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/2171689934 shutdown_connections 2023-06-08T03:50:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.169+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/2171689934 wait complete. 2023-06-08T03:50:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 Processor -- start 2023-06-08T03:50:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 -- start start 2023-06-08T03:50:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fb80c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb814c190 0x7f6fb80c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80caee0 0x7f6fb80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80cb8c0 con 0x7f6fa0003a00 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80c4cf0 con 0x7f6fb814c190 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.171+0000 7f6fbd8bb700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80c3c10 con 0x7f6fb80caee0 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fb80c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fb80c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60464/0 (socket says 172.21.15.43:60464) 2023-06-08T03:50:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/3767005248 learned_addr learned my addr 172.21.15.43:0/3767005248 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb77fe700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80caee0 0x7f6fb80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb67fc700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb814c190 0x7f6fb80c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80caee0 msgr2=0x7f6fb80cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80caee0 0x7f6fb80cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb814c190 msgr2=0x7f6fb80c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb814c190 0x7f6fb80c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 -- 172.21.15.43:0/3767005248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80c32e0 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fb6ffd700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fb80c7de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0090b0 tx=0x7f6fac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00e6c0 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0038c0 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80c35c0 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac003c70 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.172+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb80c40a0 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.173+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb8073fa0 con 0x7f6fa0003a00 2023-06-08T03:50:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.174+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fac013470 con 0x7f6fa0003a00 2023-06-08T03:50:05.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.174+0000 7f6f9ffff700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6fa406ace0 0x7f6fa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:05.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.174+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6fac08ad90 con 0x7f6fa0003a00 2023-06-08T03:50:05.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.174+0000 7f6fb67fc700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6fa406ace0 0x7f6fa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:05.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.175+0000 7f6fb67fc700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6fa406ace0 0x7f6fa406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6fb814c560 tx=0x7f6fa8007980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:05.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.179+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6fac055d90 con 0x7f6fa0003a00 2023-06-08T03:50:05.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:05.425+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6fb80714a0 con 0x7f6fa0003a00 2023-06-08T03:50:06.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.306+0000 7f6f9ffff700 1 -- 172.21.15.43:0/3767005248 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6fac0593b0 con 0x7f6fa0003a00 2023-06-08T03:50:06.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.308+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6fa406ace0 msgr2=0x7f6fa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.308+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6fa406ace0 0x7f6fa406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6fb814c560 tx=0x7f6fa8007980 comp rx=0 tx=0).stop 2023-06-08T03:50:06.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.308+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 msgr2=0x7f6fb80c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.308+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fb80c7de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0090b0 tx=0x7f6fac0047c0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 shutdown_connections 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6fa406ace0 0x7f6fa406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa0003a00 0x7f6fb80c7de0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fb80caee0 0x7f6fb80cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 --2- 172.21.15.43:0/3767005248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fb814c190 0x7f6fb80c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 >> 172.21.15.43:0/3767005248 conn(0x7f6fb806aec0 msgr2=0x7f6fb806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 shutdown_connections 2023-06-08T03:50:06.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.309+0000 7f6fbd8bb700 1 -- 172.21.15.43:0/3767005248 wait complete. 2023-06-08T03:50:06.329 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-08T03:50:06.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-08T03:50:06.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.462+0000 7f65778b1700 1 Processor -- start 2023-06-08T03:50:06.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.462+0000 7f65778b1700 1 -- start start 2023-06-08T03:50:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.463+0000 7f65778b1700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700b60a0 0x7f65700cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.463+0000 7f65778b1700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700cda20 con 0x7f65700cf5b0 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.463+0000 7f65778b1700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657015e7c0 con 0x7f657015e340 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.463+0000 7f65778b1700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b6470 con 0x7f65700b60a0 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.463+0000 7f6574e4c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f65700cf5b0 0x7f657015dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55378/0 (socket says 172.21.15.43:55378) 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.463+0000 7f6574e4c700 1 -- 172.21.15.43:0/125991152 learned_addr learned my addr 172.21.15.43:0/125991152 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f657564d700 1 --2- 172.21.15.43:0/125991152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700b60a0 0x7f65700cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660153734 0 0) 0x7f65700cda20 con 0x7f65700cf5b0 2023-06-08T03:50:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f655c0035b0 con 0x7f65700cf5b0 2023-06-08T03:50:06.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356873213 0 0) 0x7f657015e7c0 con 0x7f657015e340 2023-06-08T03:50:06.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65700cda20 con 0x7f657015e340 2023-06-08T03:50:06.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f657564d700 1 -- 172.21.15.43:0/125991152 >> v1:172.21.15.135:6789/0 conn(0x7f657015e340 legacy=0x7f65700cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207999464 0 0) 0x7f655c0035b0 con 0x7f65700cf5b0 2023-06-08T03:50:06.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f657564d700 1 -- 172.21.15.43:0/125991152 >> v1:172.21.15.43:6789/0 conn(0x7f65700cf5b0 legacy=0x7f657015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f657564d700 1 -- 172.21.15.43:0/125991152 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657015a520 con 0x7f65700b60a0 2023-06-08T03:50:06.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f657564d700 1 --2- 172.21.15.43:0/125991152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700b60a0 0x7f65700cad90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6560009870 tx=0x7f6560009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f785ae40f4f509d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:06.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c001670 con 0x7f65700b60a0 2023-06-08T03:50:06.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560004030 con 0x7f65700b60a0 2023-06-08T03:50:06.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.464+0000 7f6567fff700 1 -- 172.21.15.43:0/125991152 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600043c0 con 0x7f65700b60a0 2023-06-08T03:50:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 -- 172.21.15.43:0/125991152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700b60a0 msgr2=0x7f65700cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 --2- 172.21.15.43:0/125991152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700b60a0 0x7f65700cad90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6560009870 tx=0x7f6560009b80 comp rx=0 tx=0).stop 2023-06-08T03:50:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 -- 172.21.15.43:0/125991152 shutdown_connections 2023-06-08T03:50:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 --2- 172.21.15.43:0/125991152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700b60a0 0x7f65700cad90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 -- 172.21.15.43:0/125991152 >> 172.21.15.43:0/125991152 conn(0x7f6570069db0 msgr2=0x7f657006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 -- 172.21.15.43:0/125991152 shutdown_connections 2023-06-08T03:50:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.465+0000 7f65778b1700 1 -- 172.21.15.43:0/125991152 wait complete. 2023-06-08T03:50:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.466+0000 7f65778b1700 1 Processor -- start 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.466+0000 7f65778b1700 1 -- start start 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f65778b1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 0x7f6570153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f65778b1700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700cf5b0 0x7f657006aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f65778b1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657015e340 0x7f6570156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f65778b1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701e66a0 con 0x7f65700b60a0 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f65778b1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701e4c10 con 0x7f657015e340 2023-06-08T03:50:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f65778b1700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657006b960 con 0x7f65700cf5b0 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 0x7f6570153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 0x7f6570153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60478/0 (socket says 172.21.15.43:60478) 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 -- 172.21.15.43:0/954836056 learned_addr learned my addr 172.21.15.43:0/954836056 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f6574e4c700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700cf5b0 0x7f657006aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 -- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700cf5b0 msgr2=0x7f657006aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700cf5b0 0x7f657006aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f6575e4e700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657015e340 0x7f6570156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 -- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657015e340 msgr2=0x7f6570156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.467+0000 7f657564d700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657015e340 0x7f6570156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f657564d700 1 -- 172.21.15.43:0/954836056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094a0 con 0x7f65700b60a0 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f6574e4c700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700cf5b0 0x7f657006aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f657564d700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 0x7f6570153220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6560000c00 tx=0x7f6560004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560011830 con 0x7f65700b60a0 2023-06-08T03:50:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656001f070 con 0x7f65700b60a0 2023-06-08T03:50:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657006bc40 con 0x7f65700b60a0 2023-06-08T03:50:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560011bd0 con 0x7f65700b60a0 2023-06-08T03:50:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.468+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65701e5140 con 0x7f65700b60a0 2023-06-08T03:50:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.469+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657006be30 con 0x7f65700b60a0 2023-06-08T03:50:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.469+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6560011d30 con 0x7f65700b60a0 2023-06-08T03:50:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.470+0000 7f6565ffb700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f655406ace0 0x7f655406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.470+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6560021070 con 0x7f65700b60a0 2023-06-08T03:50:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.470+0000 7f6574e4c700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f655406ace0 0x7f655406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.471+0000 7f6574e4c700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f655406ace0 0x7f655406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f656c001eb0 tx=0x7f656c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:06.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.474+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6560055f30 con 0x7f65700b60a0 2023-06-08T03:50:06.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:06.721+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6570073fa0 con 0x7f65700b60a0 2023-06-08T03:50:06.858 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T03:50:06.854+0000 7fbd4e841700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-08T03:50:07.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.307+0000 7f6565ffb700 1 -- 172.21.15.43:0/954836056 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f656002b0c0 con 0x7f65700b60a0 2023-06-08T03:50:07.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f655406ace0 msgr2=0x7f655406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f655406ace0 0x7f655406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f656c001eb0 tx=0x7f656c009040 comp rx=0 tx=0).stop 2023-06-08T03:50:07.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 msgr2=0x7f6570153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 0x7f6570153220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6560000c00 tx=0x7f6560004750 comp rx=0 tx=0).stop 2023-06-08T03:50:07.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 shutdown_connections 2023-06-08T03:50:07.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f655406ace0 0x7f655406d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65700b60a0 0x7f6570153220 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f657015e340 0x7f6570156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 --2- 172.21.15.43:0/954836056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65700cf5b0 0x7f657006aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 >> 172.21.15.43:0/954836056 conn(0x7f6570069db0 msgr2=0x7f65700b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:07.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 shutdown_connections 2023-06-08T03:50:07.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.310+0000 7f65778b1700 1 -- 172.21.15.43:0/954836056 wait complete. 2023-06-08T03:50:07.329 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-08T03:50:07.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:50:07.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.456+0000 7f520f7db700 1 Processor -- start 2023-06-08T03:50:07.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.456+0000 7f520f7db700 1 -- start start 2023-06-08T03:50:07.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.457+0000 7f520f7db700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 0x7f52080b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.457+0000 7f520f7db700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080b01a0 con 0x7f52080cd980 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.457+0000 7f520f7db700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080b0900 con 0x7f52080b0c40 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.457+0000 7f520f7db700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080b06f0 con 0x7f52080afa30 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.457+0000 7f520dd78700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f52080cd980 0x7f52080cafa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55394/0 (socket says 172.21.15.43:55394) 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.457+0000 7f520dd78700 1 -- 172.21.15.43:0/1278377082 learned_addr learned my addr 172.21.15.43:0/1278377082 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520d577700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 0x7f52080b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262106947 0 0) 0x7f52080b01a0 con 0x7f52080cd980 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40035b0 con 0x7f52080cd980 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1791791464 0 0) 0x7f51f40035b0 con 0x7f52080cd980 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 msgr2=0x7f52080b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 0x7f52080b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 >> v1:172.21.15.135:6789/0 conn(0x7f52080b0c40 legacy=0x7f52080cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080ca7a0 con 0x7f52080cd980 2023-06-08T03:50:07.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f52000019f0 con 0x7f52080cd980 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 >> v1:172.21.15.43:6789/0 conn(0x7f52080cd980 legacy=0x7f52080cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 0x7f51f4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4004000 0x7f51f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004d90 0x7f51f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52080b06f0 con 0x7f51f4004000 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400bb20 con 0x7f51f4004d90 2023-06-08T03:50:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400def0 con 0x7f52080afa30 2023-06-08T03:50:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520cd76700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4004000 0x7f51f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520d577700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 0x7f51f4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520dd78700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004d90 0x7f51f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520cd76700 1 -- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 msgr2=0x7f51f4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520cd76700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080afa30 0x7f51f4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520cd76700 1 -- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004d90 msgr2=0x7f51f4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520cd76700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004d90 0x7f51f4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.458+0000 7f520cd76700 1 -- 172.21.15.43:0/1278377082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40035b0 con 0x7f51f4004000 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520cd76700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4004000 0x7f51f4004850 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f52080b1070 tx=0x7f51f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a944214f4abfc8a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040012f0 con 0x7f51f4004000 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52040052f0 con 0x7f51f4004000 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f51fffff700 1 -- 172.21.15.43:0/1278377082 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204006860 con 0x7f51f4004000 2023-06-08T03:50:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520f7db700 1 -- 172.21.15.43:0/1278377082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4004000 msgr2=0x7f51f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520f7db700 1 --2- 172.21.15.43:0/1278377082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4004000 0x7f51f4004850 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f52080b1070 tx=0x7f51f4005880 comp rx=0 tx=0).stop 2023-06-08T03:50:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520dd78700 1 -- 172.21.15.43:0/1278377082 reap_dead start 2023-06-08T03:50:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520f7db700 1 -- 172.21.15.43:0/1278377082 shutdown_connections 2023-06-08T03:50:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520f7db700 1 -- 172.21.15.43:0/1278377082 >> 172.21.15.43:0/1278377082 conn(0x7f520806b7e0 msgr2=0x7f52080cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520f7db700 1 -- 172.21.15.43:0/1278377082 shutdown_connections 2023-06-08T03:50:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.459+0000 7f520f7db700 1 -- 172.21.15.43:0/1278377082 wait complete. 2023-06-08T03:50:07.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 Processor -- start 2023-06-08T03:50:07.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 -- start start 2023-06-08T03:50:07.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004000 0x7f52080ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 0x7f52080c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080c34e0 0x7f52080c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208153ce0 con 0x7f52080c3070 2023-06-08T03:50:07.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081f13d0 con 0x7f51f4004000 2023-06-08T03:50:07.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520f7db700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52081f16b0 con 0x7f52080c34e0 2023-06-08T03:50:07.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520cd76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 0x7f52080c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520cd76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 0x7f52080c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60498/0 (socket says 172.21.15.43:60498) 2023-06-08T03:50:07.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.461+0000 7f520cd76700 1 -- 172.21.15.43:0/2953441121 learned_addr learned my addr 172.21.15.43:0/2953441121 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:07.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520dd78700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080c34e0 0x7f52080c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520d577700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004000 0x7f52080ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520cd76700 1 -- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080c34e0 msgr2=0x7f52080c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520cd76700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080c34e0 0x7f52080c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520cd76700 1 -- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004000 msgr2=0x7f52080ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520cd76700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004000 0x7f52080ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520cd76700 1 -- 172.21.15.43:0/2953441121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52081f1990 con 0x7f52080c3070 2023-06-08T03:50:07.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520cd76700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 0x7f52080c50c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5204004000 tx=0x7f5204001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:07.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204006d70 con 0x7f52080c3070 2023-06-08T03:50:07.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204007020 con 0x7f52080c3070 2023-06-08T03:50:07.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040073d0 con 0x7f52080c3070 2023-06-08T03:50:07.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52081f1c70 con 0x7f52080c3070 2023-06-08T03:50:07.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.462+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52081f2230 con 0x7f52080c3070 2023-06-08T03:50:07.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.463+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52080c4f10 con 0x7f52080c3070 2023-06-08T03:50:07.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.464+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5204007530 con 0x7f52080c3070 2023-06-08T03:50:07.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.464+0000 7f51fdffb700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f51ec06ace0 0x7f51ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.464+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f520408a880 con 0x7f52080c3070 2023-06-08T03:50:07.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.464+0000 7f520d577700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f51ec06ace0 0x7f51ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.465+0000 7f520d577700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f51ec06ace0 0x7f51ec06d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009c40 tx=0x7f51f80091c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:07.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.469+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5204055920 con 0x7f52080c3070 2023-06-08T03:50:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.711+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52080d0280 con 0x7f52080c3070 2023-06-08T03:50:07.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.712+0000 7f51fdffb700 1 -- 172.21.15.43:0/2953441121 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f5204058f40 con 0x7f52080c3070 2023-06-08T03:50:07.716 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:07.717 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/259769844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":259769844},{"type":"v1","addr":"172.21.15.135:6836","nonce":259769844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3929813218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3929813218},{"type":"v1","addr":"172.21.15.43:6835","nonce":3929813218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2982983469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2982983469},{"type":"v1","addr":"172.21.15.135:6837","nonce":2982983469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:50:04.290176+0000","modified":"2023-06-08T03:50:07.305956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6834/3038158097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3038158097},{"type":"v1","addr":"172.21.15.43:6834","nonce":3038158097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-08T03:50:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f51ec06ace0 msgr2=0x7f51ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f51ec06ace0 0x7f51ec06d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009c40 tx=0x7f51f80091c0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 msgr2=0x7f52080c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 0x7f52080c50c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5204004000 tx=0x7f5204001120 comp rx=0 tx=0).stop 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 shutdown_connections 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f51ec06ace0 0x7f51ec06d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52080c34e0 0x7f52080c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51f4004000 0x7f52080ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 --2- 172.21.15.43:0/2953441121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080c3070 0x7f52080c50c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 >> 172.21.15.43:0/2953441121 conn(0x7f520806b7e0 msgr2=0x7f5208158810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 shutdown_connections 2023-06-08T03:50:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.714+0000 7f520f7db700 1 -- 172.21.15.43:0/2953441121 wait complete. 2023-06-08T03:50:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-06-08T03:50:07.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T03:50:07.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.850+0000 7f2520077700 1 Processor -- start 2023-06-08T03:50:07.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.850+0000 7f2520077700 1 -- start start 2023-06-08T03:50:07.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f2520077700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251815c590 0x7f25180af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f2520077700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25180ccba0 0x7f25180b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f2520077700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2518069db0 0x7f251806a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f2520077700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180afae0 con 0x7f25180ccba0 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f2520077700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180ccff0 con 0x7f2518069db0 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f2520077700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251806a770 con 0x7f251815c590 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f251d612700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25180ccba0 0x7f25180b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f251d612700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25180ccba0 0x7f25180b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60506/0 (socket says 172.21.15.43:60506) 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.851+0000 7f251d612700 1 -- 172.21.15.43:0/3217735619 learned_addr learned my addr 172.21.15.43:0/3217735619 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:07.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251de13700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251815c590 0x7f25180af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251e614700 1 --2- 172.21.15.43:0/3217735619 >> v2:172.21.15.135:3300/0 conn(0x7f2518069db0 0x7f251806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251d612700 1 -- 172.21.15.43:0/3217735619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251815c590 msgr2=0x7f25180af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251d612700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251815c590 0x7f25180af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251d612700 1 -- 172.21.15.43:0/3217735619 >> v2:172.21.15.135:3300/0 conn(0x7f2518069db0 msgr2=0x7f251806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251d612700 1 --2- 172.21.15.43:0/3217735619 >> v2:172.21.15.135:3300/0 conn(0x7f2518069db0 0x7f251806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251d612700 1 -- 172.21.15.43:0/3217735619 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180af050 con 0x7f25180ccba0 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251de13700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251815c590 0x7f25180af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:07.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251d612700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25180ccba0 0x7f25180b06d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f25180711f0 tx=0x7f2514009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810b98ecbc9d89c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:07.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251ce11700 1 -- 172.21.15.43:0/3217735619 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400b870 con 0x7f25180ccba0 2023-06-08T03:50:07.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251ce11700 1 -- 172.21.15.43:0/3217735619 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400b9d0 con 0x7f25180ccba0 2023-06-08T03:50:07.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.852+0000 7f251ce11700 1 -- 172.21.15.43:0/3217735619 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400bd60 con 0x7f25180ccba0 2023-06-08T03:50:07.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 -- 172.21.15.43:0/3217735619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25180ccba0 msgr2=0x7f25180b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25180ccba0 0x7f25180b06d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f25180711f0 tx=0x7f2514009bd0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 -- 172.21.15.43:0/3217735619 shutdown_connections 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 --2- 172.21.15.43:0/3217735619 >> v2:172.21.15.135:3300/0 conn(0x7f2518069db0 0x7f251806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251815c590 0x7f25180af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 --2- 172.21.15.43:0/3217735619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25180ccba0 0x7f25180b06d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 -- 172.21.15.43:0/3217735619 >> 172.21.15.43:0/3217735619 conn(0x7f251806b7e0 msgr2=0x7f25180cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 -- 172.21.15.43:0/3217735619 shutdown_connections 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.853+0000 7f2520077700 1 -- 172.21.15.43:0/3217735619 wait complete. 2023-06-08T03:50:07.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.854+0000 7f2520077700 1 Processor -- start 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.854+0000 7f2520077700 1 -- start start 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518069db0 0x7f25180c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25180ccba0 0x7f251814fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 0x7f25180ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180c7140 con 0x7f251815c590 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518159090 con 0x7f2518069db0 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b53e0 con 0x7f25180ccba0 2023-06-08T03:50:07.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 0x7f25180ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 0x7f25180ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60516/0 (socket says 172.21.15.43:60516) 2023-06-08T03:50:07.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 -- 172.21.15.43:0/92866911 learned_addr learned my addr 172.21.15.43:0/92866911 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:07.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251de13700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518069db0 0x7f25180c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251d612700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25180ccba0 0x7f251814fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 -- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25180ccba0 msgr2=0x7f251814fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25180ccba0 0x7f251814fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 -- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518069db0 msgr2=0x7f25180c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:07.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518069db0 0x7f25180c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:07.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 -- 172.21.15.43:0/92866911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514009550 con 0x7f251815c590 2023-06-08T03:50:07.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f251e614700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 0x7f25180ad3d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2510007e60 tx=0x7f251000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:07.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000ed30 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510014420 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100147d0 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.855+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25180c6810 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.856+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25180c6dd0 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.856+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25180c72b0 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.857+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2510014930 con 0x7f251815c590 2023-06-08T03:50:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.857+0000 7f250e7fc700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24fc06ace0 0x7f24fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:07.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.857+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2510089d70 con 0x7f251815c590 2023-06-08T03:50:07.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.858+0000 7f251de13700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24fc06ace0 0x7f24fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:07.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.858+0000 7f251de13700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24fc06ace0 0x7f24fc06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f250800ab40 tx=0x7f2508008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:07.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:07.862+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2510054cf0 con 0x7f251815c590 2023-06-08T03:50:08.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.059+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2518073fa0 con 0x7f251815c590 2023-06-08T03:50:08.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.060+0000 7f250e7fc700 1 -- 172.21.15.43:0/92866911 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18442 (secure 0 0 0) 0x7f2510058310 con 0x7f251815c590 2023-06-08T03:50:08.065 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:08.065 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":40,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T03:50:05.292959+0000","last_up_change":"2023-06-08T03:48:38.146227+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:50:01.893006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-08T03:50:03.263523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists","up"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T03:50:08.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24fc06ace0 msgr2=0x7f24fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24fc06ace0 0x7f24fc06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f250800ab40 tx=0x7f2508008040 comp rx=0 tx=0).stop 2023-06-08T03:50:08.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 msgr2=0x7f25180ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 0x7f25180ad3d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2510007e60 tx=0x7f251000e3c0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 shutdown_connections 2023-06-08T03:50:08.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f24fc06ace0 0x7f24fc06d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f251815c590 0x7f25180ad3d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518069db0 0x7f25180c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 --2- 172.21.15.43:0/92866911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25180ccba0 0x7f251814fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 >> 172.21.15.43:0/92866911 conn(0x7f251806b7e0 msgr2=0x7f25180b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:08.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 shutdown_connections 2023-06-08T03:50:08.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.062+0000 7f2520077700 1 -- 172.21.15.43:0/92866911 wait complete. 2023-06-08T03:50:08.079 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-08T03:50:08.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:50:08.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.201+0000 7fae28167700 1 Processor -- start 2023-06-08T03:50:08.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.201+0000 7fae28167700 1 -- start start 2023-06-08T03:50:08.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae28167700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200cb490 0x7fae201607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae28167700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fae20069db0 0x7fae2006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae28167700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae20071c50 con 0x7fae200720e0 2023-06-08T03:50:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae28167700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200cb860 con 0x7fae20069db0 2023-06-08T03:50:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae28167700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2006a730 con 0x7fae200cb490 2023-06-08T03:50:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae26704700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fae20069db0 0x7fae2006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae25702700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fae200720e0 0x7fae200cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55424/0 (socket says 172.21.15.43:55424) 2023-06-08T03:50:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae26704700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fae20069db0 0x7fae2006a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60522/0 (socket says 172.21.15.43:60522) 2023-06-08T03:50:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae25702700 1 -- 172.21.15.43:0/3900888446 learned_addr learned my addr 172.21.15.43:0/3900888446 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae25f03700 1 --2- 172.21.15.43:0/3900888446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200cb490 0x7fae201607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae26704700 1 -- 172.21.15.43:0/3900888446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200cb490 msgr2=0x7fae201607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae26704700 1 --2- 172.21.15.43:0/3900888446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200cb490 0x7fae201607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae26704700 1 -- 172.21.15.43:0/3900888446 >> v1:172.21.15.43:6789/0 conn(0x7fae200720e0 legacy=0x7fae200cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.202+0000 7fae26704700 1 -- 172.21.15.43:0/3900888446 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20071320 con 0x7fae20069db0 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae26704700 1 --2- 172.21.15.43:0/3900888446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae20069db0 0x7fae2006a1f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae18009d90 tx=0x7fae1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c19cb9ab2a63ed1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae24f01700 1 -- 172.21.15.43:0/3900888446 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800e070 con 0x7fae20069db0 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae24f01700 1 -- 172.21.15.43:0/3900888446 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800bbd0 con 0x7fae20069db0 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae24f01700 1 -- 172.21.15.43:0/3900888446 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18012430 con 0x7fae20069db0 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 -- 172.21.15.43:0/3900888446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae20069db0 msgr2=0x7fae2006a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 --2- 172.21.15.43:0/3900888446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae20069db0 0x7fae2006a1f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae18009d90 tx=0x7fae1800b330 comp rx=0 tx=0).stop 2023-06-08T03:50:08.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 -- 172.21.15.43:0/3900888446 shutdown_connections 2023-06-08T03:50:08.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 --2- 172.21.15.43:0/3900888446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae20069db0 0x7fae2006a1f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 --2- 172.21.15.43:0/3900888446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200cb490 0x7fae201607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 -- 172.21.15.43:0/3900888446 >> 172.21.15.43:0/3900888446 conn(0x7fae2006d180 msgr2=0x7fae2006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:08.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 -- 172.21.15.43:0/3900888446 shutdown_connections 2023-06-08T03:50:08.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.203+0000 7fae28167700 1 -- 172.21.15.43:0/3900888446 wait complete. 2023-06-08T03:50:08.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.205+0000 7fae28167700 1 Processor -- start 2023-06-08T03:50:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.205+0000 7fae28167700 1 -- start start 2023-06-08T03:50:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae28167700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae20069db0 0x7fae201f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae28167700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200720e0 0x7fae20156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae28167700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 0x7fae200b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae28167700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae20157320 con 0x7fae200cb490 2023-06-08T03:50:08.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae28167700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200cac10 con 0x7fae20069db0 2023-06-08T03:50:08.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae28167700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200c4390 con 0x7fae200720e0 2023-06-08T03:50:08.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae26704700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 0x7fae200b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae26704700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 0x7fae200b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60528/0 (socket says 172.21.15.43:60528) 2023-06-08T03:50:08.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae26704700 1 -- 172.21.15.43:0/1664415644 learned_addr learned my addr 172.21.15.43:0/1664415644 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:08.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae25702700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200720e0 0x7fae20156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.206+0000 7fae25f03700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae20069db0 0x7fae201f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae26704700 1 -- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200720e0 msgr2=0x7fae20156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae26704700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200720e0 0x7fae20156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae26704700 1 -- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae20069db0 msgr2=0x7fae201f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae26704700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae20069db0 0x7fae201f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae26704700 1 -- 172.21.15.43:0/1664415644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18009a70 con 0x7fae200cb490 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae25702700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200720e0 0x7fae20156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae25f03700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae20069db0 0x7fae201f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae26704700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 0x7fae200b0160 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae18014040 tx=0x7fae18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18003ea0 con 0x7fae200cb490 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18020070 con 0x7fae200cb490 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae20158940 con 0x7fae200cb490 2023-06-08T03:50:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18004280 con 0x7fae200cb490 2023-06-08T03:50:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.207+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae200c4910 con 0x7fae200cb490 2023-06-08T03:50:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.208+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20073fa0 con 0x7fae200cb490 2023-06-08T03:50:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.208+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae180043e0 con 0x7fae200cb490 2023-06-08T03:50:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.209+0000 7fae167fc700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae0406ace0 0x7fae0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.209+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fae18022070 con 0x7fae200cb490 2023-06-08T03:50:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.209+0000 7fae25f03700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae0406ace0 0x7fae0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.210+0000 7fae25f03700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae0406ace0 0x7fae0406d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae200b0d40 tx=0x7fae10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.213+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fae18056540 con 0x7fae200cb490 2023-06-08T03:50:08.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.409+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae20071600 con 0x7fae0406ace0 2023-06-08T03:50:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.418+0000 7fae167fc700 1 -- 172.21.15.43:0/1664415644 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299591 (secure 0 0 0) 0x7fae10009680 con 0x7fae0406ace0 2023-06-08T03:50:08.425 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae0406ace0 msgr2=0x7fae0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae0406ace0 0x7fae0406d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae200b0d40 tx=0x7fae10008040 comp rx=0 tx=0).stop 2023-06-08T03:50:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 msgr2=0x7fae200b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 0x7fae200b0160 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae18014040 tx=0x7fae18004ad0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 shutdown_connections 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fae0406ace0 0x7fae0406d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae200cb490 0x7fae200b0160 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae20069db0 0x7fae201f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 --2- 172.21.15.43:0/1664415644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae200720e0 0x7fae20156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 >> 172.21.15.43:0/1664415644 conn(0x7fae2006d180 msgr2=0x7fae200b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 shutdown_connections 2023-06-08T03:50:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.421+0000 7fae28167700 1 -- 172.21.15.43:0/1664415644 wait complete. 2023-06-08T03:50:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:50:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-06-08T03:50:07.584082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220092,"kb_used_data":4476,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754628,"statfs":{"total":773094113280,"available":772868739072,"internally_reserved":0,"allocated":4583424,"data_stored":2669566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.721244"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866814+0000","last_change":"2023-06-08T03:50:02.866814+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866814+0000","last_undegraded":"2023-06-08T03:50:02.866814+0000","last_fullsized":"2023-06-08T03:50:02.866814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865056+0000","last_change":"2023-06-08T03:50:02.865056+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865056+0000","last_undegraded":"2023-06-08T03:50:02.865056+0000","last_fullsized":"2023-06-08T03:50:02.865056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868800+0000","last_change":"2023-06-08T03:50:02.868800+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868800+0000","last_undegraded":"2023-06-08T03:50:02.868800+0000","last_fullsized":"2023-06-08T03:50:02.868800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869706+0000","last_change":"2023-06-08T03:50:02.869706+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869706+0000","last_undegraded":"2023-06-08T03:50:02.869706+0000","last_fullsized":"2023-06-08T03:50:02.869706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866856+0000","last_change":"2023-06-08T03:50:02.866856+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866856+0000","last_undegraded":"2023-06-08T03:50:02.866856+0000","last_fullsized":"2023-06-08T03:50:02.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864896+0000","last_change":"2023-06-08T03:50:02.864896+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864896+0000","last_undegraded":"2023-06-08T03:50:02.864896+0000","last_fullsized":"2023-06-08T03:50:02.864896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867007+0000","last_change":"2023-06-08T03:50:02.867007+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867007+0000","last_undegraded":"2023-06-08T03:50:02.867007+0000","last_fullsized":"2023-06-08T03:50:02.867007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.871530+0000","last_change":"2023-06-08T03:50:02.871530+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.871530+0000","last_undegraded":"2023-06-08T03:50:02.871530+0000","last_fullsized":"2023-06-08T03:50:02.871530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864902+0000","last_change":"2023-06-08T03:50:02.864902+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864902+0000","last_undegraded":"2023-06-08T03:50:02.864902+0000","last_fullsized":"2023-06-08T03:50:02.864902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870890+0000","last_change":"2023-06-08T03:50:02.870890+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870890+0000","last_undegraded":"2023-06-08T03:50:02.870890+0000","last_fullsized":"2023-06-08T03:50:02.870890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870368+0000","last_change":"2023-06-08T03:50:02.870368+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870368+0000","last_undegraded":"2023-06-08T03:50:02.870368+0000","last_fullsized":"2023-06-08T03:50:02.870368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864306+0000","last_change":"2023-06-08T03:50:02.864306+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864306+0000","last_undegraded":"2023-06-08T03:50:02.864306+0000","last_fullsized":"2023-06-08T03:50:02.864306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867844+0000","last_change":"2023-06-08T03:50:02.867844+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867844+0000","last_undegraded":"2023-06-08T03:50:02.867844+0000","last_fullsized":"2023-06-08T03:50:02.867844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870135+0000","last_change":"2023-06-08T03:50:02.870135+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870135+0000","last_undegraded":"2023-06-08T03:50:02.870135+0000","last_fullsized":"2023-06-08T03:50:02.870135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866691+0000","last_change":"2023-06-08T03:50:02.866691+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866691+0000","last_undegraded":"2023-06-08T03:50:02.866691+0000","last_fullsized":"2023-06-08T03:50:02.866691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.871025+0000","last_change":"2023-06-08T03:50:02.871025+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.871025+0000","last_undegraded":"2023-06-08T03:50:02.871025+0000","last_fullsized":"2023-06-08T03:50:02.871025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864154+0000","last_change":"2023-06-08T03:50:02.864154+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864154+0000","last_undegraded":"2023-06-08T03:50:02.864154+0000","last_fullsized":"2023-06-08T03:50:02.864154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865503+0000","last_change":"2023-06-08T03:50:02.865503+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865503+0000","last_undegraded":"2023-06-08T03:50:02.865503+0000","last_fullsized":"2023-06-08T03:50:02.865503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866988+0000","last_change":"2023-06-08T03:50:02.866988+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866988+0000","last_undegraded":"2023-06-08T03:50:02.866988+0000","last_fullsized":"2023-06-08T03:50:02.866988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866732+0000","last_change":"2023-06-08T03:50:02.866732+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866732+0000","last_undegraded":"2023-06-08T03:50:02.866732+0000","last_fullsized":"2023-06-08T03:50:02.866732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867438+0000","last_change":"2023-06-08T03:50:02.867438+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867438+0000","last_undegraded":"2023-06-08T03:50:02.867438+0000","last_fullsized":"2023-06-08T03:50:02.867438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866943+0000","last_change":"2023-06-08T03:50:02.866943+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866943+0000","last_undegraded":"2023-06-08T03:50:02.866943+0000","last_fullsized":"2023-06-08T03:50:02.866943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870650+0000","last_change":"2023-06-08T03:50:02.870650+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870650+0000","last_undegraded":"2023-06-08T03:50:02.870650+0000","last_fullsized":"2023-06-08T03:50:02.870650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869688+0000","last_change":"2023-06-08T03:50:02.869688+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869688+0000","last_undegraded":"2023-06-08T03:50:02.869688+0000","last_fullsized":"2023-06-08T03:50:02.869688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865406+0000","last_change":"2023-06-08T03:50:02.865406+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865406+0000","last_undegraded":"2023-06-08T03:50:02.865406+0000","last_fullsized":"2023-06-08T03:50:02.865406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.865813+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:50:02.865813+0000","last_peered":"2023-06-08T03:50:02.865813+0000","last_clean":"2023-06-08T03:50:02.865813+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:50:02.865813+0000","last_undegraded":"2023-06-08T03:50:02.865813+0000","last_fullsized":"2023-06-08T03:50:02.865813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:43:09.304957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869690+0000","last_change":"2023-06-08T03:50:02.869690+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869690+0000","last_undegraded":"2023-06-08T03:50:02.869690+0000","last_fullsized":"2023-06-08T03:50:02.869690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.869567+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:50:02.869567+0000","last_peered":"2023-06-08T03:50:02.869567+0000","last_clean":"2023-06-08T03:50:02.869567+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:50:02.869567+0000","last_undegraded":"2023-06-08T03:50:02.869567+0000","last_fullsized":"2023-06-08T03:50:02.869567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:06:56.764377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868739+0000","last_change":"2023-06-08T03:50:02.868739+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868739+0000","last_undegraded":"2023-06-08T03:50:02.868739+0000","last_fullsized":"2023-06-08T03:50:02.868739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.869264+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:50:02.869264+0000","last_peered":"2023-06-08T03:50:02.869264+0000","last_clean":"2023-06-08T03:50:02.869264+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:50:02.869264+0000","last_undegraded":"2023-06-08T03:50:02.869264+0000","last_fullsized":"2023-06-08T03:50:02.869264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:59:18.278003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870989+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:50:02.870989+0000","last_peered":"2023-06-08T03:50:02.870989+0000","last_clean":"2023-06-08T03:50:02.870989+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:50:02.870989+0000","last_undegraded":"2023-06-08T03:50:02.870989+0000","last_fullsized":"2023-06-08T03:50:02.870989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:16:37.351304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869724+0000","last_change":"2023-06-08T03:50:02.869724+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869724+0000","last_undegraded":"2023-06-08T03:50:02.869724+0000","last_fullsized":"2023-06-08T03:50:02.869724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870835+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:50:02.870835+0000","last_peered":"2023-06-08T03:50:02.870835+0000","last_clean":"2023-06-08T03:50:02.870835+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:50:02.870835+0000","last_undegraded":"2023-06-08T03:50:02.870835+0000","last_fullsized":"2023-06-08T03:50:02.870835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:02:07.450181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866970+0000","last_change":"2023-06-08T03:50:02.866970+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866970+0000","last_undegraded":"2023-06-08T03:50:02.866970+0000","last_fullsized":"2023-06-08T03:50:02.866970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870969+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:50:02.870969+0000","last_peered":"2023-06-08T03:50:02.870969+0000","last_clean":"2023-06-08T03:50:02.870969+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:50:02.870969+0000","last_undegraded":"2023-06-08T03:50:02.870969+0000","last_fullsized":"2023-06-08T03:50:02.870969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:53:02.577036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866780+0000","last_change":"2023-06-08T03:50:02.866780+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866780+0000","last_undegraded":"2023-06-08T03:50:02.866780+0000","last_fullsized":"2023-06-08T03:50:02.866780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.867772+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:50:02.867772+0000","last_peered":"2023-06-08T03:50:02.867772+0000","last_clean":"2023-06-08T03:50:02.867772+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:50:02.867772+0000","last_undegraded":"2023-06-08T03:50:02.867772+0000","last_fullsized":"2023-06-08T03:50:02.867772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:11:06.128259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868693+0000","last_change":"2023-06-08T03:50:02.868693+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868693+0000","last_undegraded":"2023-06-08T03:50:02.868693+0000","last_fullsized":"2023-06-08T03:50:02.868693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.864559+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:50:02.864559+0000","last_peered":"2023-06-08T03:50:02.864559+0000","last_clean":"2023-06-08T03:50:02.864559+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:50:02.864559+0000","last_undegraded":"2023-06-08T03:50:02.864559+0000","last_fullsized":"2023-06-08T03:50:02.864559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:54:15.663142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870514+0000","last_change":"2023-06-08T03:50:02.870514+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870514+0000","last_undegraded":"2023-06-08T03:50:02.870514+0000","last_fullsized":"2023-06-08T03:50:02.870514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.864690+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:50:02.864690+0000","last_peered":"2023-06-08T03:50:02.864690+0000","last_clean":"2023-06-08T03:50:02.864690+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:50:02.864690+0000","last_undegraded":"2023-06-08T03:50:02.864690+0000","last_fullsized":"2023-06-08T03:50:02.864690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:12:07.481722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":770793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.498}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.1760000000000002,"5min":5.1760000000000002,"15min":5.1760000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":777283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.22}]},{"osd":2,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":7.0410000000000004,"5min":7.0410000000000004,"15min":7.0410000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.944,"5min":6.944,"15min":6.944},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.9870000000000001,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.752}]},{"osd":6,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.5179999999999998,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":7.5570000000000004,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.436}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.923,"5min":11.923,"15min":11.923},"last":0.309}]},{"osd":3,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.877000000000001,"5min":11.877000000000001,"15min":11.877000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.048,"5min":8.048,"15min":8.048},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.2089999999999996,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.499}]},{"osd":3,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.439}]},{"osd":5,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.622}]},{"osd":7,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:50:08.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:50:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.597+0000 7fa9fc5a0700 1 Processor -- start 2023-06-08T03:50:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.598+0000 7fa9fc5a0700 1 -- start start 2023-06-08T03:50:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.598+0000 7fa9fc5a0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa9f40709a0 0x7fa9f415af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.598+0000 7fa9fc5a0700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9f4070d70 0x7fa9f415b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.598+0000 7fa9fc5a0700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f4157ed0 con 0x7fa9f415e440 2023-06-08T03:50:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.598+0000 7fa9fc5a0700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f415da30 con 0x7fa9f4070d70 2023-06-08T03:50:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.598+0000 7fa9fc5a0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f40cb2e0 con 0x7fa9f40709a0 2023-06-08T03:50:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fab3d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9f4070d70 0x7fa9f415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9f9b3b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa9f415e440 0x7fa9f40caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55436/0 (socket says 172.21.15.43:55436) 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9f9b3b700 1 -- 172.21.15.43:0/3591185776 learned_addr learned my addr 172.21.15.43:0/3591185776 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fa33c700 1 --2- 172.21.15.43:0/3591185776 >> v2:172.21.15.135:3300/0 conn(0x7fa9f40709a0 0x7fa9f415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fab3d700 1 -- 172.21.15.43:0/3591185776 >> v2:172.21.15.135:3300/0 conn(0x7fa9f40709a0 msgr2=0x7fa9f415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fab3d700 1 --2- 172.21.15.43:0/3591185776 >> v2:172.21.15.135:3300/0 conn(0x7fa9f40709a0 0x7fa9f415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fab3d700 1 -- 172.21.15.43:0/3591185776 >> v1:172.21.15.43:6789/0 conn(0x7fa9f415e440 legacy=0x7fa9f40caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fab3d700 1 -- 172.21.15.43:0/3591185776 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f40cb5c0 con 0x7fa9f4070d70 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9fab3d700 1 --2- 172.21.15.43:0/3591185776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f4070d70 0x7fa9f415b600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4067240 tx=0x7fa9ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c861506f384d6b1d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9f933a700 1 -- 172.21.15.43:0/3591185776 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00e070 con 0x7fa9f4070d70 2023-06-08T03:50:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9f933a700 1 -- 172.21.15.43:0/3591185776 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec00bbd0 con 0x7fa9f4070d70 2023-06-08T03:50:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.599+0000 7fa9f933a700 1 -- 172.21.15.43:0/3591185776 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec012430 con 0x7fa9f4070d70 2023-06-08T03:50:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/3591185776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f4070d70 msgr2=0x7fa9f415b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/3591185776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f4070d70 0x7fa9f415b600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4067240 tx=0x7fa9ec00b330 comp rx=0 tx=0).stop 2023-06-08T03:50:08.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/3591185776 shutdown_connections 2023-06-08T03:50:08.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/3591185776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f4070d70 0x7fa9f415b600 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/3591185776 >> v2:172.21.15.135:3300/0 conn(0x7fa9f40709a0 0x7fa9f415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/3591185776 >> 172.21.15.43:0/3591185776 conn(0x7fa9f40ceed0 msgr2=0x7fa9f40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/3591185776 shutdown_connections 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.600+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/3591185776 wait complete. 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.601+0000 7fa9fc5a0700 1 Processor -- start 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.601+0000 7fa9fc5a0700 1 -- start start 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fc5a0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40709a0 0x7fa9f4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fc5a0700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f4070d70 0x7fa9f4156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fc5a0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 0x7fa9f41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fc5a0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40b2330 con 0x7fa9f415e440 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fc5a0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f415a0b0 con 0x7fa9f40709a0 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fc5a0700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40b1d00 con 0x7fa9f4070d70 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 0x7fa9f41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 0x7fa9f41590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60542/0 (socket says 172.21.15.43:60542) 2023-06-08T03:50:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 -- 172.21.15.43:0/2249410026 learned_addr learned my addr 172.21.15.43:0/2249410026 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fa33c700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40709a0 0x7fa9f4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9f9b3b700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f4070d70 0x7fa9f4156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 -- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f4070d70 msgr2=0x7fa9f4156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f4070d70 0x7fa9f4156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 -- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40709a0 msgr2=0x7fa9f4157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40709a0 0x7fa9f4157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.602+0000 7fa9fab3d700 1 -- 172.21.15.43:0/2249410026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec009a70 con 0x7fa9f415e440 2023-06-08T03:50:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.603+0000 7fa9fab3d700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 0x7fa9f41590b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40cfd00 tx=0x7fa9ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.603+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec012430 con 0x7fa9f415e440 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.603+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec020070 con 0x7fa9f415e440 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.603+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f415a300 con 0x7fa9f415e440 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.603+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0098f0 con 0x7fa9f415e440 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.603+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f41569b0 con 0x7fa9f415e440 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.604+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f415a540 con 0x7fa9f415e440 2023-06-08T03:50:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.604+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9ec004040 con 0x7fa9f415e440 2023-06-08T03:50:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.605+0000 7fa9eaffd700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa9d806ace0 0x7fa9d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.605+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa9ec022070 con 0x7fa9f415e440 2023-06-08T03:50:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.605+0000 7fa9fa33c700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa9d806ace0 0x7fa9d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.606+0000 7fa9fa33c700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa9d806ace0 0x7fa9d806d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa9f41e6580 tx=0x7fa9e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.609+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9ec0565e0 con 0x7fa9f415e440 2023-06-08T03:50:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.801+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9f415df20 con 0x7fa9d806ace0 2023-06-08T03:50:08.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.809+0000 7fa9eaffd700 1 -- 172.21.15.43:0/2249410026 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299591 (secure 0 0 0) 0x7fa9e4009e40 con 0x7fa9d806ace0 2023-06-08T03:50:08.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.812+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa9d806ace0 msgr2=0x7fa9d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.812+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa9d806ace0 0x7fa9d806d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa9f41e6580 tx=0x7fa9e4008040 comp rx=0 tx=0).stop 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 msgr2=0x7fa9f41590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 0x7fa9f41590b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40cfd00 tx=0x7fa9ec004ad0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 shutdown_connections 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fa9d806ace0 0x7fa9d806d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9f415e440 0x7fa9f41590b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40709a0 0x7fa9f4157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 --2- 172.21.15.43:0/2249410026 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f4070d70 0x7fa9f4156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 >> 172.21.15.43:0/2249410026 conn(0x7fa9f40ceed0 msgr2=0x7fa9f40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 shutdown_connections 2023-06-08T03:50:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.813+0000 7fa9fc5a0700 1 -- 172.21.15.43:0/2249410026 wait complete. 2023-06-08T03:50:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:50:08.829 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-06-08T03:50:07.584082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220092,"kb_used_data":4476,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754628,"statfs":{"total":773094113280,"available":772868739072,"internally_reserved":0,"allocated":4583424,"data_stored":2669566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.721244"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866814+0000","last_change":"2023-06-08T03:50:02.866814+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866814+0000","last_undegraded":"2023-06-08T03:50:02.866814+0000","last_fullsized":"2023-06-08T03:50:02.866814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865056+0000","last_change":"2023-06-08T03:50:02.865056+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865056+0000","last_undegraded":"2023-06-08T03:50:02.865056+0000","last_fullsized":"2023-06-08T03:50:02.865056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868800+0000","last_change":"2023-06-08T03:50:02.868800+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868800+0000","last_undegraded":"2023-06-08T03:50:02.868800+0000","last_fullsized":"2023-06-08T03:50:02.868800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869706+0000","last_change":"2023-06-08T03:50:02.869706+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869706+0000","last_undegraded":"2023-06-08T03:50:02.869706+0000","last_fullsized":"2023-06-08T03:50:02.869706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866856+0000","last_change":"2023-06-08T03:50:02.866856+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866856+0000","last_undegraded":"2023-06-08T03:50:02.866856+0000","last_fullsized":"2023-06-08T03:50:02.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864896+0000","last_change":"2023-06-08T03:50:02.864896+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864896+0000","last_undegraded":"2023-06-08T03:50:02.864896+0000","last_fullsized":"2023-06-08T03:50:02.864896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867007+0000","last_change":"2023-06-08T03:50:02.867007+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867007+0000","last_undegraded":"2023-06-08T03:50:02.867007+0000","last_fullsized":"2023-06-08T03:50:02.867007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.871530+0000","last_change":"2023-06-08T03:50:02.871530+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.871530+0000","last_undegraded":"2023-06-08T03:50:02.871530+0000","last_fullsized":"2023-06-08T03:50:02.871530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864902+0000","last_change":"2023-06-08T03:50:02.864902+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864902+0000","last_undegraded":"2023-06-08T03:50:02.864902+0000","last_fullsized":"2023-06-08T03:50:02.864902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870890+0000","last_change":"2023-06-08T03:50:02.870890+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870890+0000","last_undegraded":"2023-06-08T03:50:02.870890+0000","last_fullsized":"2023-06-08T03:50:02.870890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870368+0000","last_change":"2023-06-08T03:50:02.870368+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870368+0000","last_undegraded":"2023-06-08T03:50:02.870368+0000","last_fullsized":"2023-06-08T03:50:02.870368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864306+0000","last_change":"2023-06-08T03:50:02.864306+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864306+0000","last_undegraded":"2023-06-08T03:50:02.864306+0000","last_fullsized":"2023-06-08T03:50:02.864306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867844+0000","last_change":"2023-06-08T03:50:02.867844+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867844+0000","last_undegraded":"2023-06-08T03:50:02.867844+0000","last_fullsized":"2023-06-08T03:50:02.867844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870135+0000","last_change":"2023-06-08T03:50:02.870135+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870135+0000","last_undegraded":"2023-06-08T03:50:02.870135+0000","last_fullsized":"2023-06-08T03:50:02.870135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866691+0000","last_change":"2023-06-08T03:50:02.866691+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866691+0000","last_undegraded":"2023-06-08T03:50:02.866691+0000","last_fullsized":"2023-06-08T03:50:02.866691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.871025+0000","last_change":"2023-06-08T03:50:02.871025+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.871025+0000","last_undegraded":"2023-06-08T03:50:02.871025+0000","last_fullsized":"2023-06-08T03:50:02.871025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864154+0000","last_change":"2023-06-08T03:50:02.864154+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864154+0000","last_undegraded":"2023-06-08T03:50:02.864154+0000","last_fullsized":"2023-06-08T03:50:02.864154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865503+0000","last_change":"2023-06-08T03:50:02.865503+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865503+0000","last_undegraded":"2023-06-08T03:50:02.865503+0000","last_fullsized":"2023-06-08T03:50:02.865503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866988+0000","last_change":"2023-06-08T03:50:02.866988+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866988+0000","last_undegraded":"2023-06-08T03:50:02.866988+0000","last_fullsized":"2023-06-08T03:50:02.866988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866732+0000","last_change":"2023-06-08T03:50:02.866732+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866732+0000","last_undegraded":"2023-06-08T03:50:02.866732+0000","last_fullsized":"2023-06-08T03:50:02.866732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867438+0000","last_change":"2023-06-08T03:50:02.867438+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867438+0000","last_undegraded":"2023-06-08T03:50:02.867438+0000","last_fullsized":"2023-06-08T03:50:02.867438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866943+0000","last_change":"2023-06-08T03:50:02.866943+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866943+0000","last_undegraded":"2023-06-08T03:50:02.866943+0000","last_fullsized":"2023-06-08T03:50:02.866943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870650+0000","last_change":"2023-06-08T03:50:02.870650+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870650+0000","last_undegraded":"2023-06-08T03:50:02.870650+0000","last_fullsized":"2023-06-08T03:50:02.870650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869688+0000","last_change":"2023-06-08T03:50:02.869688+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869688+0000","last_undegraded":"2023-06-08T03:50:02.869688+0000","last_fullsized":"2023-06-08T03:50:02.869688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865406+0000","last_change":"2023-06-08T03:50:02.865406+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865406+0000","last_undegraded":"2023-06-08T03:50:02.865406+0000","last_fullsized":"2023-06-08T03:50:02.865406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.865813+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:50:02.865813+0000","last_peered":"2023-06-08T03:50:02.865813+0000","last_clean":"2023-06-08T03:50:02.865813+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:50:02.865813+0000","last_undegraded":"2023-06-08T03:50:02.865813+0000","last_fullsized":"2023-06-08T03:50:02.865813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:43:09.304957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869690+0000","last_change":"2023-06-08T03:50:02.869690+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869690+0000","last_undegraded":"2023-06-08T03:50:02.869690+0000","last_fullsized":"2023-06-08T03:50:02.869690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.869567+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:50:02.869567+0000","last_peered":"2023-06-08T03:50:02.869567+0000","last_clean":"2023-06-08T03:50:02.869567+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:50:02.869567+0000","last_undegraded":"2023-06-08T03:50:02.869567+0000","last_fullsized":"2023-06-08T03:50:02.869567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:06:56.764377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868739+0000","last_change":"2023-06-08T03:50:02.868739+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868739+0000","last_undegraded":"2023-06-08T03:50:02.868739+0000","last_fullsized":"2023-06-08T03:50:02.868739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.869264+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:50:02.869264+0000","last_peered":"2023-06-08T03:50:02.869264+0000","last_clean":"2023-06-08T03:50:02.869264+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:50:02.869264+0000","last_undegraded":"2023-06-08T03:50:02.869264+0000","last_fullsized":"2023-06-08T03:50:02.869264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:59:18.278003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870989+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:50:02.870989+0000","last_peered":"2023-06-08T03:50:02.870989+0000","last_clean":"2023-06-08T03:50:02.870989+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:50:02.870989+0000","last_undegraded":"2023-06-08T03:50:02.870989+0000","last_fullsized":"2023-06-08T03:50:02.870989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:16:37.351304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869724+0000","last_change":"2023-06-08T03:50:02.869724+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869724+0000","last_undegraded":"2023-06-08T03:50:02.869724+0000","last_fullsized":"2023-06-08T03:50:02.869724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870835+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:50:02.870835+0000","last_peered":"2023-06-08T03:50:02.870835+0000","last_clean":"2023-06-08T03:50:02.870835+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:50:02.870835+0000","last_undegraded":"2023-06-08T03:50:02.870835+0000","last_fullsized":"2023-06-08T03:50:02.870835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:02:07.450181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866970+0000","last_change":"2023-06-08T03:50:02.866970+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866970+0000","last_undegraded":"2023-06-08T03:50:02.866970+0000","last_fullsized":"2023-06-08T03:50:02.866970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870969+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:50:02.870969+0000","last_peered":"2023-06-08T03:50:02.870969+0000","last_clean":"2023-06-08T03:50:02.870969+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:50:02.870969+0000","last_undegraded":"2023-06-08T03:50:02.870969+0000","last_fullsized":"2023-06-08T03:50:02.870969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:53:02.577036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866780+0000","last_change":"2023-06-08T03:50:02.866780+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866780+0000","last_undegraded":"2023-06-08T03:50:02.866780+0000","last_fullsized":"2023-06-08T03:50:02.866780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.867772+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:50:02.867772+0000","last_peered":"2023-06-08T03:50:02.867772+0000","last_clean":"2023-06-08T03:50:02.867772+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:50:02.867772+0000","last_undegraded":"2023-06-08T03:50:02.867772+0000","last_fullsized":"2023-06-08T03:50:02.867772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:11:06.128259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868693+0000","last_change":"2023-06-08T03:50:02.868693+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868693+0000","last_undegraded":"2023-06-08T03:50:02.868693+0000","last_fullsized":"2023-06-08T03:50:02.868693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.864559+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:50:02.864559+0000","last_peered":"2023-06-08T03:50:02.864559+0000","last_clean":"2023-06-08T03:50:02.864559+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:50:02.864559+0000","last_undegraded":"2023-06-08T03:50:02.864559+0000","last_fullsized":"2023-06-08T03:50:02.864559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:54:15.663142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870514+0000","last_change":"2023-06-08T03:50:02.870514+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870514+0000","last_undegraded":"2023-06-08T03:50:02.870514+0000","last_fullsized":"2023-06-08T03:50:02.870514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.864690+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:50:02.864690+0000","last_peered":"2023-06-08T03:50:02.864690+0000","last_clean":"2023-06-08T03:50:02.864690+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:50:02.864690+0000","last_undegraded":"2023-06-08T03:50:02.864690+0000","last_fullsized":"2023-06-08T03:50:02.864690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:12:07.481722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":770793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.498}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.1760000000000002,"5min":5.1760000000000002,"15min":5.1760000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":777283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.22}]},{"osd":2,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":7.0410000000000004,"5min":7.0410000000000004,"15min":7.0410000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.944,"5min":6.944,"15min":6.944},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.9870000000000001,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.752}]},{"osd":6,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.5179999999999998,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":7.5570000000000004,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.436}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.923,"5min":11.923,"15min":11.923},"last":0.309}]},{"osd":3,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.877000000000001,"5min":11.877000000000001,"15min":11.877000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.048,"5min":8.048,"15min":8.048},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.2089999999999996,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.499}]},{"osd":3,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.439}]},{"osd":5,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.622}]},{"osd":7,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:50:08.835 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:50:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.990+0000 7f0304061700 1 Processor -- start 2023-06-08T03:50:08.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.990+0000 7f0304061700 1 -- start start 2023-06-08T03:50:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f0304061700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02fc071560 0x7f02fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f0304061700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc06a2f0 0x7f02fc0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f0304061700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc15c8f0 con 0x7f02fc15c520 2023-06-08T03:50:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f0304061700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc0cd940 con 0x7f02fc071560 2023-06-08T03:50:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f0304061700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc06a770 con 0x7f02fc06a2f0 2023-06-08T03:50:08.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02fc071560 0x7f02fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02fc071560 0x7f02fc069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60548/0 (socket says 172.21.15.43:60548) 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 -- 172.21.15.43:0/1122671768 learned_addr learned my addr 172.21.15.43:0/1122671768 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 -- 172.21.15.43:0/1122671768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc06a2f0 msgr2=0x7f02fc0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 --2- 172.21.15.43:0/1122671768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc06a2f0 0x7f02fc0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 -- 172.21.15.43:0/1122671768 >> v1:172.21.15.135:6789/0 conn(0x7f02fc15c520 legacy=0x7f02fc0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.991+0000 7f03015fc700 1 -- 172.21.15.43:0/1122671768 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0719b0 con 0x7f02fc071560 2023-06-08T03:50:08.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f03015fc700 1 --2- 172.21.15.43:0/1122671768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc071560 0x7f02fc069db0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06a8b0 tx=0x7f02f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6403c670d7df980 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:08.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0300dfb700 1 -- 172.21.15.43:0/1122671768 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8011830 con 0x7f02fc071560 2023-06-08T03:50:08.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0300dfb700 1 -- 172.21.15.43:0/1122671768 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8011990 con 0x7f02fc071560 2023-06-08T03:50:08.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0300dfb700 1 -- 172.21.15.43:0/1122671768 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8011d20 con 0x7f02fc071560 2023-06-08T03:50:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 -- 172.21.15.43:0/1122671768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc071560 msgr2=0x7f02fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 --2- 172.21.15.43:0/1122671768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc071560 0x7f02fc069db0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06a8b0 tx=0x7f02f8009bd0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 -- 172.21.15.43:0/1122671768 shutdown_connections 2023-06-08T03:50:09.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 --2- 172.21.15.43:0/1122671768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc06a2f0 0x7f02fc0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 --2- 172.21.15.43:0/1122671768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc071560 0x7f02fc069db0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 -- 172.21.15.43:0/1122671768 >> 172.21.15.43:0/1122671768 conn(0x7f02fc06aec0 msgr2=0x7f02fc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 -- 172.21.15.43:0/1122671768 shutdown_connections 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.992+0000 7f0304061700 1 -- 172.21.15.43:0/1122671768 wait complete. 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.994+0000 7f0304061700 1 Processor -- start 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.994+0000 7f0304061700 1 -- start start 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0304061700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 0x7f02fc1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0304061700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc071560 0x7f02fc155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0304061700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02fc15c520 0x7f02fc15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0304061700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0c5d70 con 0x7f02fc06a2f0 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0304061700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0c5160 con 0x7f02fc15c520 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0304061700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0c5440 con 0x7f02fc071560 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 0x7f02fc1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 0x7f02fc1558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60552/0 (socket says 172.21.15.43:60552) 2023-06-08T03:50:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 -- 172.21.15.43:0/2482573586 learned_addr learned my addr 172.21.15.43:0/2482573586 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f03015fc700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc071560 0x7f02fc155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f03025fe700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02fc15c520 0x7f02fc15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 -- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc071560 msgr2=0x7f02fc155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc071560 0x7f02fc155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 -- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02fc15c520 msgr2=0x7f02fc15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02fc15c520 0x7f02fc15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 -- 172.21.15.43:0/2482573586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8009550 con 0x7f02fc06a2f0 2023-06-08T03:50:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f03025fe700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02fc15c520 0x7f02fc15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f0301dfd700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 0x7f02fc1558e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b470 tx=0x7f02ec00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec011830 con 0x7f02fc06a2f0 2023-06-08T03:50:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.995+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec011990 con 0x7f02fc06a2f0 2023-06-08T03:50:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.996+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc0c5720 con 0x7f02fc06a2f0 2023-06-08T03:50:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.996+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec011d40 con 0x7f02fc06a2f0 2023-06-08T03:50:09.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.996+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc0ae640 con 0x7f02fc06a2f0 2023-06-08T03:50:09.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.997+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc073fa0 con 0x7f02fc06a2f0 2023-06-08T03:50:09.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.997+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02ec01a400 con 0x7f02fc06a2f0 2023-06-08T03:50:09.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.997+0000 7f02f27fc700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f02e006ace0 0x7f02e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.997+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f02ec089720 con 0x7f02fc06a2f0 2023-06-08T03:50:09.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.998+0000 7f03015fc700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f02e006ace0 0x7f02e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:08.998+0000 7f03015fc700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f02e006ace0 0x7f02e006d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02f8000c00 tx=0x7f02f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.002+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02ec054690 con 0x7f02fc06a2f0 2023-06-08T03:50:09.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.193+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02fc0cd3c0 con 0x7f02e006ace0 2023-06-08T03:50:09.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.202+0000 7f02f27fc700 1 -- 172.21.15.43:0/2482573586 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299591 (secure 0 0 0) 0x7f02f8011c80 con 0x7f02e006ace0 2023-06-08T03:50:09.209 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:09.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.205+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f02e006ace0 msgr2=0x7f02e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f02e006ace0 0x7f02e006d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02f8000c00 tx=0x7f02f8008030 comp rx=0 tx=0).stop 2023-06-08T03:50:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 msgr2=0x7f02fc1558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 0x7f02fc1558e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b470 tx=0x7f02ec00b830 comp rx=0 tx=0).stop 2023-06-08T03:50:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 shutdown_connections 2023-06-08T03:50:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f02e006ace0 0x7f02e006d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02fc06a2f0 0x7f02fc1558e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02fc15c520 0x7f02fc15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 --2- 172.21.15.43:0/2482573586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02fc071560 0x7f02fc155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 >> 172.21.15.43:0/2482573586 conn(0x7f02fc06aec0 msgr2=0x7f02fc0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 shutdown_connections 2023-06-08T03:50:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.206+0000 7f0304061700 1 -- 172.21.15.43:0/2482573586 wait complete. 2023-06-08T03:50:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:50:09.222 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-06-08T03:50:07.584082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220092,"kb_used_data":4476,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754628,"statfs":{"total":773094113280,"available":772868739072,"internally_reserved":0,"allocated":4583424,"data_stored":2669566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.721244"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866814+0000","last_change":"2023-06-08T03:50:02.866814+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866814+0000","last_undegraded":"2023-06-08T03:50:02.866814+0000","last_fullsized":"2023-06-08T03:50:02.866814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865056+0000","last_change":"2023-06-08T03:50:02.865056+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865056+0000","last_undegraded":"2023-06-08T03:50:02.865056+0000","last_fullsized":"2023-06-08T03:50:02.865056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868800+0000","last_change":"2023-06-08T03:50:02.868800+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868800+0000","last_undegraded":"2023-06-08T03:50:02.868800+0000","last_fullsized":"2023-06-08T03:50:02.868800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869706+0000","last_change":"2023-06-08T03:50:02.869706+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869706+0000","last_undegraded":"2023-06-08T03:50:02.869706+0000","last_fullsized":"2023-06-08T03:50:02.869706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866856+0000","last_change":"2023-06-08T03:50:02.866856+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866856+0000","last_undegraded":"2023-06-08T03:50:02.866856+0000","last_fullsized":"2023-06-08T03:50:02.866856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864896+0000","last_change":"2023-06-08T03:50:02.864896+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864896+0000","last_undegraded":"2023-06-08T03:50:02.864896+0000","last_fullsized":"2023-06-08T03:50:02.864896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867007+0000","last_change":"2023-06-08T03:50:02.867007+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867007+0000","last_undegraded":"2023-06-08T03:50:02.867007+0000","last_fullsized":"2023-06-08T03:50:02.867007+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.871530+0000","last_change":"2023-06-08T03:50:02.871530+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.871530+0000","last_undegraded":"2023-06-08T03:50:02.871530+0000","last_fullsized":"2023-06-08T03:50:02.871530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864902+0000","last_change":"2023-06-08T03:50:02.864902+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864902+0000","last_undegraded":"2023-06-08T03:50:02.864902+0000","last_fullsized":"2023-06-08T03:50:02.864902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870890+0000","last_change":"2023-06-08T03:50:02.870890+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870890+0000","last_undegraded":"2023-06-08T03:50:02.870890+0000","last_fullsized":"2023-06-08T03:50:02.870890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870368+0000","last_change":"2023-06-08T03:50:02.870368+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870368+0000","last_undegraded":"2023-06-08T03:50:02.870368+0000","last_fullsized":"2023-06-08T03:50:02.870368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864306+0000","last_change":"2023-06-08T03:50:02.864306+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864306+0000","last_undegraded":"2023-06-08T03:50:02.864306+0000","last_fullsized":"2023-06-08T03:50:02.864306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867844+0000","last_change":"2023-06-08T03:50:02.867844+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867844+0000","last_undegraded":"2023-06-08T03:50:02.867844+0000","last_fullsized":"2023-06-08T03:50:02.867844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870135+0000","last_change":"2023-06-08T03:50:02.870135+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870135+0000","last_undegraded":"2023-06-08T03:50:02.870135+0000","last_fullsized":"2023-06-08T03:50:02.870135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866691+0000","last_change":"2023-06-08T03:50:02.866691+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866691+0000","last_undegraded":"2023-06-08T03:50:02.866691+0000","last_fullsized":"2023-06-08T03:50:02.866691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.871025+0000","last_change":"2023-06-08T03:50:02.871025+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.871025+0000","last_undegraded":"2023-06-08T03:50:02.871025+0000","last_fullsized":"2023-06-08T03:50:02.871025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.864154+0000","last_change":"2023-06-08T03:50:02.864154+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.864154+0000","last_undegraded":"2023-06-08T03:50:02.864154+0000","last_fullsized":"2023-06-08T03:50:02.864154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865503+0000","last_change":"2023-06-08T03:50:02.865503+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865503+0000","last_undegraded":"2023-06-08T03:50:02.865503+0000","last_fullsized":"2023-06-08T03:50:02.865503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866988+0000","last_change":"2023-06-08T03:50:02.866988+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866988+0000","last_undegraded":"2023-06-08T03:50:02.866988+0000","last_fullsized":"2023-06-08T03:50:02.866988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866732+0000","last_change":"2023-06-08T03:50:02.866732+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866732+0000","last_undegraded":"2023-06-08T03:50:02.866732+0000","last_fullsized":"2023-06-08T03:50:02.866732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.867438+0000","last_change":"2023-06-08T03:50:02.867438+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.867438+0000","last_undegraded":"2023-06-08T03:50:02.867438+0000","last_fullsized":"2023-06-08T03:50:02.867438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866943+0000","last_change":"2023-06-08T03:50:02.866943+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866943+0000","last_undegraded":"2023-06-08T03:50:02.866943+0000","last_fullsized":"2023-06-08T03:50:02.866943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870650+0000","last_change":"2023-06-08T03:50:02.870650+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870650+0000","last_undegraded":"2023-06-08T03:50:02.870650+0000","last_fullsized":"2023-06-08T03:50:02.870650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869688+0000","last_change":"2023-06-08T03:50:02.869688+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869688+0000","last_undegraded":"2023-06-08T03:50:02.869688+0000","last_fullsized":"2023-06-08T03:50:02.869688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.865406+0000","last_change":"2023-06-08T03:50:02.865406+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.865406+0000","last_undegraded":"2023-06-08T03:50:02.865406+0000","last_fullsized":"2023-06-08T03:50:02.865406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.865813+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:50:02.865813+0000","last_peered":"2023-06-08T03:50:02.865813+0000","last_clean":"2023-06-08T03:50:02.865813+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:50:02.865813+0000","last_undegraded":"2023-06-08T03:50:02.865813+0000","last_fullsized":"2023-06-08T03:50:02.865813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:43:09.304957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869690+0000","last_change":"2023-06-08T03:50:02.869690+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869690+0000","last_undegraded":"2023-06-08T03:50:02.869690+0000","last_fullsized":"2023-06-08T03:50:02.869690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.869567+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:50:02.869567+0000","last_peered":"2023-06-08T03:50:02.869567+0000","last_clean":"2023-06-08T03:50:02.869567+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:50:02.869567+0000","last_undegraded":"2023-06-08T03:50:02.869567+0000","last_fullsized":"2023-06-08T03:50:02.869567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:06:56.764377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868739+0000","last_change":"2023-06-08T03:50:02.868739+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868739+0000","last_undegraded":"2023-06-08T03:50:02.868739+0000","last_fullsized":"2023-06-08T03:50:02.868739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.869264+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:50:02.869264+0000","last_peered":"2023-06-08T03:50:02.869264+0000","last_clean":"2023-06-08T03:50:02.869264+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:50:02.869264+0000","last_undegraded":"2023-06-08T03:50:02.869264+0000","last_fullsized":"2023-06-08T03:50:02.869264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:59:18.278003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870989+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:50:02.870989+0000","last_peered":"2023-06-08T03:50:02.870989+0000","last_clean":"2023-06-08T03:50:02.870989+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:50:02.870989+0000","last_undegraded":"2023-06-08T03:50:02.870989+0000","last_fullsized":"2023-06-08T03:50:02.870989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:16:37.351304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.869724+0000","last_change":"2023-06-08T03:50:02.869724+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.869724+0000","last_undegraded":"2023-06-08T03:50:02.869724+0000","last_fullsized":"2023-06-08T03:50:02.869724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870835+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:50:02.870835+0000","last_peered":"2023-06-08T03:50:02.870835+0000","last_clean":"2023-06-08T03:50:02.870835+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:50:02.870835+0000","last_undegraded":"2023-06-08T03:50:02.870835+0000","last_fullsized":"2023-06-08T03:50:02.870835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:02:07.450181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866970+0000","last_change":"2023-06-08T03:50:02.866970+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866970+0000","last_undegraded":"2023-06-08T03:50:02.866970+0000","last_fullsized":"2023-06-08T03:50:02.866970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.870969+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:50:02.870969+0000","last_peered":"2023-06-08T03:50:02.870969+0000","last_clean":"2023-06-08T03:50:02.870969+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:50:02.870969+0000","last_undegraded":"2023-06-08T03:50:02.870969+0000","last_fullsized":"2023-06-08T03:50:02.870969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:53:02.577036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.866780+0000","last_change":"2023-06-08T03:50:02.866780+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.866780+0000","last_undegraded":"2023-06-08T03:50:02.866780+0000","last_fullsized":"2023-06-08T03:50:02.866780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.867772+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:50:02.867772+0000","last_peered":"2023-06-08T03:50:02.867772+0000","last_clean":"2023-06-08T03:50:02.867772+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:50:02.867772+0000","last_undegraded":"2023-06-08T03:50:02.867772+0000","last_fullsized":"2023-06-08T03:50:02.867772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:11:06.128259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.868693+0000","last_change":"2023-06-08T03:50:02.868693+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.868693+0000","last_undegraded":"2023-06-08T03:50:02.868693+0000","last_fullsized":"2023-06-08T03:50:02.868693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.864559+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:50:02.864559+0000","last_peered":"2023-06-08T03:50:02.864559+0000","last_clean":"2023-06-08T03:50:02.864559+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:50:02.864559+0000","last_undegraded":"2023-06-08T03:50:02.864559+0000","last_fullsized":"2023-06-08T03:50:02.864559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:54:15.663142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T03:50:03.861371+0000","last_change":"2023-06-08T03:50:03.861371+0000","last_active":"2023-06-08T03:50:03.861371+0000","last_peered":"2023-06-08T03:50:03.861371+0000","last_clean":"2023-06-08T03:50:03.861371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:03.861371+0000","last_undegraded":"2023-06-08T03:50:03.861371+0000","last_fullsized":"2023-06-08T03:50:03.861371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-06-08T03:50:02.870514+0000","last_change":"2023-06-08T03:50:02.870514+0000","last_active":"2023-06-08T03:50:02.859293+0000","last_peered":"2023-06-08T03:50:02.859293+0000","last_clean":"2023-06-08T03:50:02.859293+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T03:50:02.870514+0000","last_undegraded":"2023-06-08T03:50:02.870514+0000","last_fullsized":"2023-06-08T03:50:02.870514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-08T03:50:02.864690+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:50:02.864690+0000","last_peered":"2023-06-08T03:50:02.864690+0000","last_clean":"2023-06-08T03:50:02.864690+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:50:02.864690+0000","last_undegraded":"2023-06-08T03:50:02.864690+0000","last_fullsized":"2023-06-08T03:50:02.864690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:12:07.481722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":770793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.498}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.1760000000000002,"5min":5.1760000000000002,"15min":5.1760000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":777283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.22}]},{"osd":2,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":7.0410000000000004,"5min":7.0410000000000004,"15min":7.0410000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.944,"5min":6.944,"15min":6.944},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.9870000000000001,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.752}]},{"osd":6,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.5179999999999998,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":7.5570000000000004,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.436}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.923,"5min":11.923,"15min":11.923},"last":0.309}]},{"osd":3,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.877000000000001,"5min":11.877000000000001,"15min":11.877000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.048,"5min":8.048,"15min":8.048},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.2089999999999996,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.499}]},{"osd":3,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.439}]},{"osd":5,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.622}]},{"osd":7,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":186915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.42299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:50:09.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-06-08T03:50:09.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-06-08T03:50:09.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-06-08T03:50:09.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-06-08T03:50:09.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-06-08T03:50:09.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-06-08T03:50:09.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-06-08T03:50:09.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-06-08T03:50:09.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-06-08T03:50:09.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-06-08T03:50:09.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-06-08T03:50:09.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-06-08T03:50:09.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-06-08T03:50:09.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-06-08T03:50:09.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-06-08T03:50:09.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-06-08T03:50:09.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-06-08T03:50:09.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-06-08T03:50:09.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-06-08T03:50:09.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-06-08T03:50:09.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-06-08T03:50:09.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-06-08T03:50:09.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-06-08T03:50:09.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-06-08T03:50:09.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-06-08T03:50:09.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-06-08T03:50:09.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-06-08T03:50:09.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-06-08T03:50:09.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-06-08T03:50:09.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-06-08T03:50:09.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-06-08T03:50:09.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-06-08T03:50:09.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-06-08T03:50:09.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-06-08T03:50:09.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866814+0000', 'last_change': '2023-06-08T03:50:02.866814+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866814+0000', 'last_undegraded': '2023-06-08T03:50:02.866814+0000', 'last_fullsized': '2023-06-08T03:50:02.866814+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-06-08T03:50:09.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-06-08T03:50:09.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.865056+0000', 'last_change': '2023-06-08T03:50:02.865056+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.865056+0000', 'last_undegraded': '2023-06-08T03:50:02.865056+0000', 'last_fullsized': '2023-06-08T03:50:02.865056+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-08T03:50:09.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-06-08T03:50:09.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-06-08T03:50:09.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.868800+0000', 'last_change': '2023-06-08T03:50:02.868800+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.868800+0000', 'last_undegraded': '2023-06-08T03:50:02.868800+0000', 'last_fullsized': '2023-06-08T03:50:02.868800+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-08T03:50:09.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-06-08T03:50:09.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-06-08T03:50:09.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.869706+0000', 'last_change': '2023-06-08T03:50:02.869706+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.869706+0000', 'last_undegraded': '2023-06-08T03:50:02.869706+0000', 'last_fullsized': '2023-06-08T03:50:02.869706+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-08T03:50:09.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-06-08T03:50:09.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-06-08T03:50:09.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866856+0000', 'last_change': '2023-06-08T03:50:02.866856+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866856+0000', 'last_undegraded': '2023-06-08T03:50:02.866856+0000', 'last_fullsized': '2023-06-08T03:50:02.866856+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-06-08T03:50:09.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-06-08T03:50:09.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.864896+0000', 'last_change': '2023-06-08T03:50:02.864896+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.864896+0000', 'last_undegraded': '2023-06-08T03:50:02.864896+0000', 'last_fullsized': '2023-06-08T03:50:02.864896+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-08T03:50:09.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-06-08T03:50:09.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-06-08T03:50:09.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.867007+0000', 'last_change': '2023-06-08T03:50:02.867007+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.867007+0000', 'last_undegraded': '2023-06-08T03:50:02.867007+0000', 'last_fullsized': '2023-06-08T03:50:02.867007+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-08T03:50:09.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-06-08T03:50:09.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-06-08T03:50:09.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.871530+0000', 'last_change': '2023-06-08T03:50:02.871530+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.871530+0000', 'last_undegraded': '2023-06-08T03:50:02.871530+0000', 'last_fullsized': '2023-06-08T03:50:02.871530+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-08T03:50:09.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-06-08T03:50:09.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-06-08T03:50:09.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.864902+0000', 'last_change': '2023-06-08T03:50:02.864902+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.864902+0000', 'last_undegraded': '2023-06-08T03:50:02.864902+0000', 'last_fullsized': '2023-06-08T03:50:02.864902+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-08T03:50:09.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-06-08T03:50:09.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-06-08T03:50:09.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.870890+0000', 'last_change': '2023-06-08T03:50:02.870890+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.870890+0000', 'last_undegraded': '2023-06-08T03:50:02.870890+0000', 'last_fullsized': '2023-06-08T03:50:02.870890+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-08T03:50:09.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-06-08T03:50:09.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-06-08T03:50:09.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.870368+0000', 'last_change': '2023-06-08T03:50:02.870368+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.870368+0000', 'last_undegraded': '2023-06-08T03:50:02.870368+0000', 'last_fullsized': '2023-06-08T03:50:02.870368+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-08T03:50:09.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-06-08T03:50:09.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-06-08T03:50:09.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.864306+0000', 'last_change': '2023-06-08T03:50:02.864306+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.864306+0000', 'last_undegraded': '2023-06-08T03:50:02.864306+0000', 'last_fullsized': '2023-06-08T03:50:02.864306+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-08T03:50:09.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-06-08T03:50:09.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-06-08T03:50:09.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.867844+0000', 'last_change': '2023-06-08T03:50:02.867844+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.867844+0000', 'last_undegraded': '2023-06-08T03:50:02.867844+0000', 'last_fullsized': '2023-06-08T03:50:02.867844+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-06-08T03:50:09.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-06-08T03:50:09.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.870135+0000', 'last_change': '2023-06-08T03:50:02.870135+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.870135+0000', 'last_undegraded': '2023-06-08T03:50:02.870135+0000', 'last_fullsized': '2023-06-08T03:50:02.870135+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-08T03:50:09.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-06-08T03:50:09.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-06-08T03:50:09.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866691+0000', 'last_change': '2023-06-08T03:50:02.866691+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866691+0000', 'last_undegraded': '2023-06-08T03:50:02.866691+0000', 'last_fullsized': '2023-06-08T03:50:02.866691+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-06-08T03:50:09.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-06-08T03:50:09.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.871025+0000', 'last_change': '2023-06-08T03:50:02.871025+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.871025+0000', 'last_undegraded': '2023-06-08T03:50:02.871025+0000', 'last_fullsized': '2023-06-08T03:50:02.871025+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-08T03:50:09.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-06-08T03:50:09.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-06-08T03:50:09.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.864154+0000', 'last_change': '2023-06-08T03:50:02.864154+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.864154+0000', 'last_undegraded': '2023-06-08T03:50:02.864154+0000', 'last_fullsized': '2023-06-08T03:50:02.864154+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-08T03:50:09.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-06-08T03:50:09.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-06-08T03:50:09.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.865503+0000', 'last_change': '2023-06-08T03:50:02.865503+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.865503+0000', 'last_undegraded': '2023-06-08T03:50:02.865503+0000', 'last_fullsized': '2023-06-08T03:50:02.865503+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-08T03:50:09.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-06-08T03:50:09.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-06-08T03:50:09.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866988+0000', 'last_change': '2023-06-08T03:50:02.866988+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866988+0000', 'last_undegraded': '2023-06-08T03:50:02.866988+0000', 'last_fullsized': '2023-06-08T03:50:02.866988+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-08T03:50:09.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-06-08T03:50:09.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-06-08T03:50:09.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866732+0000', 'last_change': '2023-06-08T03:50:02.866732+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866732+0000', 'last_undegraded': '2023-06-08T03:50:02.866732+0000', 'last_fullsized': '2023-06-08T03:50:02.866732+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-06-08T03:50:09.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-06-08T03:50:09.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.867438+0000', 'last_change': '2023-06-08T03:50:02.867438+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.867438+0000', 'last_undegraded': '2023-06-08T03:50:02.867438+0000', 'last_fullsized': '2023-06-08T03:50:02.867438+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-06-08T03:50:09.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-06-08T03:50:09.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866943+0000', 'last_change': '2023-06-08T03:50:02.866943+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866943+0000', 'last_undegraded': '2023-06-08T03:50:02.866943+0000', 'last_fullsized': '2023-06-08T03:50:02.866943+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-08T03:50:09.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-06-08T03:50:09.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-06-08T03:50:09.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.870650+0000', 'last_change': '2023-06-08T03:50:02.870650+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.870650+0000', 'last_undegraded': '2023-06-08T03:50:02.870650+0000', 'last_fullsized': '2023-06-08T03:50:02.870650+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-08T03:50:09.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-06-08T03:50:09.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-06-08T03:50:09.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.869688+0000', 'last_change': '2023-06-08T03:50:02.869688+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.869688+0000', 'last_undegraded': '2023-06-08T03:50:02.869688+0000', 'last_fullsized': '2023-06-08T03:50:02.869688+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-08T03:50:09.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-06-08T03:50:09.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-06-08T03:50:09.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.865406+0000', 'last_change': '2023-06-08T03:50:02.865406+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.865406+0000', 'last_undegraded': '2023-06-08T03:50:02.865406+0000', 'last_fullsized': '2023-06-08T03:50:02.865406+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-08T03:50:09.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-06-08T03:50:09.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-06-08T03:50:09.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.869690+0000', 'last_change': '2023-06-08T03:50:02.869690+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.869690+0000', 'last_undegraded': '2023-06-08T03:50:02.869690+0000', 'last_fullsized': '2023-06-08T03:50:02.869690+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-08T03:50:09.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-06-08T03:50:09.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-06-08T03:50:09.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.868739+0000', 'last_change': '2023-06-08T03:50:02.868739+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.868739+0000', 'last_undegraded': '2023-06-08T03:50:02.868739+0000', 'last_fullsized': '2023-06-08T03:50:02.868739+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-08T03:50:09.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-06-08T03:50:09.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-06-08T03:50:09.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.869724+0000', 'last_change': '2023-06-08T03:50:02.869724+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.869724+0000', 'last_undegraded': '2023-06-08T03:50:02.869724+0000', 'last_fullsized': '2023-06-08T03:50:02.869724+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-08T03:50:09.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-06-08T03:50:09.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-06-08T03:50:09.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866970+0000', 'last_change': '2023-06-08T03:50:02.866970+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866970+0000', 'last_undegraded': '2023-06-08T03:50:02.866970+0000', 'last_fullsized': '2023-06-08T03:50:02.866970+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-08T03:50:09.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-06-08T03:50:09.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-06-08T03:50:09.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.866780+0000', 'last_change': '2023-06-08T03:50:02.866780+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.866780+0000', 'last_undegraded': '2023-06-08T03:50:02.866780+0000', 'last_fullsized': '2023-06-08T03:50:02.866780+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-08T03:50:09.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-06-08T03:50:09.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-06-08T03:50:09.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.868693+0000', 'last_change': '2023-06-08T03:50:02.868693+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.868693+0000', 'last_undegraded': '2023-06-08T03:50:02.868693+0000', 'last_fullsized': '2023-06-08T03:50:02.868693+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-08T03:50:09.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-06-08T03:50:09.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-08T03:50:03.861371+0000', 'last_change': '2023-06-08T03:50:03.861371+0000', 'last_active': '2023-06-08T03:50:03.861371+0000', 'last_peered': '2023-06-08T03:50:03.861371+0000', 'last_clean': '2023-06-08T03:50:03.861371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:03.861371+0000', 'last_undegraded': '2023-06-08T03:50:03.861371+0000', 'last_fullsized': '2023-06-08T03:50:03.861371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:03.861371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-08T03:50:09.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-06-08T03:50:09.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-06-08T03:50:02.870514+0000', 'last_change': '2023-06-08T03:50:02.870514+0000', 'last_active': '2023-06-08T03:50:02.859293+0000', 'last_peered': '2023-06-08T03:50:02.859293+0000', 'last_clean': '2023-06-08T03:50:02.859293+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-08T03:50:02.870514+0000', 'last_undegraded': '2023-06-08T03:50:02.870514+0000', 'last_fullsized': '2023-06-08T03:50:02.870514+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'last_clean_scrub_stamp': '2023-06-08T03:50:02.859293+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-08T03:50:09.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-08T03:50:09.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.408+0000 7f785dd92700 1 Processor -- start 2023-06-08T03:50:09.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.408+0000 7f785dd92700 1 -- start start 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f785dd92700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78580d0380 0x7f78580ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f785dd92700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580ae580 0x7f78580ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f785dd92700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78580acbe0 con 0x7f7858069db0 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f785dd92700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78580ac2d0 con 0x7f78580d0380 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f785dd92700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78580b0860 con 0x7f78580ae580 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f7856ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78580d0380 0x7f78580ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f78577fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7858069db0 0x7f785806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55464/0 (socket says 172.21.15.43:55464) 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f7856ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78580d0380 0x7f78580ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60562/0 (socket says 172.21.15.43:60562) 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.409+0000 7f78577fe700 1 -- 172.21.15.43:0/1329343201 learned_addr learned my addr 172.21.15.43:0/1329343201 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f7857fff700 1 --2- 172.21.15.43:0/1329343201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580ae580 0x7f78580ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f7856ffd700 1 -- 172.21.15.43:0/1329343201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580ae580 msgr2=0x7f78580ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f7856ffd700 1 --2- 172.21.15.43:0/1329343201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580ae580 0x7f78580ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f7856ffd700 1 -- 172.21.15.43:0/1329343201 >> v1:172.21.15.43:6789/0 conn(0x7f7858069db0 legacy=0x7f785806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f7856ffd700 1 -- 172.21.15.43:0/1329343201 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580ac590 con 0x7f78580d0380 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f78567fc700 1 -- 172.21.15.43:0/1329343201 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563167987 0 0) 0x7f78580acbe0 con 0x7f7858069db0 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f7856ffd700 1 --2- 172.21.15.43:0/1329343201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78580d0380 0x7f78580ad070 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7840009840 tx=0x7f7840009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811f25d2435db4b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f78567fc700 1 -- 172.21.15.43:0/1329343201 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840011830 con 0x7f78580d0380 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f78567fc700 1 -- 172.21.15.43:0/1329343201 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840011990 con 0x7f78580d0380 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.410+0000 7f78567fc700 1 -- 172.21.15.43:0/1329343201 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840011d20 con 0x7f78580d0380 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 -- 172.21.15.43:0/1329343201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78580d0380 msgr2=0x7f78580ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 --2- 172.21.15.43:0/1329343201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78580d0380 0x7f78580ad070 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7840009840 tx=0x7f7840009b50 comp rx=0 tx=0).stop 2023-06-08T03:50:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 -- 172.21.15.43:0/1329343201 shutdown_connections 2023-06-08T03:50:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 --2- 172.21.15.43:0/1329343201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580ae580 0x7f78580ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 --2- 172.21.15.43:0/1329343201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78580d0380 0x7f78580ad070 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 -- 172.21.15.43:0/1329343201 >> 172.21.15.43:0/1329343201 conn(0x7f785806b7e0 msgr2=0x7f78580cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 -- 172.21.15.43:0/1329343201 shutdown_connections 2023-06-08T03:50:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.411+0000 7f785dd92700 1 -- 172.21.15.43:0/1329343201 wait complete. 2023-06-08T03:50:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.412+0000 7f785dd92700 1 Processor -- start 2023-06-08T03:50:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.412+0000 7f785dd92700 1 -- start start 2023-06-08T03:50:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f785dd92700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 0x7f7858157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f785dd92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78580ae580 0x7f7858149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f785dd92700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580d0380 0x7f7858149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f785dd92700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580c3370 con 0x7f7858069db0 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f785dd92700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580c3650 con 0x7f78580ae580 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f785dd92700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78580c3930 con 0x7f78580d0380 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 0x7f7858157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 0x7f7858157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60570/0 (socket says 172.21.15.43:60570) 2023-06-08T03:50:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 -- 172.21.15.43:0/2455279462 learned_addr learned my addr 172.21.15.43:0/2455279462 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f7857fff700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580d0380 0x7f7858149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 -- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580d0380 msgr2=0x7f7858149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580d0380 0x7f7858149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 -- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78580ae580 msgr2=0x7f7858149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78580ae580 0x7f7858149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 -- 172.21.15.43:0/2455279462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400094a0 con 0x7f7858069db0 2023-06-08T03:50:09.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.413+0000 7f78577fe700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 0x7f7858157b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f784800c4a0 tx=0x7f784800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.414+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480074e0 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.414+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7848007640 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.414+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78580c3c10 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.414+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848005a70 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.414+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7858158040 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.414+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858158260 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.415+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7848005bd0 con 0x7f7858069db0 2023-06-08T03:50:09.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.415+0000 7f784ffff700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f783806ace0 0x7f783806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.416+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7848088a10 con 0x7f7858069db0 2023-06-08T03:50:09.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.416+0000 7f7856ffd700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f783806ace0 0x7f783806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.416+0000 7f7856ffd700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f783806ace0 0x7f783806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7840000c00 tx=0x7f7840010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.420+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7858158260 con 0x7f7858069db0 2023-06-08T03:50:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.697+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7858158260 con 0x7f7858069db0 2023-06-08T03:50:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.697+0000 7f784ffff700 1 -- 172.21.15.43:0/2455279462 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1270 (secure 0 0 0) 0x7f7848017510 con 0x7f7858069db0 2023-06-08T03:50:09.702 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:09.702 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":101,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1686196118,"num_in_osds":8,"osd_in_since":1686196110,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":225374208,"bytes_avail":772868739072,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5334}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-06-08T03:49:43.577964+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-06-08T03:50:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f783806ace0 msgr2=0x7f783806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f783806ace0 0x7f783806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7840000c00 tx=0x7f7840010000 comp rx=0 tx=0).stop 2023-06-08T03:50:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 msgr2=0x7f7858157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 0x7f7858157b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f784800c4a0 tx=0x7f784800c860 comp rx=0 tx=0).stop 2023-06-08T03:50:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 shutdown_connections 2023-06-08T03:50:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f783806ace0 0x7f783806d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7858069db0 0x7f7858157b00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78580d0380 0x7f7858149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 --2- 172.21.15.43:0/2455279462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78580ae580 0x7f7858149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 >> 172.21.15.43:0/2455279462 conn(0x7f785806b7e0 msgr2=0x7f785806a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:09.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 shutdown_connections 2023-06-08T03:50:09.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.699+0000 7f785dd92700 1 -- 172.21.15.43:0/2455279462 wait complete. 2023-06-08T03:50:09.715 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-08T03:50:09.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:50:09.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.836+0000 7f208fb0e700 1 Processor -- start 2023-06-08T03:50:09.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.836+0000 7f208fb0e700 1 -- start start 2023-06-08T03:50:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208fb0e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f208815c430 0x7f20880ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208fb0e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20880cdb50 0x7f20880caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208fb0e700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20880ccb30 con 0x7f2088070a50 2023-06-08T03:50:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208fb0e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880c8f70 con 0x7f20880cdb50 2023-06-08T03:50:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208fb0e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880c8c40 con 0x7f208815c430 2023-06-08T03:50:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20880cdb50 0x7f20880caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208e0ab700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2088070a50 0x7f208815caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55482/0 (socket says 172.21.15.43:55482) 2023-06-08T03:50:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f20880cdb50 0x7f20880caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60576/0 (socket says 172.21.15.43:60576) 2023-06-08T03:50:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208e0ab700 1 -- 172.21.15.43:0/1978567780 learned_addr learned my addr 172.21.15.43:0/1978567780 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d8aa700 1 --2- 172.21.15.43:0/1978567780 >> v2:172.21.15.135:3300/0 conn(0x7f208815c430 0x7f20880ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 -- 172.21.15.43:0/1978567780 >> v2:172.21.15.135:3300/0 conn(0x7f208815c430 msgr2=0x7f20880ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 --2- 172.21.15.43:0/1978567780 >> v2:172.21.15.135:3300/0 conn(0x7f208815c430 0x7f20880ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 -- 172.21.15.43:0/1978567780 >> v1:172.21.15.43:6789/0 conn(0x7f2088070a50 legacy=0x7f208815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 -- 172.21.15.43:0/1978567780 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880ade20 con 0x7f20880cdb50 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.837+0000 7f208d0a9700 1 --2- 172.21.15.43:0/1978567780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20880cdb50 0x7f20880caf60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f208806fe70 tx=0x7f2078009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda05a0b1e715da6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208c8a8700 1 -- 172.21.15.43:0/1978567780 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078011830 con 0x7f20880cdb50 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208c8a8700 1 -- 172.21.15.43:0/1978567780 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078011990 con 0x7f20880cdb50 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208c8a8700 1 -- 172.21.15.43:0/1978567780 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078011d20 con 0x7f20880cdb50 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 -- 172.21.15.43:0/1978567780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20880cdb50 msgr2=0x7f20880caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 --2- 172.21.15.43:0/1978567780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20880cdb50 0x7f20880caf60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f208806fe70 tx=0x7f2078009b20 comp rx=0 tx=0).stop 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 -- 172.21.15.43:0/1978567780 shutdown_connections 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 --2- 172.21.15.43:0/1978567780 >> v2:172.21.15.135:3300/0 conn(0x7f208815c430 0x7f20880ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 --2- 172.21.15.43:0/1978567780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20880cdb50 0x7f20880caf60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 -- 172.21.15.43:0/1978567780 >> 172.21.15.43:0/1978567780 conn(0x7f208806aa40 msgr2=0x7f20880b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:09.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 -- 172.21.15.43:0/1978567780 shutdown_connections 2023-06-08T03:50:09.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.838+0000 7f208fb0e700 1 -- 172.21.15.43:0/1978567780 wait complete. 2023-06-08T03:50:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.839+0000 7f208fb0e700 1 Processor -- start 2023-06-08T03:50:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.839+0000 7f208fb0e700 1 -- start start 2023-06-08T03:50:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208fb0e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 0x7f20880c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208fb0e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20880cdb50 0x7f2088146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208fb0e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815c430 0x7f20880b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208fb0e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880ac300 con 0x7f2088070a50 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208fb0e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880b2260 con 0x7f20880cdb50 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208fb0e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2088156170 con 0x7f208815c430 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208d8aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 0x7f20880c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208d8aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 0x7f20880c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60582/0 (socket says 172.21.15.43:60582) 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.840+0000 7f208d8aa700 1 -- 172.21.15.43:0/720606180 learned_addr learned my addr 172.21.15.43:0/720606180 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208e0ab700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815c430 0x7f20880b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d0a9700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20880cdb50 0x7f2088146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d8aa700 1 -- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815c430 msgr2=0x7f20880b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d8aa700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815c430 0x7f20880b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d8aa700 1 -- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20880cdb50 msgr2=0x7f2088146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d8aa700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20880cdb50 0x7f2088146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d8aa700 1 -- 172.21.15.43:0/720606180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780094a0 con 0x7f2088070a50 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208e0ab700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815c430 0x7f20880b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d0a9700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20880cdb50 0x7f2088146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208d8aa700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 0x7f20880c30d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f208400e810 tx=0x7f208400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084013610 con 0x7f2088070a50 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084013770 con 0x7f2088070a50 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084013b20 con 0x7f2088070a50 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088156450 con 0x7f2088070a50 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.841+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20880c3610 con 0x7f2088070a50 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.842+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20880ac5e0 con 0x7f2088070a50 2023-06-08T03:50:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.842+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2084013c80 con 0x7f2088070a50 2023-06-08T03:50:09.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.843+0000 7f207e7fc700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f206c06ace0 0x7f206c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:09.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.843+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2084089270 con 0x7f2088070a50 2023-06-08T03:50:09.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.843+0000 7f208d0a9700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f206c06ace0 0x7f206c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:09.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.844+0000 7f208d0a9700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f206c06ace0 0x7f206c06d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20880b19c0 tx=0x7f2078008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:09.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:09.847+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2084057c80 con 0x7f2088070a50 2023-06-08T03:50:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.038+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20881562e0 con 0x7f206c06ace0 2023-06-08T03:50:10.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.048+0000 7f207e7fc700 1 -- 172.21.15.43:0/720606180 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311699 (secure 0 0 0) 0x7f20881562e0 con 0x7f206c06ace0 2023-06-08T03:50:10.055 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:10.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f206c06ace0 msgr2=0x7f206c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:10.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f206c06ace0 0x7f206c06d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20880b19c0 tx=0x7f2078008030 comp rx=0 tx=0).stop 2023-06-08T03:50:10.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 msgr2=0x7f20880c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:10.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 0x7f20880c30d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f208400e810 tx=0x7f208400ebd0 comp rx=0 tx=0).stop 2023-06-08T03:50:10.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 shutdown_connections 2023-06-08T03:50:10.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f206c06ace0 0x7f206c06d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:10.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2088070a50 0x7f20880c30d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815c430 0x7f20880b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 --2- 172.21.15.43:0/720606180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20880cdb50 0x7f2088146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 >> 172.21.15.43:0/720606180 conn(0x7f208806aa40 msgr2=0x7f208815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 shutdown_connections 2023-06-08T03:50:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:10.051+0000 7f208fb0e700 1 -- 172.21.15.43:0/720606180 wait complete. 2023-06-08T03:50:10.058 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:50:10.067 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-06-08T03:50:09.584482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220456,"kb_used_data":4840,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754264,"statfs":{"total":773094113280,"available":772868366336,"internally_reserved":0,"allocated":4956160,"data_stored":2851668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001438"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.551021+0000","last_change":"2023-06-08T03:50:04.313578+0000","last_active":"2023-06-08T03:50:05.551021+0000","last_peered":"2023-06-08T03:50:05.551021+0000","last_clean":"2023-06-08T03:50:05.551021+0000","last_became_active":"2023-06-08T03:50:04.313315+0000","last_became_peered":"2023-06-08T03:50:04.313315+0000","last_unstale":"2023-06-08T03:50:05.551021+0000","last_undegraded":"2023-06-08T03:50:05.551021+0000","last_fullsized":"2023-06-08T03:50:05.551021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:25:49.056825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.452013+0000","last_change":"2023-06-08T03:50:04.324015+0000","last_active":"2023-06-08T03:50:05.452013+0000","last_peered":"2023-06-08T03:50:05.452013+0000","last_clean":"2023-06-08T03:50:05.452013+0000","last_became_active":"2023-06-08T03:50:04.323772+0000","last_became_peered":"2023-06-08T03:50:04.323772+0000","last_unstale":"2023-06-08T03:50:05.452013+0000","last_undegraded":"2023-06-08T03:50:05.452013+0000","last_fullsized":"2023-06-08T03:50:05.452013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:24.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305496+0000","last_change":"2023-06-08T03:50:04.308482+0000","last_active":"2023-06-08T03:50:05.305496+0000","last_peered":"2023-06-08T03:50:05.305496+0000","last_clean":"2023-06-08T03:50:05.305496+0000","last_became_active":"2023-06-08T03:50:04.308211+0000","last_became_peered":"2023-06-08T03:50:04.308211+0000","last_unstale":"2023-06-08T03:50:05.305496+0000","last_undegraded":"2023-06-08T03:50:05.305496+0000","last_fullsized":"2023-06-08T03:50:05.305496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:57:32.893940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549778+0000","last_change":"2023-06-08T03:50:04.313010+0000","last_active":"2023-06-08T03:50:05.549778+0000","last_peered":"2023-06-08T03:50:05.549778+0000","last_clean":"2023-06-08T03:50:05.549778+0000","last_became_active":"2023-06-08T03:50:04.312760+0000","last_became_peered":"2023-06-08T03:50:04.312760+0000","last_unstale":"2023-06-08T03:50:05.549778+0000","last_undegraded":"2023-06-08T03:50:05.549778+0000","last_fullsized":"2023-06-08T03:50:05.549778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:02:01.072516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451933+0000","last_change":"2023-06-08T03:50:04.314457+0000","last_active":"2023-06-08T03:50:05.451933+0000","last_peered":"2023-06-08T03:50:05.451933+0000","last_clean":"2023-06-08T03:50:05.451933+0000","last_became_active":"2023-06-08T03:50:04.314177+0000","last_became_peered":"2023-06-08T03:50:04.314177+0000","last_unstale":"2023-06-08T03:50:05.451933+0000","last_undegraded":"2023-06-08T03:50:05.451933+0000","last_fullsized":"2023-06-08T03:50:05.451933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:55:55.285693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302173+0000","last_change":"2023-06-08T03:50:04.320255+0000","last_active":"2023-06-08T03:50:05.302173+0000","last_peered":"2023-06-08T03:50:05.302173+0000","last_clean":"2023-06-08T03:50:05.302173+0000","last_became_active":"2023-06-08T03:50:04.319966+0000","last_became_peered":"2023-06-08T03:50:04.319966+0000","last_unstale":"2023-06-08T03:50:05.302173+0000","last_undegraded":"2023-06-08T03:50:05.302173+0000","last_fullsized":"2023-06-08T03:50:05.302173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:18:59.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550195+0000","last_change":"2023-06-08T03:50:04.318428+0000","last_active":"2023-06-08T03:50:05.550195+0000","last_peered":"2023-06-08T03:50:05.550195+0000","last_clean":"2023-06-08T03:50:05.550195+0000","last_became_active":"2023-06-08T03:50:04.317852+0000","last_became_peered":"2023-06-08T03:50:04.317852+0000","last_unstale":"2023-06-08T03:50:05.550195+0000","last_undegraded":"2023-06-08T03:50:05.550195+0000","last_fullsized":"2023-06-08T03:50:05.550195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:18:59.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549463+0000","last_change":"2023-06-08T03:50:04.311671+0000","last_active":"2023-06-08T03:50:05.549463+0000","last_peered":"2023-06-08T03:50:05.549463+0000","last_clean":"2023-06-08T03:50:05.549463+0000","last_became_active":"2023-06-08T03:50:04.311386+0000","last_became_peered":"2023-06-08T03:50:04.311386+0000","last_unstale":"2023-06-08T03:50:05.549463+0000","last_undegraded":"2023-06-08T03:50:05.549463+0000","last_fullsized":"2023-06-08T03:50:05.549463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:08:20.467424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549963+0000","last_change":"2023-06-08T03:50:04.315007+0000","last_active":"2023-06-08T03:50:05.549963+0000","last_peered":"2023-06-08T03:50:05.549963+0000","last_clean":"2023-06-08T03:50:05.549963+0000","last_became_active":"2023-06-08T03:50:04.314700+0000","last_became_peered":"2023-06-08T03:50:04.314700+0000","last_unstale":"2023-06-08T03:50:05.549963+0000","last_undegraded":"2023-06-08T03:50:05.549963+0000","last_fullsized":"2023-06-08T03:50:05.549963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:02:12.053726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549929+0000","last_change":"2023-06-08T03:50:04.314735+0000","last_active":"2023-06-08T03:50:05.549929+0000","last_peered":"2023-06-08T03:50:05.549929+0000","last_clean":"2023-06-08T03:50:05.549929+0000","last_became_active":"2023-06-08T03:50:04.314407+0000","last_became_peered":"2023-06-08T03:50:04.314407+0000","last_unstale":"2023-06-08T03:50:05.549929+0000","last_undegraded":"2023-06-08T03:50:05.549929+0000","last_fullsized":"2023-06-08T03:50:05.549929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:54:26.280084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549805+0000","last_change":"2023-06-08T03:50:04.322922+0000","last_active":"2023-06-08T03:50:05.549805+0000","last_peered":"2023-06-08T03:50:05.549805+0000","last_clean":"2023-06-08T03:50:05.549805+0000","last_became_active":"2023-06-08T03:50:04.322635+0000","last_became_peered":"2023-06-08T03:50:04.322635+0000","last_unstale":"2023-06-08T03:50:05.549805+0000","last_undegraded":"2023-06-08T03:50:05.549805+0000","last_fullsized":"2023-06-08T03:50:05.549805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:35.282996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.452061+0000","last_change":"2023-06-08T03:50:04.312886+0000","last_active":"2023-06-08T03:50:05.452061+0000","last_peered":"2023-06-08T03:50:05.452061+0000","last_clean":"2023-06-08T03:50:05.452061+0000","last_became_active":"2023-06-08T03:50:04.312636+0000","last_became_peered":"2023-06-08T03:50:04.312636+0000","last_unstale":"2023-06-08T03:50:05.452061+0000","last_undegraded":"2023-06-08T03:50:05.452061+0000","last_fullsized":"2023-06-08T03:50:05.452061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:51:56.664299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538391+0000","last_change":"2023-06-08T03:50:04.323610+0000","last_active":"2023-06-08T03:50:05.538391+0000","last_peered":"2023-06-08T03:50:05.538391+0000","last_clean":"2023-06-08T03:50:05.538391+0000","last_became_active":"2023-06-08T03:50:04.323287+0000","last_became_peered":"2023-06-08T03:50:04.323287+0000","last_unstale":"2023-06-08T03:50:05.538391+0000","last_undegraded":"2023-06-08T03:50:05.538391+0000","last_fullsized":"2023-06-08T03:50:05.538391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:36:30.356179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549571+0000","last_change":"2023-06-08T03:50:04.318170+0000","last_active":"2023-06-08T03:50:05.549571+0000","last_peered":"2023-06-08T03:50:05.549571+0000","last_clean":"2023-06-08T03:50:05.549571+0000","last_became_active":"2023-06-08T03:50:04.315197+0000","last_became_peered":"2023-06-08T03:50:04.315197+0000","last_unstale":"2023-06-08T03:50:05.549571+0000","last_undegraded":"2023-06-08T03:50:05.549571+0000","last_fullsized":"2023-06-08T03:50:05.549571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:27:37.945124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301179+0000","last_change":"2023-06-08T03:50:04.308768+0000","last_active":"2023-06-08T03:50:05.301179+0000","last_peered":"2023-06-08T03:50:05.301179+0000","last_clean":"2023-06-08T03:50:05.301179+0000","last_became_active":"2023-06-08T03:50:04.308497+0000","last_became_peered":"2023-06-08T03:50:04.308497+0000","last_unstale":"2023-06-08T03:50:05.301179+0000","last_undegraded":"2023-06-08T03:50:05.301179+0000","last_fullsized":"2023-06-08T03:50:05.301179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:55:55.285693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549766+0000","last_change":"2023-06-08T03:50:04.315473+0000","last_active":"2023-06-08T03:50:05.549766+0000","last_peered":"2023-06-08T03:50:05.549766+0000","last_clean":"2023-06-08T03:50:05.549766+0000","last_became_active":"2023-06-08T03:50:04.315207+0000","last_became_peered":"2023-06-08T03:50:04.315207+0000","last_unstale":"2023-06-08T03:50:05.549766+0000","last_undegraded":"2023-06-08T03:50:05.549766+0000","last_fullsized":"2023-06-08T03:50:05.549766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:41.981051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305701+0000","last_change":"2023-06-08T03:50:04.311921+0000","last_active":"2023-06-08T03:50:05.305701+0000","last_peered":"2023-06-08T03:50:05.305701+0000","last_clean":"2023-06-08T03:50:05.305701+0000","last_became_active":"2023-06-08T03:50:04.311584+0000","last_became_peered":"2023-06-08T03:50:04.311584+0000","last_unstale":"2023-06-08T03:50:05.305701+0000","last_undegraded":"2023-06-08T03:50:05.305701+0000","last_fullsized":"2023-06-08T03:50:05.305701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:26:11.252073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305523+0000","last_change":"2023-06-08T03:50:04.316137+0000","last_active":"2023-06-08T03:50:05.305523+0000","last_peered":"2023-06-08T03:50:05.305523+0000","last_clean":"2023-06-08T03:50:05.305523+0000","last_became_active":"2023-06-08T03:50:04.315820+0000","last_became_peered":"2023-06-08T03:50:04.315820+0000","last_unstale":"2023-06-08T03:50:05.305523+0000","last_undegraded":"2023-06-08T03:50:05.305523+0000","last_fullsized":"2023-06-08T03:50:05.305523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:28:39.317938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550340+0000","last_change":"2023-06-08T03:50:04.314297+0000","last_active":"2023-06-08T03:50:05.550340+0000","last_peered":"2023-06-08T03:50:05.550340+0000","last_clean":"2023-06-08T03:50:05.550340+0000","last_became_active":"2023-06-08T03:50:04.314004+0000","last_became_peered":"2023-06-08T03:50:04.314004+0000","last_unstale":"2023-06-08T03:50:05.550340+0000","last_undegraded":"2023-06-08T03:50:05.550340+0000","last_fullsized":"2023-06-08T03:50:05.550340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:08:06.226028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538507+0000","last_change":"2023-06-08T03:50:04.319290+0000","last_active":"2023-06-08T03:50:05.538507+0000","last_peered":"2023-06-08T03:50:05.538507+0000","last_clean":"2023-06-08T03:50:05.538507+0000","last_became_active":"2023-06-08T03:50:04.319037+0000","last_became_peered":"2023-06-08T03:50:04.319037+0000","last_unstale":"2023-06-08T03:50:05.538507+0000","last_undegraded":"2023-06-08T03:50:05.538507+0000","last_fullsized":"2023-06-08T03:50:05.538507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:49:15.193372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301307+0000","last_change":"2023-06-08T03:50:04.300153+0000","last_active":"2023-06-08T03:50:05.301307+0000","last_peered":"2023-06-08T03:50:05.301307+0000","last_clean":"2023-06-08T03:50:05.301307+0000","last_became_active":"2023-06-08T03:50:04.299876+0000","last_became_peered":"2023-06-08T03:50:04.299876+0000","last_unstale":"2023-06-08T03:50:05.301307+0000","last_undegraded":"2023-06-08T03:50:05.301307+0000","last_fullsized":"2023-06-08T03:50:05.301307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:59:39.129237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549777+0000","last_change":"2023-06-08T03:50:04.308976+0000","last_active":"2023-06-08T03:50:05.549777+0000","last_peered":"2023-06-08T03:50:05.549777+0000","last_clean":"2023-06-08T03:50:05.549777+0000","last_became_active":"2023-06-08T03:50:04.308725+0000","last_became_peered":"2023-06-08T03:50:04.308725+0000","last_unstale":"2023-06-08T03:50:05.549777+0000","last_undegraded":"2023-06-08T03:50:05.549777+0000","last_fullsized":"2023-06-08T03:50:05.549777+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:41:10.729970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550713+0000","last_change":"2023-06-08T03:50:04.319715+0000","last_active":"2023-06-08T03:50:05.550713+0000","last_peered":"2023-06-08T03:50:05.550713+0000","last_clean":"2023-06-08T03:50:05.550713+0000","last_became_active":"2023-06-08T03:50:04.319257+0000","last_became_peered":"2023-06-08T03:50:04.319257+0000","last_unstale":"2023-06-08T03:50:05.550713+0000","last_undegraded":"2023-06-08T03:50:05.550713+0000","last_fullsized":"2023-06-08T03:50:05.550713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:46:52.574724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549931+0000","last_change":"2023-06-08T03:50:04.318625+0000","last_active":"2023-06-08T03:50:05.549931+0000","last_peered":"2023-06-08T03:50:05.549931+0000","last_clean":"2023-06-08T03:50:05.549931+0000","last_became_active":"2023-06-08T03:50:04.318358+0000","last_became_peered":"2023-06-08T03:50:04.318358+0000","last_unstale":"2023-06-08T03:50:05.549931+0000","last_undegraded":"2023-06-08T03:50:05.549931+0000","last_fullsized":"2023-06-08T03:50:05.549931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:33:01.199263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550839+0000","last_change":"2023-06-08T03:50:04.315189+0000","last_active":"2023-06-08T03:50:05.550839+0000","last_peered":"2023-06-08T03:50:05.550839+0000","last_clean":"2023-06-08T03:50:05.550839+0000","last_became_active":"2023-06-08T03:50:04.314896+0000","last_became_peered":"2023-06-08T03:50:04.314896+0000","last_unstale":"2023-06-08T03:50:05.550839+0000","last_undegraded":"2023-06-08T03:50:05.550839+0000","last_fullsized":"2023-06-08T03:50:05.550839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:02:54.591447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538555+0000","last_change":"2023-06-08T03:50:04.321827+0000","last_active":"2023-06-08T03:50:05.538555+0000","last_peered":"2023-06-08T03:50:05.538555+0000","last_clean":"2023-06-08T03:50:05.538555+0000","last_became_active":"2023-06-08T03:50:04.321564+0000","last_became_peered":"2023-06-08T03:50:04.321564+0000","last_unstale":"2023-06-08T03:50:05.538555+0000","last_undegraded":"2023-06-08T03:50:05.538555+0000","last_fullsized":"2023-06-08T03:50:05.538555+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:48:12.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305634+0000","last_change":"2023-06-08T03:50:04.311268+0000","last_active":"2023-06-08T03:50:05.305634+0000","last_peered":"2023-06-08T03:50:05.305634+0000","last_clean":"2023-06-08T03:50:05.305634+0000","last_became_active":"2023-06-08T03:50:04.310963+0000","last_became_peered":"2023-06-08T03:50:04.310963+0000","last_unstale":"2023-06-08T03:50:05.305634+0000","last_undegraded":"2023-06-08T03:50:05.305634+0000","last_fullsized":"2023-06-08T03:50:05.305634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:17:49.149469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451825+0000","last_change":"2023-06-08T03:50:04.311364+0000","last_active":"2023-06-08T03:50:05.451825+0000","last_peered":"2023-06-08T03:50:05.451825+0000","last_clean":"2023-06-08T03:50:05.451825+0000","last_became_active":"2023-06-08T03:50:04.311075+0000","last_became_peered":"2023-06-08T03:50:04.311075+0000","last_unstale":"2023-06-08T03:50:05.451825+0000","last_undegraded":"2023-06-08T03:50:05.451825+0000","last_fullsized":"2023-06-08T03:50:05.451825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:40:26.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550546+0000","last_change":"2023-06-08T03:50:04.316544+0000","last_active":"2023-06-08T03:50:05.550546+0000","last_peered":"2023-06-08T03:50:05.550546+0000","last_clean":"2023-06-08T03:50:05.550546+0000","last_became_active":"2023-06-08T03:50:04.316289+0000","last_became_peered":"2023-06-08T03:50:04.316289+0000","last_unstale":"2023-06-08T03:50:05.550546+0000","last_undegraded":"2023-06-08T03:50:05.550546+0000","last_fullsized":"2023-06-08T03:50:05.550546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:39:35.102600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305415+0000","last_change":"2023-06-08T03:50:04.319369+0000","last_active":"2023-06-08T03:50:05.305415+0000","last_peered":"2023-06-08T03:50:05.305415+0000","last_clean":"2023-06-08T03:50:05.305415+0000","last_became_active":"2023-06-08T03:50:04.319055+0000","last_became_peered":"2023-06-08T03:50:04.319055+0000","last_unstale":"2023-06-08T03:50:05.305415+0000","last_undegraded":"2023-06-08T03:50:05.305415+0000","last_fullsized":"2023-06-08T03:50:05.305415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:12:15.222250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301331+0000","last_change":"2023-06-08T03:50:04.310535+0000","last_active":"2023-06-08T03:50:05.301331+0000","last_peered":"2023-06-08T03:50:05.301331+0000","last_clean":"2023-06-08T03:50:05.301331+0000","last_became_active":"2023-06-08T03:50:04.310267+0000","last_became_peered":"2023-06-08T03:50:04.310267+0000","last_unstale":"2023-06-08T03:50:05.301331+0000","last_undegraded":"2023-06-08T03:50:05.301331+0000","last_fullsized":"2023-06-08T03:50:05.301331+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:51:56.664299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538415+0000","last_change":"2023-06-08T03:50:04.318440+0000","last_active":"2023-06-08T03:50:05.538415+0000","last_peered":"2023-06-08T03:50:05.538415+0000","last_clean":"2023-06-08T03:50:05.538415+0000","last_became_active":"2023-06-08T03:50:04.318162+0000","last_became_peered":"2023-06-08T03:50:04.318162+0000","last_unstale":"2023-06-08T03:50:05.538415+0000","last_undegraded":"2023-06-08T03:50:05.538415+0000","last_fullsized":"2023-06-08T03:50:05.538415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:22.021336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.306294+0000","last_change":"2023-06-08T03:50:04.321589+0000","last_active":"2023-06-08T03:50:05.306294+0000","last_peered":"2023-06-08T03:50:05.306294+0000","last_clean":"2023-06-08T03:50:05.306294+0000","last_became_active":"2023-06-08T03:50:04.321304+0000","last_became_peered":"2023-06-08T03:50:04.321304+0000","last_unstale":"2023-06-08T03:50:05.306294+0000","last_undegraded":"2023-06-08T03:50:05.306294+0000","last_fullsized":"2023-06-08T03:50:05.306294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:01:51.690260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301953+0000","last_change":"2023-06-08T03:50:03.889190+0000","last_active":"2023-06-08T03:50:05.301953+0000","last_peered":"2023-06-08T03:50:05.301953+0000","last_clean":"2023-06-08T03:50:05.301953+0000","last_became_active":"2023-06-08T03:50:03.888920+0000","last_became_peered":"2023-06-08T03:50:03.888920+0000","last_unstale":"2023-06-08T03:50:05.301953+0000","last_undegraded":"2023-06-08T03:50:05.301953+0000","last_fullsized":"2023-06-08T03:50:05.301953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:45:01.530067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550598+0000","last_change":"2023-06-08T03:50:04.310428+0000","last_active":"2023-06-08T03:50:05.550598+0000","last_peered":"2023-06-08T03:50:05.550598+0000","last_clean":"2023-06-08T03:50:05.550598+0000","last_became_active":"2023-06-08T03:50:04.309904+0000","last_became_peered":"2023-06-08T03:50:04.309904+0000","last_unstale":"2023-06-08T03:50:05.550598+0000","last_undegraded":"2023-06-08T03:50:05.550598+0000","last_fullsized":"2023-06-08T03:50:05.550598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:41:17.069906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305820+0000","last_change":"2023-06-08T03:50:03.882248+0000","last_active":"2023-06-08T03:50:05.305820+0000","last_peered":"2023-06-08T03:50:05.305820+0000","last_clean":"2023-06-08T03:50:05.305820+0000","last_became_active":"2023-06-08T03:50:03.881982+0000","last_became_peered":"2023-06-08T03:50:03.881982+0000","last_unstale":"2023-06-08T03:50:05.305820+0000","last_undegraded":"2023-06-08T03:50:05.305820+0000","last_fullsized":"2023-06-08T03:50:05.305820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:01:12.024114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451960+0000","last_change":"2023-06-08T03:50:04.311827+0000","last_active":"2023-06-08T03:50:05.451960+0000","last_peered":"2023-06-08T03:50:05.451960+0000","last_clean":"2023-06-08T03:50:05.451960+0000","last_became_active":"2023-06-08T03:50:04.311318+0000","last_became_peered":"2023-06-08T03:50:04.311318+0000","last_unstale":"2023-06-08T03:50:05.451960+0000","last_undegraded":"2023-06-08T03:50:05.451960+0000","last_fullsized":"2023-06-08T03:50:05.451960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:14:22.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.306197+0000","last_change":"2023-06-08T03:50:03.888231+0000","last_active":"2023-06-08T03:50:05.306197+0000","last_peered":"2023-06-08T03:50:05.306197+0000","last_clean":"2023-06-08T03:50:05.306197+0000","last_became_active":"2023-06-08T03:50:03.887862+0000","last_became_peered":"2023-06-08T03:50:03.887862+0000","last_unstale":"2023-06-08T03:50:05.306197+0000","last_undegraded":"2023-06-08T03:50:05.306197+0000","last_fullsized":"2023-06-08T03:50:05.306197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:36:14.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.306099+0000","last_change":"2023-06-08T03:50:04.315347+0000","last_active":"2023-06-08T03:50:05.306099+0000","last_peered":"2023-06-08T03:50:05.306099+0000","last_clean":"2023-06-08T03:50:05.306099+0000","last_became_active":"2023-06-08T03:50:04.314513+0000","last_became_peered":"2023-06-08T03:50:04.314513+0000","last_unstale":"2023-06-08T03:50:05.306099+0000","last_undegraded":"2023-06-08T03:50:05.306099+0000","last_fullsized":"2023-06-08T03:50:05.306099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:53:53.638707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550353+0000","last_change":"2023-06-08T03:50:03.885323+0000","last_active":"2023-06-08T03:50:05.550353+0000","last_peered":"2023-06-08T03:50:05.550353+0000","last_clean":"2023-06-08T03:50:05.550353+0000","last_became_active":"2023-06-08T03:50:03.885045+0000","last_became_peered":"2023-06-08T03:50:03.885045+0000","last_unstale":"2023-06-08T03:50:05.550353+0000","last_undegraded":"2023-06-08T03:50:05.550353+0000","last_fullsized":"2023-06-08T03:50:05.550353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:59:45.986168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305597+0000","last_change":"2023-06-08T03:50:04.308097+0000","last_active":"2023-06-08T03:50:05.305597+0000","last_peered":"2023-06-08T03:50:05.305597+0000","last_clean":"2023-06-08T03:50:05.305597+0000","last_became_active":"2023-06-08T03:50:04.307841+0000","last_became_peered":"2023-06-08T03:50:04.307841+0000","last_unstale":"2023-06-08T03:50:05.305597+0000","last_undegraded":"2023-06-08T03:50:05.305597+0000","last_fullsized":"2023-06-08T03:50:05.305597+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:13:07.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301575+0000","last_change":"2023-06-08T03:50:03.884711+0000","last_active":"2023-06-08T03:50:05.301575+0000","last_peered":"2023-06-08T03:50:05.301575+0000","last_clean":"2023-06-08T03:50:05.301575+0000","last_became_active":"2023-06-08T03:50:03.883316+0000","last_became_peered":"2023-06-08T03:50:03.883316+0000","last_unstale":"2023-06-08T03:50:05.301575+0000","last_undegraded":"2023-06-08T03:50:05.301575+0000","last_fullsized":"2023-06-08T03:50:05.301575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:47:28.600080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550150+0000","last_change":"2023-06-08T03:50:04.311227+0000","last_active":"2023-06-08T03:50:05.550150+0000","last_peered":"2023-06-08T03:50:05.550150+0000","last_clean":"2023-06-08T03:50:05.550150+0000","last_became_active":"2023-06-08T03:50:04.310713+0000","last_became_peered":"2023-06-08T03:50:04.310713+0000","last_unstale":"2023-06-08T03:50:05.550150+0000","last_undegraded":"2023-06-08T03:50:05.550150+0000","last_fullsized":"2023-06-08T03:50:05.550150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:22:40.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305707+0000","last_change":"2023-06-08T03:50:03.885932+0000","last_active":"2023-06-08T03:50:05.305707+0000","last_peered":"2023-06-08T03:50:05.305707+0000","last_clean":"2023-06-08T03:50:05.305707+0000","last_became_active":"2023-06-08T03:50:03.885681+0000","last_became_peered":"2023-06-08T03:50:03.885681+0000","last_unstale":"2023-06-08T03:50:05.305707+0000","last_undegraded":"2023-06-08T03:50:05.305707+0000","last_fullsized":"2023-06-08T03:50:05.305707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:39:59.338306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549937+0000","last_change":"2023-06-08T03:50:04.311464+0000","last_active":"2023-06-08T03:50:05.549937+0000","last_peered":"2023-06-08T03:50:05.549937+0000","last_clean":"2023-06-08T03:50:05.549937+0000","last_became_active":"2023-06-08T03:50:04.311052+0000","last_became_peered":"2023-06-08T03:50:04.311052+0000","last_unstale":"2023-06-08T03:50:05.549937+0000","last_undegraded":"2023-06-08T03:50:05.549937+0000","last_fullsized":"2023-06-08T03:50:05.549937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:18:01.054351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451613+0000","last_change":"2023-06-08T03:50:03.887671+0000","last_active":"2023-06-08T03:50:05.451613+0000","last_peered":"2023-06-08T03:50:05.451613+0000","last_clean":"2023-06-08T03:50:05.451613+0000","last_became_active":"2023-06-08T03:50:03.887356+0000","last_became_peered":"2023-06-08T03:50:03.887356+0000","last_unstale":"2023-06-08T03:50:05.451613+0000","last_undegraded":"2023-06-08T03:50:05.451613+0000","last_fullsized":"2023-06-08T03:50:05.451613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:43:39.377798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550874+0000","last_change":"2023-06-08T03:50:04.320152+0000","last_active":"2023-06-08T03:50:05.550874+0000","last_peered":"2023-06-08T03:50:05.550874+0000","last_clean":"2023-06-08T03:50:05.550874+0000","last_became_active":"2023-06-08T03:50:04.319851+0000","last_became_peered":"2023-06-08T03:50:04.319851+0000","last_unstale":"2023-06-08T03:50:05.550874+0000","last_undegraded":"2023-06-08T03:50:05.550874+0000","last_fullsized":"2023-06-08T03:50:05.550874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:36:29.319760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549777+0000","last_change":"2023-06-08T03:50:03.886937+0000","last_active":"2023-06-08T03:50:05.549777+0000","last_peered":"2023-06-08T03:50:05.549777+0000","last_clean":"2023-06-08T03:50:05.549777+0000","last_became_active":"2023-06-08T03:50:03.886653+0000","last_became_peered":"2023-06-08T03:50:03.886653+0000","last_unstale":"2023-06-08T03:50:05.549777+0000","last_undegraded":"2023-06-08T03:50:05.549777+0000","last_fullsized":"2023-06-08T03:50:05.549777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:03:12.069492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305716+0000","last_change":"2023-06-08T03:50:04.320741+0000","last_active":"2023-06-08T03:50:05.305716+0000","last_peered":"2023-06-08T03:50:05.305716+0000","last_clean":"2023-06-08T03:50:05.305716+0000","last_became_active":"2023-06-08T03:50:04.320473+0000","last_became_peered":"2023-06-08T03:50:04.320473+0000","last_unstale":"2023-06-08T03:50:05.305716+0000","last_undegraded":"2023-06-08T03:50:05.305716+0000","last_fullsized":"2023-06-08T03:50:05.305716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:57:21.728222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305850+0000","last_change":"2023-06-08T03:50:03.880743+0000","last_active":"2023-06-08T03:50:05.305850+0000","last_peered":"2023-06-08T03:50:05.305850+0000","last_clean":"2023-06-08T03:50:05.305850+0000","last_became_active":"2023-06-08T03:50:03.880473+0000","last_became_peered":"2023-06-08T03:50:03.880473+0000","last_unstale":"2023-06-08T03:50:05.305850+0000","last_undegraded":"2023-06-08T03:50:05.305850+0000","last_fullsized":"2023-06-08T03:50:05.305850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:48:46.879617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.551040+0000","last_change":"2023-06-08T03:50:04.318395+0000","last_active":"2023-06-08T03:50:05.551040+0000","last_peered":"2023-06-08T03:50:05.551040+0000","last_clean":"2023-06-08T03:50:05.551040+0000","last_became_active":"2023-06-08T03:50:04.318105+0000","last_became_peered":"2023-06-08T03:50:04.318105+0000","last_unstale":"2023-06-08T03:50:05.551040+0000","last_undegraded":"2023-06-08T03:50:05.551040+0000","last_fullsized":"2023-06-08T03:50:05.551040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:50:56.489500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550021+0000","last_change":"2023-06-08T03:50:03.876936+0000","last_active":"2023-06-08T03:50:05.550021+0000","last_peered":"2023-06-08T03:50:05.550021+0000","last_clean":"2023-06-08T03:50:05.550021+0000","last_became_active":"2023-06-08T03:50:03.876659+0000","last_became_peered":"2023-06-08T03:50:03.876659+0000","last_unstale":"2023-06-08T03:50:05.550021+0000","last_undegraded":"2023-06-08T03:50:05.550021+0000","last_fullsized":"2023-06-08T03:50:05.550021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:54:32.337200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301263+0000","last_change":"2023-06-08T03:50:04.311544+0000","last_active":"2023-06-08T03:50:05.301263+0000","last_peered":"2023-06-08T03:50:05.301263+0000","last_clean":"2023-06-08T03:50:05.301263+0000","last_became_active":"2023-06-08T03:50:04.311270+0000","last_became_peered":"2023-06-08T03:50:04.311270+0000","last_unstale":"2023-06-08T03:50:05.301263+0000","last_undegraded":"2023-06-08T03:50:05.301263+0000","last_fullsized":"2023-06-08T03:50:05.301263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:14:22.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550709+0000","last_change":"2023-06-08T03:50:03.878921+0000","last_active":"2023-06-08T03:50:05.550709+0000","last_peered":"2023-06-08T03:50:05.550709+0000","last_clean":"2023-06-08T03:50:05.550709+0000","last_became_active":"2023-06-08T03:50:03.878442+0000","last_became_peered":"2023-06-08T03:50:03.878442+0000","last_unstale":"2023-06-08T03:50:05.550709+0000","last_undegraded":"2023-06-08T03:50:05.550709+0000","last_fullsized":"2023-06-08T03:50:05.550709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:35:34.620099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550578+0000","last_change":"2023-06-08T03:50:04.317113+0000","last_active":"2023-06-08T03:50:05.550578+0000","last_peered":"2023-06-08T03:50:05.550578+0000","last_clean":"2023-06-08T03:50:05.550578+0000","last_became_active":"2023-06-08T03:50:04.315872+0000","last_became_peered":"2023-06-08T03:50:04.315872+0000","last_unstale":"2023-06-08T03:50:05.550578+0000","last_undegraded":"2023-06-08T03:50:05.550578+0000","last_fullsized":"2023-06-08T03:50:05.550578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:25:59.502061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538567+0000","last_change":"2023-06-08T03:50:03.880936+0000","last_active":"2023-06-08T03:50:05.538567+0000","last_peered":"2023-06-08T03:50:05.538567+0000","last_clean":"2023-06-08T03:50:05.538567+0000","last_became_active":"2023-06-08T03:50:03.880497+0000","last_became_peered":"2023-06-08T03:50:03.880497+0000","last_unstale":"2023-06-08T03:50:05.538567+0000","last_undegraded":"2023-06-08T03:50:05.538567+0000","last_fullsized":"2023-06-08T03:50:05.538567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:56:14.233058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550148+0000","last_change":"2023-06-08T03:50:04.315117+0000","last_active":"2023-06-08T03:50:05.550148+0000","last_peered":"2023-06-08T03:50:05.550148+0000","last_clean":"2023-06-08T03:50:05.550148+0000","last_became_active":"2023-06-08T03:50:04.314843+0000","last_became_peered":"2023-06-08T03:50:04.314843+0000","last_unstale":"2023-06-08T03:50:05.550148+0000","last_undegraded":"2023-06-08T03:50:05.550148+0000","last_fullsized":"2023-06-08T03:50:05.550148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:12:06.202970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301416+0000","last_change":"2023-06-08T03:50:03.884316+0000","last_active":"2023-06-08T03:50:05.301416+0000","last_peered":"2023-06-08T03:50:05.301416+0000","last_clean":"2023-06-08T03:50:05.301416+0000","last_became_active":"2023-06-08T03:50:03.884048+0000","last_became_peered":"2023-06-08T03:50:03.884048+0000","last_unstale":"2023-06-08T03:50:05.301416+0000","last_undegraded":"2023-06-08T03:50:05.301416+0000","last_fullsized":"2023-06-08T03:50:05.301416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:22:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549889+0000","last_change":"2023-06-08T03:50:04.317380+0000","last_active":"2023-06-08T03:50:05.549889+0000","last_peered":"2023-06-08T03:50:05.549889+0000","last_clean":"2023-06-08T03:50:05.549889+0000","last_became_active":"2023-06-08T03:50:04.314482+0000","last_became_peered":"2023-06-08T03:50:04.314482+0000","last_unstale":"2023-06-08T03:50:05.549889+0000","last_undegraded":"2023-06-08T03:50:05.549889+0000","last_fullsized":"2023-06-08T03:50:05.549889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:28:37.647653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550219+0000","last_change":"2023-06-08T03:50:03.880451+0000","last_active":"2023-06-08T03:50:05.550219+0000","last_peered":"2023-06-08T03:50:05.550219+0000","last_clean":"2023-06-08T03:50:05.550219+0000","last_became_active":"2023-06-08T03:50:03.880179+0000","last_became_peered":"2023-06-08T03:50:03.880179+0000","last_unstale":"2023-06-08T03:50:05.550219+0000","last_undegraded":"2023-06-08T03:50:05.550219+0000","last_fullsized":"2023-06-08T03:50:05.550219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:59:36.792416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302256+0000","last_change":"2023-06-08T03:50:04.312827+0000","last_active":"2023-06-08T03:50:05.302256+0000","last_peered":"2023-06-08T03:50:05.302256+0000","last_clean":"2023-06-08T03:50:05.302256+0000","last_became_active":"2023-06-08T03:50:04.312528+0000","last_became_peered":"2023-06-08T03:50:04.312528+0000","last_unstale":"2023-06-08T03:50:05.302256+0000","last_undegraded":"2023-06-08T03:50:05.302256+0000","last_fullsized":"2023-06-08T03:50:05.302256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:59:46.988245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301522+0000","last_change":"2023-06-08T03:50:03.883994+0000","last_active":"2023-06-08T03:50:05.301522+0000","last_peered":"2023-06-08T03:50:05.301522+0000","last_clean":"2023-06-08T03:50:05.301522+0000","last_became_active":"2023-06-08T03:50:03.883726+0000","last_became_peered":"2023-06-08T03:50:03.883726+0000","last_unstale":"2023-06-08T03:50:05.301522+0000","last_undegraded":"2023-06-08T03:50:05.301522+0000","last_fullsized":"2023-06-08T03:50:05.301522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:40:39.111333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550539+0000","last_change":"2023-06-08T03:50:04.318397+0000","last_active":"2023-06-08T03:50:05.550539+0000","last_peered":"2023-06-08T03:50:05.550539+0000","last_clean":"2023-06-08T03:50:05.550539+0000","last_became_active":"2023-06-08T03:50:04.317903+0000","last_became_peered":"2023-06-08T03:50:04.317903+0000","last_unstale":"2023-06-08T03:50:05.550539+0000","last_undegraded":"2023-06-08T03:50:05.550539+0000","last_fullsized":"2023-06-08T03:50:05.550539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:04:16.466173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549948+0000","last_change":"2023-06-08T03:50:03.885850+0000","last_active":"2023-06-08T03:50:05.549948+0000","last_peered":"2023-06-08T03:50:05.549948+0000","last_clean":"2023-06-08T03:50:05.549948+0000","last_became_active":"2023-06-08T03:50:03.885548+0000","last_became_peered":"2023-06-08T03:50:03.885548+0000","last_unstale":"2023-06-08T03:50:05.549948+0000","last_undegraded":"2023-06-08T03:50:05.549948+0000","last_fullsized":"2023-06-08T03:50:05.549948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:30:50.782351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538633+0000","last_change":"2023-06-08T03:50:04.310276+0000","last_active":"2023-06-08T03:50:05.538633+0000","last_peered":"2023-06-08T03:50:05.538633+0000","last_clean":"2023-06-08T03:50:05.538633+0000","last_became_active":"2023-06-08T03:50:04.310003+0000","last_became_peered":"2023-06-08T03:50:04.310003+0000","last_unstale":"2023-06-08T03:50:05.538633+0000","last_undegraded":"2023-06-08T03:50:05.538633+0000","last_fullsized":"2023-06-08T03:50:05.538633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:05:31.737888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538557+0000","last_change":"2023-06-08T03:50:03.881684+0000","last_active":"2023-06-08T03:50:05.538557+0000","last_peered":"2023-06-08T03:50:05.538557+0000","last_clean":"2023-06-08T03:50:05.538557+0000","last_became_active":"2023-06-08T03:50:03.881392+0000","last_became_peered":"2023-06-08T03:50:03.881392+0000","last_unstale":"2023-06-08T03:50:05.538557+0000","last_undegraded":"2023-06-08T03:50:05.538557+0000","last_fullsized":"2023-06-08T03:50:05.538557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:24:43.007580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549981+0000","last_change":"2023-06-08T03:50:04.317966+0000","last_active":"2023-06-08T03:50:05.549981+0000","last_peered":"2023-06-08T03:50:05.549981+0000","last_clean":"2023-06-08T03:50:05.549981+0000","last_became_active":"2023-06-08T03:50:04.317706+0000","last_became_peered":"2023-06-08T03:50:04.317706+0000","last_unstale":"2023-06-08T03:50:05.549981+0000","last_undegraded":"2023-06-08T03:50:05.549981+0000","last_fullsized":"2023-06-08T03:50:05.549981+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:51:14.993458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305694+0000","last_change":"2023-06-08T03:50:03.887811+0000","last_active":"2023-06-08T03:50:05.305694+0000","last_peered":"2023-06-08T03:50:05.305694+0000","last_clean":"2023-06-08T03:50:05.305694+0000","last_became_active":"2023-06-08T03:50:03.887277+0000","last_became_peered":"2023-06-08T03:50:03.887277+0000","last_unstale":"2023-06-08T03:50:05.305694+0000","last_undegraded":"2023-06-08T03:50:05.305694+0000","last_fullsized":"2023-06-08T03:50:05.305694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:53:23.803343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550498+0000","last_change":"2023-06-08T03:50:04.306795+0000","last_active":"2023-06-08T03:50:05.550498+0000","last_peered":"2023-06-08T03:50:05.550498+0000","last_clean":"2023-06-08T03:50:05.550498+0000","last_became_active":"2023-06-08T03:50:04.306477+0000","last_became_peered":"2023-06-08T03:50:04.306477+0000","last_unstale":"2023-06-08T03:50:05.550498+0000","last_undegraded":"2023-06-08T03:50:05.550498+0000","last_fullsized":"2023-06-08T03:50:05.550498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:51:33.942083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451909+0000","last_change":"2023-06-08T03:50:03.887660+0000","last_active":"2023-06-08T03:50:05.451909+0000","last_peered":"2023-06-08T03:50:05.451909+0000","last_clean":"2023-06-08T03:50:05.451909+0000","last_became_active":"2023-06-08T03:50:03.887342+0000","last_became_peered":"2023-06-08T03:50:03.887342+0000","last_unstale":"2023-06-08T03:50:05.451909+0000","last_undegraded":"2023-06-08T03:50:05.451909+0000","last_fullsized":"2023-06-08T03:50:05.451909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:59:38.127160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550635+0000","last_change":"2023-06-08T03:50:04.316814+0000","last_active":"2023-06-08T03:50:05.550635+0000","last_peered":"2023-06-08T03:50:05.550635+0000","last_clean":"2023-06-08T03:50:05.550635+0000","last_became_active":"2023-06-08T03:50:04.316525+0000","last_became_peered":"2023-06-08T03:50:04.316525+0000","last_unstale":"2023-06-08T03:50:05.550635+0000","last_undegraded":"2023-06-08T03:50:05.550635+0000","last_fullsized":"2023-06-08T03:50:05.550635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:39:27.268069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301445+0000","last_change":"2023-06-08T03:50:03.877732+0000","last_active":"2023-06-08T03:50:05.301445+0000","last_peered":"2023-06-08T03:50:05.301445+0000","last_clean":"2023-06-08T03:50:05.301445+0000","last_became_active":"2023-06-08T03:50:03.877442+0000","last_became_peered":"2023-06-08T03:50:03.877442+0000","last_unstale":"2023-06-08T03:50:05.301445+0000","last_undegraded":"2023-06-08T03:50:05.301445+0000","last_fullsized":"2023-06-08T03:50:05.301445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:27.083847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302210+0000","last_change":"2023-06-08T03:50:04.312282+0000","last_active":"2023-06-08T03:50:05.302210+0000","last_peered":"2023-06-08T03:50:05.302210+0000","last_clean":"2023-06-08T03:50:05.302210+0000","last_became_active":"2023-06-08T03:50:04.312038+0000","last_became_peered":"2023-06-08T03:50:04.312038+0000","last_unstale":"2023-06-08T03:50:05.302210+0000","last_undegraded":"2023-06-08T03:50:05.302210+0000","last_fullsized":"2023-06-08T03:50:05.302210+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:59:37.794493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301428+0000","last_change":"2023-06-08T03:50:03.876943+0000","last_active":"2023-06-08T03:50:05.301428+0000","last_peered":"2023-06-08T03:50:05.301428+0000","last_clean":"2023-06-08T03:50:05.301428+0000","last_became_active":"2023-06-08T03:50:03.876602+0000","last_became_peered":"2023-06-08T03:50:03.876602+0000","last_unstale":"2023-06-08T03:50:05.301428+0000","last_undegraded":"2023-06-08T03:50:05.301428+0000","last_fullsized":"2023-06-08T03:50:05.301428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:27:29.901155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305989+0000","last_change":"2023-06-08T03:50:04.314691+0000","last_active":"2023-06-08T03:50:05.305989+0000","last_peered":"2023-06-08T03:50:05.305989+0000","last_clean":"2023-06-08T03:50:05.305989+0000","last_became_active":"2023-06-08T03:50:04.314366+0000","last_became_peered":"2023-06-08T03:50:04.314366+0000","last_unstale":"2023-06-08T03:50:05.305989+0000","last_undegraded":"2023-06-08T03:50:05.305989+0000","last_fullsized":"2023-06-08T03:50:05.305989+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:53.539487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451635+0000","last_change":"2023-06-08T03:50:03.885035+0000","last_active":"2023-06-08T03:50:05.451635+0000","last_peered":"2023-06-08T03:50:05.451635+0000","last_clean":"2023-06-08T03:50:05.451635+0000","last_became_active":"2023-06-08T03:50:03.884774+0000","last_became_peered":"2023-06-08T03:50:03.884774+0000","last_unstale":"2023-06-08T03:50:05.451635+0000","last_undegraded":"2023-06-08T03:50:05.451635+0000","last_fullsized":"2023-06-08T03:50:05.451635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:37:19.829154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538545+0000","last_change":"2023-06-08T03:50:04.320011+0000","last_active":"2023-06-08T03:50:05.538545+0000","last_peered":"2023-06-08T03:50:05.538545+0000","last_clean":"2023-06-08T03:50:05.538545+0000","last_became_active":"2023-06-08T03:50:04.319740+0000","last_became_peered":"2023-06-08T03:50:04.319740+0000","last_unstale":"2023-06-08T03:50:05.538545+0000","last_undegraded":"2023-06-08T03:50:05.538545+0000","last_fullsized":"2023-06-08T03:50:05.538545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:30:41.491320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549465+0000","last_change":"2023-06-08T03:50:03.877730+0000","last_active":"2023-06-08T03:50:05.549465+0000","last_peered":"2023-06-08T03:50:05.549465+0000","last_clean":"2023-06-08T03:50:05.549465+0000","last_became_active":"2023-06-08T03:50:03.877442+0000","last_became_peered":"2023-06-08T03:50:03.877442+0000","last_unstale":"2023-06-08T03:50:05.549465+0000","last_undegraded":"2023-06-08T03:50:05.549465+0000","last_fullsized":"2023-06-08T03:50:05.549465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:30:31.608233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549595+0000","last_change":"2023-06-08T03:50:04.315095+0000","last_active":"2023-06-08T03:50:05.549595+0000","last_peered":"2023-06-08T03:50:05.549595+0000","last_clean":"2023-06-08T03:50:05.549595+0000","last_became_active":"2023-06-08T03:50:04.314840+0000","last_became_peered":"2023-06-08T03:50:04.314840+0000","last_unstale":"2023-06-08T03:50:05.549595+0000","last_undegraded":"2023-06-08T03:50:05.549595+0000","last_fullsized":"2023-06-08T03:50:05.549595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:12:29.831307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549781+0000","last_change":"2023-06-08T03:50:03.880493+0000","last_active":"2023-06-08T03:50:05.549781+0000","last_peered":"2023-06-08T03:50:05.549781+0000","last_clean":"2023-06-08T03:50:05.549781+0000","last_became_active":"2023-06-08T03:50:03.880166+0000","last_became_peered":"2023-06-08T03:50:03.880166+0000","last_unstale":"2023-06-08T03:50:05.549781+0000","last_undegraded":"2023-06-08T03:50:05.549781+0000","last_fullsized":"2023-06-08T03:50:05.549781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:51:00.870150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301348+0000","last_change":"2023-06-08T03:50:04.313838+0000","last_active":"2023-06-08T03:50:05.301348+0000","last_peered":"2023-06-08T03:50:05.301348+0000","last_clean":"2023-06-08T03:50:05.301348+0000","last_became_active":"2023-06-08T03:50:04.313152+0000","last_became_peered":"2023-06-08T03:50:04.313152+0000","last_unstale":"2023-06-08T03:50:05.301348+0000","last_undegraded":"2023-06-08T03:50:05.301348+0000","last_fullsized":"2023-06-08T03:50:05.301348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:24.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305546+0000","last_change":"2023-06-08T03:50:03.883840+0000","last_active":"2023-06-08T03:50:05.305546+0000","last_peered":"2023-06-08T03:50:05.305546+0000","last_clean":"2023-06-08T03:50:05.305546+0000","last_became_active":"2023-06-08T03:50:03.883408+0000","last_became_peered":"2023-06-08T03:50:03.883408+0000","last_unstale":"2023-06-08T03:50:05.305546+0000","last_undegraded":"2023-06-08T03:50:05.305546+0000","last_fullsized":"2023-06-08T03:50:05.305546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:18:12.586009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305589+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:50:05.305589+0000","last_peered":"2023-06-08T03:50:05.305589+0000","last_clean":"2023-06-08T03:50:05.305589+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:50:05.305589+0000","last_undegraded":"2023-06-08T03:50:05.305589+0000","last_fullsized":"2023-06-08T03:50:05.305589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:13.293946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302249+0000","last_change":"2023-06-08T03:50:04.319062+0000","last_active":"2023-06-08T03:50:05.302249+0000","last_peered":"2023-06-08T03:50:05.302249+0000","last_clean":"2023-06-08T03:50:05.302249+0000","last_became_active":"2023-06-08T03:50:04.318783+0000","last_became_peered":"2023-06-08T03:50:04.318783+0000","last_unstale":"2023-06-08T03:50:05.302249+0000","last_undegraded":"2023-06-08T03:50:05.302249+0000","last_fullsized":"2023-06-08T03:50:05.302249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:46:13.664232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550402+0000","last_change":"2023-06-08T03:50:03.878507+0000","last_active":"2023-06-08T03:50:05.550402+0000","last_peered":"2023-06-08T03:50:05.550402+0000","last_clean":"2023-06-08T03:50:05.550402+0000","last_became_active":"2023-06-08T03:50:03.878178+0000","last_became_peered":"2023-06-08T03:50:03.878178+0000","last_unstale":"2023-06-08T03:50:05.550402+0000","last_undegraded":"2023-06-08T03:50:05.550402+0000","last_fullsized":"2023-06-08T03:50:05.550402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:33:49.252611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301579+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:50:05.301579+0000","last_peered":"2023-06-08T03:50:05.301579+0000","last_clean":"2023-06-08T03:50:05.301579+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:50:05.301579+0000","last_undegraded":"2023-06-08T03:50:05.301579+0000","last_fullsized":"2023-06-08T03:50:05.301579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:49:38.169180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550586+0000","last_change":"2023-06-08T03:50:04.313675+0000","last_active":"2023-06-08T03:50:05.550586+0000","last_peered":"2023-06-08T03:50:05.550586+0000","last_clean":"2023-06-08T03:50:05.550586+0000","last_became_active":"2023-06-08T03:50:04.313292+0000","last_became_peered":"2023-06-08T03:50:04.313292+0000","last_unstale":"2023-06-08T03:50:05.550586+0000","last_undegraded":"2023-06-08T03:50:05.550586+0000","last_fullsized":"2023-06-08T03:50:05.550586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:58:36.044898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305950+0000","last_change":"2023-06-08T03:50:03.885465+0000","last_active":"2023-06-08T03:50:05.305950+0000","last_peered":"2023-06-08T03:50:05.305950+0000","last_clean":"2023-06-08T03:50:05.305950+0000","last_became_active":"2023-06-08T03:50:03.885182+0000","last_became_peered":"2023-06-08T03:50:03.885182+0000","last_unstale":"2023-06-08T03:50:05.305950+0000","last_undegraded":"2023-06-08T03:50:05.305950+0000","last_fullsized":"2023-06-08T03:50:05.305950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:44:39.328383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305992+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:50:05.305992+0000","last_peered":"2023-06-08T03:50:05.305992+0000","last_clean":"2023-06-08T03:50:05.305992+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:50:05.305992+0000","last_undegraded":"2023-06-08T03:50:05.305992+0000","last_fullsized":"2023-06-08T03:50:05.305992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:55:11.302743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":201,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550020+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:50:05.550020+0000","last_peered":"2023-06-08T03:50:05.550020+0000","last_clean":"2023-06-08T03:50:05.550020+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:50:05.550020+0000","last_undegraded":"2023-06-08T03:50:05.550020+0000","last_fullsized":"2023-06-08T03:50:05.550020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:43:38.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549895+0000","last_change":"2023-06-08T03:50:04.311778+0000","last_active":"2023-06-08T03:50:05.549895+0000","last_peered":"2023-06-08T03:50:05.549895+0000","last_clean":"2023-06-08T03:50:05.549895+0000","last_became_active":"2023-06-08T03:50:04.311481+0000","last_became_peered":"2023-06-08T03:50:04.311481+0000","last_unstale":"2023-06-08T03:50:05.549895+0000","last_undegraded":"2023-06-08T03:50:05.549895+0000","last_fullsized":"2023-06-08T03:50:05.549895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:03:31.153229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550701+0000","last_change":"2023-06-08T03:50:03.879067+0000","last_active":"2023-06-08T03:50:05.550701+0000","last_peered":"2023-06-08T03:50:05.550701+0000","last_clean":"2023-06-08T03:50:05.550701+0000","last_became_active":"2023-06-08T03:50:03.878796+0000","last_became_peered":"2023-06-08T03:50:03.878796+0000","last_unstale":"2023-06-08T03:50:05.550701+0000","last_undegraded":"2023-06-08T03:50:05.550701+0000","last_fullsized":"2023-06-08T03:50:05.550701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:09:06.797807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550271+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:50:05.550271+0000","last_peered":"2023-06-08T03:50:05.550271+0000","last_clean":"2023-06-08T03:50:05.550271+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:50:05.550271+0000","last_undegraded":"2023-06-08T03:50:05.550271+0000","last_fullsized":"2023-06-08T03:50:05.550271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:44:49.961184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550022+0000","last_change":"2023-06-08T03:50:04.319347+0000","last_active":"2023-06-08T03:50:05.550022+0000","last_peered":"2023-06-08T03:50:05.550022+0000","last_clean":"2023-06-08T03:50:05.550022+0000","last_became_active":"2023-06-08T03:50:04.319070+0000","last_became_peered":"2023-06-08T03:50:04.319070+0000","last_unstale":"2023-06-08T03:50:05.550022+0000","last_undegraded":"2023-06-08T03:50:05.550022+0000","last_fullsized":"2023-06-08T03:50:05.550022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:16:25.568919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.452103+0000","last_change":"2023-06-08T03:50:03.889567+0000","last_active":"2023-06-08T03:50:05.452103+0000","last_peered":"2023-06-08T03:50:05.452103+0000","last_clean":"2023-06-08T03:50:05.452103+0000","last_became_active":"2023-06-08T03:50:03.889230+0000","last_became_peered":"2023-06-08T03:50:03.889230+0000","last_unstale":"2023-06-08T03:50:05.452103+0000","last_undegraded":"2023-06-08T03:50:05.452103+0000","last_fullsized":"2023-06-08T03:50:05.452103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:22:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549892+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:50:05.549892+0000","last_peered":"2023-06-08T03:50:05.549892+0000","last_clean":"2023-06-08T03:50:05.549892+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:50:05.549892+0000","last_undegraded":"2023-06-08T03:50:05.549892+0000","last_fullsized":"2023-06-08T03:50:05.549892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:46:05.899110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550671+0000","last_change":"2023-06-08T03:50:04.314883+0000","last_active":"2023-06-08T03:50:05.550671+0000","last_peered":"2023-06-08T03:50:05.550671+0000","last_clean":"2023-06-08T03:50:05.550671+0000","last_became_active":"2023-06-08T03:50:04.314612+0000","last_became_peered":"2023-06-08T03:50:04.314612+0000","last_unstale":"2023-06-08T03:50:05.550671+0000","last_undegraded":"2023-06-08T03:50:05.550671+0000","last_fullsized":"2023-06-08T03:50:05.550671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:48:44.761868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301539+0000","last_change":"2023-06-08T03:50:03.886787+0000","last_active":"2023-06-08T03:50:05.301539+0000","last_peered":"2023-06-08T03:50:05.301539+0000","last_clean":"2023-06-08T03:50:05.301539+0000","last_became_active":"2023-06-08T03:50:03.886490+0000","last_became_peered":"2023-06-08T03:50:03.886490+0000","last_unstale":"2023-06-08T03:50:05.301539+0000","last_undegraded":"2023-06-08T03:50:05.301539+0000","last_fullsized":"2023-06-08T03:50:05.301539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:34:01.308242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451806+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:50:05.451806+0000","last_peered":"2023-06-08T03:50:05.451806+0000","last_clean":"2023-06-08T03:50:05.451806+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:50:05.451806+0000","last_undegraded":"2023-06-08T03:50:05.451806+0000","last_fullsized":"2023-06-08T03:50:05.451806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:39:58.820156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451684+0000","last_change":"2023-06-08T03:50:04.315005+0000","last_active":"2023-06-08T03:50:05.451684+0000","last_peered":"2023-06-08T03:50:05.451684+0000","last_clean":"2023-06-08T03:50:05.451684+0000","last_became_active":"2023-06-08T03:50:04.314739+0000","last_became_peered":"2023-06-08T03:50:04.314739+0000","last_unstale":"2023-06-08T03:50:05.451684+0000","last_undegraded":"2023-06-08T03:50:05.451684+0000","last_fullsized":"2023-06-08T03:50:05.451684+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:03:28.497446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305877+0000","last_change":"2023-06-08T03:50:03.884645+0000","last_active":"2023-06-08T03:50:05.305877+0000","last_peered":"2023-06-08T03:50:05.305877+0000","last_clean":"2023-06-08T03:50:05.305877+0000","last_became_active":"2023-06-08T03:50:03.884324+0000","last_became_peered":"2023-06-08T03:50:03.884324+0000","last_unstale":"2023-06-08T03:50:05.305877+0000","last_undegraded":"2023-06-08T03:50:05.305877+0000","last_fullsized":"2023-06-08T03:50:05.305877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:37:43.814012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550809+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:50:05.550809+0000","last_peered":"2023-06-08T03:50:05.550809+0000","last_clean":"2023-06-08T03:50:05.550809+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:50:05.550809+0000","last_undegraded":"2023-06-08T03:50:05.550809+0000","last_fullsized":"2023-06-08T03:50:05.550809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:02:53.673536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305415+0000","last_change":"2023-06-08T03:50:04.305063+0000","last_active":"2023-06-08T03:50:05.305415+0000","last_peered":"2023-06-08T03:50:05.305415+0000","last_clean":"2023-06-08T03:50:05.305415+0000","last_became_active":"2023-06-08T03:50:04.302207+0000","last_became_peered":"2023-06-08T03:50:04.302207+0000","last_unstale":"2023-06-08T03:50:05.305415+0000","last_undegraded":"2023-06-08T03:50:05.305415+0000","last_fullsized":"2023-06-08T03:50:05.305415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:52:54.122463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550031+0000","last_change":"2023-06-08T03:50:03.882733+0000","last_active":"2023-06-08T03:50:05.550031+0000","last_peered":"2023-06-08T03:50:05.550031+0000","last_clean":"2023-06-08T03:50:05.550031+0000","last_became_active":"2023-06-08T03:50:03.879940+0000","last_became_peered":"2023-06-08T03:50:03.879940+0000","last_unstale":"2023-06-08T03:50:05.550031+0000","last_undegraded":"2023-06-08T03:50:05.550031+0000","last_fullsized":"2023-06-08T03:50:05.550031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:37:39.449770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550925+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:50:05.550925+0000","last_peered":"2023-06-08T03:50:05.550925+0000","last_clean":"2023-06-08T03:50:05.550925+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:50:05.550925+0000","last_undegraded":"2023-06-08T03:50:05.550925+0000","last_fullsized":"2023-06-08T03:50:05.550925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:12:21.713193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":798734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.376},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":208948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.1279999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.1760000000000002,"5min":5.1760000000000002,"15min":5.1760000000000002},"last":1.169},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.626}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":798714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":7.0410000000000004,"5min":7.0410000000000004,"15min":7.0410000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.944,"5min":6.944,"15min":6.944},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.9870000000000001,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.5179999999999998,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":7.5570000000000004,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":208310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.432},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":209862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.923,"5min":11.923,"15min":11.923},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.877000000000001,"5min":11.877000000000001,"15min":11.877000000000001},"last":0.372},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.048,"5min":8.048,"15min":8.048},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.746}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.626}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":208914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.623}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.2089999999999996,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":209840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.437},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":208346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.626}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.437},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:50:13.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T03:50:13.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.209+0000 7fb6dfebf700 1 Processor -- start 2023-06-08T03:50:13.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.209+0000 7fb6dfebf700 1 -- start start 2023-06-08T03:50:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6dfebf700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb6d815c300 0x7fb6d8071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6dfebf700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d815c6d0 0x7fb6d80cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6dfebf700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d80b2090 con 0x7fb6d8069db0 2023-06-08T03:50:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6dfebf700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d80cd910 con 0x7fb6d815c300 2023-06-08T03:50:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6dfebf700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80b1db0 con 0x7fb6d815c6d0 2023-06-08T03:50:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6ddc5b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb6d815c300 0x7fb6d8071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6de45c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb6d8069db0 0x7fb6d80b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55496/0 (socket says 172.21.15.43:55496) 2023-06-08T03:50:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.210+0000 7fb6de45c700 1 -- 172.21.15.43:0/3230227678 learned_addr learned my addr 172.21.15.43:0/3230227678 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6dd45a700 1 --2- 172.21.15.43:0/3230227678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d815c6d0 0x7fb6d80cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6ddc5b700 1 -- 172.21.15.43:0/3230227678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d815c6d0 msgr2=0x7fb6d80cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6ddc5b700 1 --2- 172.21.15.43:0/3230227678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d815c6d0 0x7fb6d80cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6ddc5b700 1 -- 172.21.15.43:0/3230227678 >> v1:172.21.15.43:6789/0 conn(0x7fb6d8069db0 legacy=0x7fb6d80b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6ddc5b700 1 -- 172.21.15.43:0/3230227678 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80cd350 con 0x7fb6d815c300 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6dcc59700 1 -- 172.21.15.43:0/3230227678 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038763522 0 0) 0x7fb6d80b2090 con 0x7fb6d8069db0 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6ddc5b700 1 --2- 172.21.15.43:0/3230227678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d8071fc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009840 tx=0x7fb6c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3365d5d7f7de1075 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6dcc59700 1 -- 172.21.15.43:0/3230227678 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011830 con 0x7fb6d815c300 2023-06-08T03:50:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6dcc59700 1 -- 172.21.15.43:0/3230227678 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8011990 con 0x7fb6d815c300 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.211+0000 7fb6dcc59700 1 -- 172.21.15.43:0/3230227678 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011d20 con 0x7fb6d815c300 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 -- 172.21.15.43:0/3230227678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 msgr2=0x7fb6d8071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/3230227678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d8071fc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009840 tx=0x7fb6c8009b50 comp rx=0 tx=0).stop 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 -- 172.21.15.43:0/3230227678 shutdown_connections 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/3230227678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d8071fc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/3230227678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d815c6d0 0x7fb6d80cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 -- 172.21.15.43:0/3230227678 >> 172.21.15.43:0/3230227678 conn(0x7fb6d806aec0 msgr2=0x7fb6d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 -- 172.21.15.43:0/3230227678 shutdown_connections 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.212+0000 7fb6dfebf700 1 -- 172.21.15.43:0/3230227678 wait complete. 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.213+0000 7fb6dfebf700 1 Processor -- start 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 -- start start 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d8069db0 0x7fb6d81ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d80b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6d815c6d0 0x7fb6d80b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81f2be0 con 0x7fb6d815c300 2023-06-08T03:50:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80b4300 con 0x7fb6d815c6d0 2023-06-08T03:50:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.214+0000 7fb6dfebf700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80b45e0 con 0x7fb6d8069db0 2023-06-08T03:50:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d80b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d80b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60596/0 (socket says 172.21.15.43:60596) 2023-06-08T03:50:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 -- 172.21.15.43:0/4052931729 learned_addr learned my addr 172.21.15.43:0/4052931729 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6ddc5b700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d8069db0 0x7fb6d81ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6de45c700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6d815c6d0 0x7fb6d80b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 -- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d8069db0 msgr2=0x7fb6d81ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d8069db0 0x7fb6d81ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 -- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6d815c6d0 msgr2=0x7fb6d80b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6d815c6d0 0x7fb6d80b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 -- 172.21.15.43:0/4052931729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c80094a0 con 0x7fb6d815c300 2023-06-08T03:50:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dd45a700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d80b0270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400d800 tx=0x7fb6d400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d40125f0 con 0x7fb6d815c300 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4012750 con 0x7fb6d815c300 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d80b48c0 con 0x7fb6d815c300 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4012b00 con 0x7fb6d815c300 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.215+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d80b50c0 con 0x7fb6d815c300 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.216+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d80b4f10 con 0x7fb6d815c300 2023-06-08T03:50:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.217+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6d4012c60 con 0x7fb6d815c300 2023-06-08T03:50:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.217+0000 7fb6ce7fc700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb6bc06ace0 0x7fb6bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.217+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb6d4089870 con 0x7fb6d815c300 2023-06-08T03:50:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.218+0000 7fb6ddc5b700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb6bc06ace0 0x7fb6bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.218+0000 7fb6ddc5b700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb6bc06ace0 0x7fb6bc06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80090b0 tx=0x7fb6c8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.222+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6d4054870 con 0x7fb6d815c300 2023-06-08T03:50:13.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.415+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 --> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6d80b1a60 con 0x7fb6bc06ace0 2023-06-08T03:50:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.424+0000 7fb6ce7fc700 1 -- 172.21.15.43:0/4052931729 <== mgr.4102 v2:172.21.15.135:6832/298241574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311699 (secure 0 0 0) 0x7fb6c8011c00 con 0x7fb6bc06ace0 2023-06-08T03:50:13.431 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:13.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb6bc06ace0 msgr2=0x7fb6bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb6bc06ace0 0x7fb6bc06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80090b0 tx=0x7fb6c8008030 comp rx=0 tx=0).stop 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 msgr2=0x7fb6d80b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d80b0270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400d800 tx=0x7fb6d400db10 comp rx=0 tx=0).stop 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 shutdown_connections 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fb6bc06ace0 0x7fb6bc06d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6d815c6d0 0x7fb6d80b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6d8069db0 0x7fb6d81ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 --2- 172.21.15.43:0/4052931729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6d815c300 0x7fb6d80b0270 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.427+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 >> 172.21.15.43:0/4052931729 conn(0x7fb6d806aec0 msgr2=0x7fb6d815cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:13.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.428+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 shutdown_connections 2023-06-08T03:50:13.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.428+0000 7fb6dfebf700 1 -- 172.21.15.43:0/4052931729 wait complete. 2023-06-08T03:50:13.435 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-06-08T03:50:13.444 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-06-08T03:50:11.585070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220456,"kb_used_data":4840,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754264,"statfs":{"total":773094113280,"available":772868366336,"internally_reserved":0,"allocated":4956160,"data_stored":2851668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.720123"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.551021+0000","last_change":"2023-06-08T03:50:04.313578+0000","last_active":"2023-06-08T03:50:05.551021+0000","last_peered":"2023-06-08T03:50:05.551021+0000","last_clean":"2023-06-08T03:50:05.551021+0000","last_became_active":"2023-06-08T03:50:04.313315+0000","last_became_peered":"2023-06-08T03:50:04.313315+0000","last_unstale":"2023-06-08T03:50:05.551021+0000","last_undegraded":"2023-06-08T03:50:05.551021+0000","last_fullsized":"2023-06-08T03:50:05.551021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:25:49.056825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.452013+0000","last_change":"2023-06-08T03:50:04.324015+0000","last_active":"2023-06-08T03:50:05.452013+0000","last_peered":"2023-06-08T03:50:05.452013+0000","last_clean":"2023-06-08T03:50:05.452013+0000","last_became_active":"2023-06-08T03:50:04.323772+0000","last_became_peered":"2023-06-08T03:50:04.323772+0000","last_unstale":"2023-06-08T03:50:05.452013+0000","last_undegraded":"2023-06-08T03:50:05.452013+0000","last_fullsized":"2023-06-08T03:50:05.452013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:24.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305496+0000","last_change":"2023-06-08T03:50:04.308482+0000","last_active":"2023-06-08T03:50:05.305496+0000","last_peered":"2023-06-08T03:50:05.305496+0000","last_clean":"2023-06-08T03:50:05.305496+0000","last_became_active":"2023-06-08T03:50:04.308211+0000","last_became_peered":"2023-06-08T03:50:04.308211+0000","last_unstale":"2023-06-08T03:50:05.305496+0000","last_undegraded":"2023-06-08T03:50:05.305496+0000","last_fullsized":"2023-06-08T03:50:05.305496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:57:32.893940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549778+0000","last_change":"2023-06-08T03:50:04.313010+0000","last_active":"2023-06-08T03:50:05.549778+0000","last_peered":"2023-06-08T03:50:05.549778+0000","last_clean":"2023-06-08T03:50:05.549778+0000","last_became_active":"2023-06-08T03:50:04.312760+0000","last_became_peered":"2023-06-08T03:50:04.312760+0000","last_unstale":"2023-06-08T03:50:05.549778+0000","last_undegraded":"2023-06-08T03:50:05.549778+0000","last_fullsized":"2023-06-08T03:50:05.549778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:02:01.072516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451933+0000","last_change":"2023-06-08T03:50:04.314457+0000","last_active":"2023-06-08T03:50:05.451933+0000","last_peered":"2023-06-08T03:50:05.451933+0000","last_clean":"2023-06-08T03:50:05.451933+0000","last_became_active":"2023-06-08T03:50:04.314177+0000","last_became_peered":"2023-06-08T03:50:04.314177+0000","last_unstale":"2023-06-08T03:50:05.451933+0000","last_undegraded":"2023-06-08T03:50:05.451933+0000","last_fullsized":"2023-06-08T03:50:05.451933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:55:55.285693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302173+0000","last_change":"2023-06-08T03:50:04.320255+0000","last_active":"2023-06-08T03:50:05.302173+0000","last_peered":"2023-06-08T03:50:05.302173+0000","last_clean":"2023-06-08T03:50:05.302173+0000","last_became_active":"2023-06-08T03:50:04.319966+0000","last_became_peered":"2023-06-08T03:50:04.319966+0000","last_unstale":"2023-06-08T03:50:05.302173+0000","last_undegraded":"2023-06-08T03:50:05.302173+0000","last_fullsized":"2023-06-08T03:50:05.302173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:18:59.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550195+0000","last_change":"2023-06-08T03:50:04.318428+0000","last_active":"2023-06-08T03:50:05.550195+0000","last_peered":"2023-06-08T03:50:05.550195+0000","last_clean":"2023-06-08T03:50:05.550195+0000","last_became_active":"2023-06-08T03:50:04.317852+0000","last_became_peered":"2023-06-08T03:50:04.317852+0000","last_unstale":"2023-06-08T03:50:05.550195+0000","last_undegraded":"2023-06-08T03:50:05.550195+0000","last_fullsized":"2023-06-08T03:50:05.550195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:18:59.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549463+0000","last_change":"2023-06-08T03:50:04.311671+0000","last_active":"2023-06-08T03:50:05.549463+0000","last_peered":"2023-06-08T03:50:05.549463+0000","last_clean":"2023-06-08T03:50:05.549463+0000","last_became_active":"2023-06-08T03:50:04.311386+0000","last_became_peered":"2023-06-08T03:50:04.311386+0000","last_unstale":"2023-06-08T03:50:05.549463+0000","last_undegraded":"2023-06-08T03:50:05.549463+0000","last_fullsized":"2023-06-08T03:50:05.549463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:08:20.467424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549963+0000","last_change":"2023-06-08T03:50:04.315007+0000","last_active":"2023-06-08T03:50:05.549963+0000","last_peered":"2023-06-08T03:50:05.549963+0000","last_clean":"2023-06-08T03:50:05.549963+0000","last_became_active":"2023-06-08T03:50:04.314700+0000","last_became_peered":"2023-06-08T03:50:04.314700+0000","last_unstale":"2023-06-08T03:50:05.549963+0000","last_undegraded":"2023-06-08T03:50:05.549963+0000","last_fullsized":"2023-06-08T03:50:05.549963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:02:12.053726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549929+0000","last_change":"2023-06-08T03:50:04.314735+0000","last_active":"2023-06-08T03:50:05.549929+0000","last_peered":"2023-06-08T03:50:05.549929+0000","last_clean":"2023-06-08T03:50:05.549929+0000","last_became_active":"2023-06-08T03:50:04.314407+0000","last_became_peered":"2023-06-08T03:50:04.314407+0000","last_unstale":"2023-06-08T03:50:05.549929+0000","last_undegraded":"2023-06-08T03:50:05.549929+0000","last_fullsized":"2023-06-08T03:50:05.549929+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:54:26.280084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549805+0000","last_change":"2023-06-08T03:50:04.322922+0000","last_active":"2023-06-08T03:50:05.549805+0000","last_peered":"2023-06-08T03:50:05.549805+0000","last_clean":"2023-06-08T03:50:05.549805+0000","last_became_active":"2023-06-08T03:50:04.322635+0000","last_became_peered":"2023-06-08T03:50:04.322635+0000","last_unstale":"2023-06-08T03:50:05.549805+0000","last_undegraded":"2023-06-08T03:50:05.549805+0000","last_fullsized":"2023-06-08T03:50:05.549805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:10:35.282996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.452061+0000","last_change":"2023-06-08T03:50:04.312886+0000","last_active":"2023-06-08T03:50:05.452061+0000","last_peered":"2023-06-08T03:50:05.452061+0000","last_clean":"2023-06-08T03:50:05.452061+0000","last_became_active":"2023-06-08T03:50:04.312636+0000","last_became_peered":"2023-06-08T03:50:04.312636+0000","last_unstale":"2023-06-08T03:50:05.452061+0000","last_undegraded":"2023-06-08T03:50:05.452061+0000","last_fullsized":"2023-06-08T03:50:05.452061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:51:56.664299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538391+0000","last_change":"2023-06-08T03:50:04.323610+0000","last_active":"2023-06-08T03:50:05.538391+0000","last_peered":"2023-06-08T03:50:05.538391+0000","last_clean":"2023-06-08T03:50:05.538391+0000","last_became_active":"2023-06-08T03:50:04.323287+0000","last_became_peered":"2023-06-08T03:50:04.323287+0000","last_unstale":"2023-06-08T03:50:05.538391+0000","last_undegraded":"2023-06-08T03:50:05.538391+0000","last_fullsized":"2023-06-08T03:50:05.538391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:36:30.356179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549571+0000","last_change":"2023-06-08T03:50:04.318170+0000","last_active":"2023-06-08T03:50:05.549571+0000","last_peered":"2023-06-08T03:50:05.549571+0000","last_clean":"2023-06-08T03:50:05.549571+0000","last_became_active":"2023-06-08T03:50:04.315197+0000","last_became_peered":"2023-06-08T03:50:04.315197+0000","last_unstale":"2023-06-08T03:50:05.549571+0000","last_undegraded":"2023-06-08T03:50:05.549571+0000","last_fullsized":"2023-06-08T03:50:05.549571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:27:37.945124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301179+0000","last_change":"2023-06-08T03:50:04.308768+0000","last_active":"2023-06-08T03:50:05.301179+0000","last_peered":"2023-06-08T03:50:05.301179+0000","last_clean":"2023-06-08T03:50:05.301179+0000","last_became_active":"2023-06-08T03:50:04.308497+0000","last_became_peered":"2023-06-08T03:50:04.308497+0000","last_unstale":"2023-06-08T03:50:05.301179+0000","last_undegraded":"2023-06-08T03:50:05.301179+0000","last_fullsized":"2023-06-08T03:50:05.301179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:55:55.285693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549766+0000","last_change":"2023-06-08T03:50:04.315473+0000","last_active":"2023-06-08T03:50:05.549766+0000","last_peered":"2023-06-08T03:50:05.549766+0000","last_clean":"2023-06-08T03:50:05.549766+0000","last_became_active":"2023-06-08T03:50:04.315207+0000","last_became_peered":"2023-06-08T03:50:04.315207+0000","last_unstale":"2023-06-08T03:50:05.549766+0000","last_undegraded":"2023-06-08T03:50:05.549766+0000","last_fullsized":"2023-06-08T03:50:05.549766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:41.981051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305701+0000","last_change":"2023-06-08T03:50:04.311921+0000","last_active":"2023-06-08T03:50:05.305701+0000","last_peered":"2023-06-08T03:50:05.305701+0000","last_clean":"2023-06-08T03:50:05.305701+0000","last_became_active":"2023-06-08T03:50:04.311584+0000","last_became_peered":"2023-06-08T03:50:04.311584+0000","last_unstale":"2023-06-08T03:50:05.305701+0000","last_undegraded":"2023-06-08T03:50:05.305701+0000","last_fullsized":"2023-06-08T03:50:05.305701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:26:11.252073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305523+0000","last_change":"2023-06-08T03:50:04.316137+0000","last_active":"2023-06-08T03:50:05.305523+0000","last_peered":"2023-06-08T03:50:05.305523+0000","last_clean":"2023-06-08T03:50:05.305523+0000","last_became_active":"2023-06-08T03:50:04.315820+0000","last_became_peered":"2023-06-08T03:50:04.315820+0000","last_unstale":"2023-06-08T03:50:05.305523+0000","last_undegraded":"2023-06-08T03:50:05.305523+0000","last_fullsized":"2023-06-08T03:50:05.305523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:28:39.317938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550340+0000","last_change":"2023-06-08T03:50:04.314297+0000","last_active":"2023-06-08T03:50:05.550340+0000","last_peered":"2023-06-08T03:50:05.550340+0000","last_clean":"2023-06-08T03:50:05.550340+0000","last_became_active":"2023-06-08T03:50:04.314004+0000","last_became_peered":"2023-06-08T03:50:04.314004+0000","last_unstale":"2023-06-08T03:50:05.550340+0000","last_undegraded":"2023-06-08T03:50:05.550340+0000","last_fullsized":"2023-06-08T03:50:05.550340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:08:06.226028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538507+0000","last_change":"2023-06-08T03:50:04.319290+0000","last_active":"2023-06-08T03:50:05.538507+0000","last_peered":"2023-06-08T03:50:05.538507+0000","last_clean":"2023-06-08T03:50:05.538507+0000","last_became_active":"2023-06-08T03:50:04.319037+0000","last_became_peered":"2023-06-08T03:50:04.319037+0000","last_unstale":"2023-06-08T03:50:05.538507+0000","last_undegraded":"2023-06-08T03:50:05.538507+0000","last_fullsized":"2023-06-08T03:50:05.538507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:49:15.193372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301307+0000","last_change":"2023-06-08T03:50:04.300153+0000","last_active":"2023-06-08T03:50:05.301307+0000","last_peered":"2023-06-08T03:50:05.301307+0000","last_clean":"2023-06-08T03:50:05.301307+0000","last_became_active":"2023-06-08T03:50:04.299876+0000","last_became_peered":"2023-06-08T03:50:04.299876+0000","last_unstale":"2023-06-08T03:50:05.301307+0000","last_undegraded":"2023-06-08T03:50:05.301307+0000","last_fullsized":"2023-06-08T03:50:05.301307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:59:39.129237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549777+0000","last_change":"2023-06-08T03:50:04.308976+0000","last_active":"2023-06-08T03:50:05.549777+0000","last_peered":"2023-06-08T03:50:05.549777+0000","last_clean":"2023-06-08T03:50:05.549777+0000","last_became_active":"2023-06-08T03:50:04.308725+0000","last_became_peered":"2023-06-08T03:50:04.308725+0000","last_unstale":"2023-06-08T03:50:05.549777+0000","last_undegraded":"2023-06-08T03:50:05.549777+0000","last_fullsized":"2023-06-08T03:50:05.549777+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:41:10.729970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550713+0000","last_change":"2023-06-08T03:50:04.319715+0000","last_active":"2023-06-08T03:50:05.550713+0000","last_peered":"2023-06-08T03:50:05.550713+0000","last_clean":"2023-06-08T03:50:05.550713+0000","last_became_active":"2023-06-08T03:50:04.319257+0000","last_became_peered":"2023-06-08T03:50:04.319257+0000","last_unstale":"2023-06-08T03:50:05.550713+0000","last_undegraded":"2023-06-08T03:50:05.550713+0000","last_fullsized":"2023-06-08T03:50:05.550713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:46:52.574724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549931+0000","last_change":"2023-06-08T03:50:04.318625+0000","last_active":"2023-06-08T03:50:05.549931+0000","last_peered":"2023-06-08T03:50:05.549931+0000","last_clean":"2023-06-08T03:50:05.549931+0000","last_became_active":"2023-06-08T03:50:04.318358+0000","last_became_peered":"2023-06-08T03:50:04.318358+0000","last_unstale":"2023-06-08T03:50:05.549931+0000","last_undegraded":"2023-06-08T03:50:05.549931+0000","last_fullsized":"2023-06-08T03:50:05.549931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:33:01.199263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550839+0000","last_change":"2023-06-08T03:50:04.315189+0000","last_active":"2023-06-08T03:50:05.550839+0000","last_peered":"2023-06-08T03:50:05.550839+0000","last_clean":"2023-06-08T03:50:05.550839+0000","last_became_active":"2023-06-08T03:50:04.314896+0000","last_became_peered":"2023-06-08T03:50:04.314896+0000","last_unstale":"2023-06-08T03:50:05.550839+0000","last_undegraded":"2023-06-08T03:50:05.550839+0000","last_fullsized":"2023-06-08T03:50:05.550839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:02:54.591447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538555+0000","last_change":"2023-06-08T03:50:04.321827+0000","last_active":"2023-06-08T03:50:05.538555+0000","last_peered":"2023-06-08T03:50:05.538555+0000","last_clean":"2023-06-08T03:50:05.538555+0000","last_became_active":"2023-06-08T03:50:04.321564+0000","last_became_peered":"2023-06-08T03:50:04.321564+0000","last_unstale":"2023-06-08T03:50:05.538555+0000","last_undegraded":"2023-06-08T03:50:05.538555+0000","last_fullsized":"2023-06-08T03:50:05.538555+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:48:12.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305634+0000","last_change":"2023-06-08T03:50:04.311268+0000","last_active":"2023-06-08T03:50:05.305634+0000","last_peered":"2023-06-08T03:50:05.305634+0000","last_clean":"2023-06-08T03:50:05.305634+0000","last_became_active":"2023-06-08T03:50:04.310963+0000","last_became_peered":"2023-06-08T03:50:04.310963+0000","last_unstale":"2023-06-08T03:50:05.305634+0000","last_undegraded":"2023-06-08T03:50:05.305634+0000","last_fullsized":"2023-06-08T03:50:05.305634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:17:49.149469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451825+0000","last_change":"2023-06-08T03:50:04.311364+0000","last_active":"2023-06-08T03:50:05.451825+0000","last_peered":"2023-06-08T03:50:05.451825+0000","last_clean":"2023-06-08T03:50:05.451825+0000","last_became_active":"2023-06-08T03:50:04.311075+0000","last_became_peered":"2023-06-08T03:50:04.311075+0000","last_unstale":"2023-06-08T03:50:05.451825+0000","last_undegraded":"2023-06-08T03:50:05.451825+0000","last_fullsized":"2023-06-08T03:50:05.451825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:40:26.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550546+0000","last_change":"2023-06-08T03:50:04.316544+0000","last_active":"2023-06-08T03:50:05.550546+0000","last_peered":"2023-06-08T03:50:05.550546+0000","last_clean":"2023-06-08T03:50:05.550546+0000","last_became_active":"2023-06-08T03:50:04.316289+0000","last_became_peered":"2023-06-08T03:50:04.316289+0000","last_unstale":"2023-06-08T03:50:05.550546+0000","last_undegraded":"2023-06-08T03:50:05.550546+0000","last_fullsized":"2023-06-08T03:50:05.550546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:39:35.102600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305415+0000","last_change":"2023-06-08T03:50:04.319369+0000","last_active":"2023-06-08T03:50:05.305415+0000","last_peered":"2023-06-08T03:50:05.305415+0000","last_clean":"2023-06-08T03:50:05.305415+0000","last_became_active":"2023-06-08T03:50:04.319055+0000","last_became_peered":"2023-06-08T03:50:04.319055+0000","last_unstale":"2023-06-08T03:50:05.305415+0000","last_undegraded":"2023-06-08T03:50:05.305415+0000","last_fullsized":"2023-06-08T03:50:05.305415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:12:15.222250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301331+0000","last_change":"2023-06-08T03:50:04.310535+0000","last_active":"2023-06-08T03:50:05.301331+0000","last_peered":"2023-06-08T03:50:05.301331+0000","last_clean":"2023-06-08T03:50:05.301331+0000","last_became_active":"2023-06-08T03:50:04.310267+0000","last_became_peered":"2023-06-08T03:50:04.310267+0000","last_unstale":"2023-06-08T03:50:05.301331+0000","last_undegraded":"2023-06-08T03:50:05.301331+0000","last_fullsized":"2023-06-08T03:50:05.301331+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:51:56.664299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538415+0000","last_change":"2023-06-08T03:50:04.318440+0000","last_active":"2023-06-08T03:50:05.538415+0000","last_peered":"2023-06-08T03:50:05.538415+0000","last_clean":"2023-06-08T03:50:05.538415+0000","last_became_active":"2023-06-08T03:50:04.318162+0000","last_became_peered":"2023-06-08T03:50:04.318162+0000","last_unstale":"2023-06-08T03:50:05.538415+0000","last_undegraded":"2023-06-08T03:50:05.538415+0000","last_fullsized":"2023-06-08T03:50:05.538415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:22.021336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.306294+0000","last_change":"2023-06-08T03:50:04.321589+0000","last_active":"2023-06-08T03:50:05.306294+0000","last_peered":"2023-06-08T03:50:05.306294+0000","last_clean":"2023-06-08T03:50:05.306294+0000","last_became_active":"2023-06-08T03:50:04.321304+0000","last_became_peered":"2023-06-08T03:50:04.321304+0000","last_unstale":"2023-06-08T03:50:05.306294+0000","last_undegraded":"2023-06-08T03:50:05.306294+0000","last_fullsized":"2023-06-08T03:50:05.306294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:01:51.690260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301953+0000","last_change":"2023-06-08T03:50:03.889190+0000","last_active":"2023-06-08T03:50:05.301953+0000","last_peered":"2023-06-08T03:50:05.301953+0000","last_clean":"2023-06-08T03:50:05.301953+0000","last_became_active":"2023-06-08T03:50:03.888920+0000","last_became_peered":"2023-06-08T03:50:03.888920+0000","last_unstale":"2023-06-08T03:50:05.301953+0000","last_undegraded":"2023-06-08T03:50:05.301953+0000","last_fullsized":"2023-06-08T03:50:05.301953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:45:01.530067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550598+0000","last_change":"2023-06-08T03:50:04.310428+0000","last_active":"2023-06-08T03:50:05.550598+0000","last_peered":"2023-06-08T03:50:05.550598+0000","last_clean":"2023-06-08T03:50:05.550598+0000","last_became_active":"2023-06-08T03:50:04.309904+0000","last_became_peered":"2023-06-08T03:50:04.309904+0000","last_unstale":"2023-06-08T03:50:05.550598+0000","last_undegraded":"2023-06-08T03:50:05.550598+0000","last_fullsized":"2023-06-08T03:50:05.550598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:41:17.069906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305820+0000","last_change":"2023-06-08T03:50:03.882248+0000","last_active":"2023-06-08T03:50:05.305820+0000","last_peered":"2023-06-08T03:50:05.305820+0000","last_clean":"2023-06-08T03:50:05.305820+0000","last_became_active":"2023-06-08T03:50:03.881982+0000","last_became_peered":"2023-06-08T03:50:03.881982+0000","last_unstale":"2023-06-08T03:50:05.305820+0000","last_undegraded":"2023-06-08T03:50:05.305820+0000","last_fullsized":"2023-06-08T03:50:05.305820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:01:12.024114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451960+0000","last_change":"2023-06-08T03:50:04.311827+0000","last_active":"2023-06-08T03:50:05.451960+0000","last_peered":"2023-06-08T03:50:05.451960+0000","last_clean":"2023-06-08T03:50:05.451960+0000","last_became_active":"2023-06-08T03:50:04.311318+0000","last_became_peered":"2023-06-08T03:50:04.311318+0000","last_unstale":"2023-06-08T03:50:05.451960+0000","last_undegraded":"2023-06-08T03:50:05.451960+0000","last_fullsized":"2023-06-08T03:50:05.451960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:14:22.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.306197+0000","last_change":"2023-06-08T03:50:03.888231+0000","last_active":"2023-06-08T03:50:05.306197+0000","last_peered":"2023-06-08T03:50:05.306197+0000","last_clean":"2023-06-08T03:50:05.306197+0000","last_became_active":"2023-06-08T03:50:03.887862+0000","last_became_peered":"2023-06-08T03:50:03.887862+0000","last_unstale":"2023-06-08T03:50:05.306197+0000","last_undegraded":"2023-06-08T03:50:05.306197+0000","last_fullsized":"2023-06-08T03:50:05.306197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:36:14.483421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.306099+0000","last_change":"2023-06-08T03:50:04.315347+0000","last_active":"2023-06-08T03:50:05.306099+0000","last_peered":"2023-06-08T03:50:05.306099+0000","last_clean":"2023-06-08T03:50:05.306099+0000","last_became_active":"2023-06-08T03:50:04.314513+0000","last_became_peered":"2023-06-08T03:50:04.314513+0000","last_unstale":"2023-06-08T03:50:05.306099+0000","last_undegraded":"2023-06-08T03:50:05.306099+0000","last_fullsized":"2023-06-08T03:50:05.306099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:53:53.638707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550353+0000","last_change":"2023-06-08T03:50:03.885323+0000","last_active":"2023-06-08T03:50:05.550353+0000","last_peered":"2023-06-08T03:50:05.550353+0000","last_clean":"2023-06-08T03:50:05.550353+0000","last_became_active":"2023-06-08T03:50:03.885045+0000","last_became_peered":"2023-06-08T03:50:03.885045+0000","last_unstale":"2023-06-08T03:50:05.550353+0000","last_undegraded":"2023-06-08T03:50:05.550353+0000","last_fullsized":"2023-06-08T03:50:05.550353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:59:45.986168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305597+0000","last_change":"2023-06-08T03:50:04.308097+0000","last_active":"2023-06-08T03:50:05.305597+0000","last_peered":"2023-06-08T03:50:05.305597+0000","last_clean":"2023-06-08T03:50:05.305597+0000","last_became_active":"2023-06-08T03:50:04.307841+0000","last_became_peered":"2023-06-08T03:50:04.307841+0000","last_unstale":"2023-06-08T03:50:05.305597+0000","last_undegraded":"2023-06-08T03:50:05.305597+0000","last_fullsized":"2023-06-08T03:50:05.305597+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:13:07.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301575+0000","last_change":"2023-06-08T03:50:03.884711+0000","last_active":"2023-06-08T03:50:05.301575+0000","last_peered":"2023-06-08T03:50:05.301575+0000","last_clean":"2023-06-08T03:50:05.301575+0000","last_became_active":"2023-06-08T03:50:03.883316+0000","last_became_peered":"2023-06-08T03:50:03.883316+0000","last_unstale":"2023-06-08T03:50:05.301575+0000","last_undegraded":"2023-06-08T03:50:05.301575+0000","last_fullsized":"2023-06-08T03:50:05.301575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:47:28.600080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550150+0000","last_change":"2023-06-08T03:50:04.311227+0000","last_active":"2023-06-08T03:50:05.550150+0000","last_peered":"2023-06-08T03:50:05.550150+0000","last_clean":"2023-06-08T03:50:05.550150+0000","last_became_active":"2023-06-08T03:50:04.310713+0000","last_became_peered":"2023-06-08T03:50:04.310713+0000","last_unstale":"2023-06-08T03:50:05.550150+0000","last_undegraded":"2023-06-08T03:50:05.550150+0000","last_fullsized":"2023-06-08T03:50:05.550150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:22:40.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305707+0000","last_change":"2023-06-08T03:50:03.885932+0000","last_active":"2023-06-08T03:50:05.305707+0000","last_peered":"2023-06-08T03:50:05.305707+0000","last_clean":"2023-06-08T03:50:05.305707+0000","last_became_active":"2023-06-08T03:50:03.885681+0000","last_became_peered":"2023-06-08T03:50:03.885681+0000","last_unstale":"2023-06-08T03:50:05.305707+0000","last_undegraded":"2023-06-08T03:50:05.305707+0000","last_fullsized":"2023-06-08T03:50:05.305707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:39:59.338306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549937+0000","last_change":"2023-06-08T03:50:04.311464+0000","last_active":"2023-06-08T03:50:05.549937+0000","last_peered":"2023-06-08T03:50:05.549937+0000","last_clean":"2023-06-08T03:50:05.549937+0000","last_became_active":"2023-06-08T03:50:04.311052+0000","last_became_peered":"2023-06-08T03:50:04.311052+0000","last_unstale":"2023-06-08T03:50:05.549937+0000","last_undegraded":"2023-06-08T03:50:05.549937+0000","last_fullsized":"2023-06-08T03:50:05.549937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:18:01.054351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451613+0000","last_change":"2023-06-08T03:50:03.887671+0000","last_active":"2023-06-08T03:50:05.451613+0000","last_peered":"2023-06-08T03:50:05.451613+0000","last_clean":"2023-06-08T03:50:05.451613+0000","last_became_active":"2023-06-08T03:50:03.887356+0000","last_became_peered":"2023-06-08T03:50:03.887356+0000","last_unstale":"2023-06-08T03:50:05.451613+0000","last_undegraded":"2023-06-08T03:50:05.451613+0000","last_fullsized":"2023-06-08T03:50:05.451613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:43:39.377798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550874+0000","last_change":"2023-06-08T03:50:04.320152+0000","last_active":"2023-06-08T03:50:05.550874+0000","last_peered":"2023-06-08T03:50:05.550874+0000","last_clean":"2023-06-08T03:50:05.550874+0000","last_became_active":"2023-06-08T03:50:04.319851+0000","last_became_peered":"2023-06-08T03:50:04.319851+0000","last_unstale":"2023-06-08T03:50:05.550874+0000","last_undegraded":"2023-06-08T03:50:05.550874+0000","last_fullsized":"2023-06-08T03:50:05.550874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:36:29.319760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549777+0000","last_change":"2023-06-08T03:50:03.886937+0000","last_active":"2023-06-08T03:50:05.549777+0000","last_peered":"2023-06-08T03:50:05.549777+0000","last_clean":"2023-06-08T03:50:05.549777+0000","last_became_active":"2023-06-08T03:50:03.886653+0000","last_became_peered":"2023-06-08T03:50:03.886653+0000","last_unstale":"2023-06-08T03:50:05.549777+0000","last_undegraded":"2023-06-08T03:50:05.549777+0000","last_fullsized":"2023-06-08T03:50:05.549777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:03:12.069492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305716+0000","last_change":"2023-06-08T03:50:04.320741+0000","last_active":"2023-06-08T03:50:05.305716+0000","last_peered":"2023-06-08T03:50:05.305716+0000","last_clean":"2023-06-08T03:50:05.305716+0000","last_became_active":"2023-06-08T03:50:04.320473+0000","last_became_peered":"2023-06-08T03:50:04.320473+0000","last_unstale":"2023-06-08T03:50:05.305716+0000","last_undegraded":"2023-06-08T03:50:05.305716+0000","last_fullsized":"2023-06-08T03:50:05.305716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:57:21.728222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305850+0000","last_change":"2023-06-08T03:50:03.880743+0000","last_active":"2023-06-08T03:50:05.305850+0000","last_peered":"2023-06-08T03:50:05.305850+0000","last_clean":"2023-06-08T03:50:05.305850+0000","last_became_active":"2023-06-08T03:50:03.880473+0000","last_became_peered":"2023-06-08T03:50:03.880473+0000","last_unstale":"2023-06-08T03:50:05.305850+0000","last_undegraded":"2023-06-08T03:50:05.305850+0000","last_fullsized":"2023-06-08T03:50:05.305850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:48:46.879617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.551040+0000","last_change":"2023-06-08T03:50:04.318395+0000","last_active":"2023-06-08T03:50:05.551040+0000","last_peered":"2023-06-08T03:50:05.551040+0000","last_clean":"2023-06-08T03:50:05.551040+0000","last_became_active":"2023-06-08T03:50:04.318105+0000","last_became_peered":"2023-06-08T03:50:04.318105+0000","last_unstale":"2023-06-08T03:50:05.551040+0000","last_undegraded":"2023-06-08T03:50:05.551040+0000","last_fullsized":"2023-06-08T03:50:05.551040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:50:56.489500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550021+0000","last_change":"2023-06-08T03:50:03.876936+0000","last_active":"2023-06-08T03:50:05.550021+0000","last_peered":"2023-06-08T03:50:05.550021+0000","last_clean":"2023-06-08T03:50:05.550021+0000","last_became_active":"2023-06-08T03:50:03.876659+0000","last_became_peered":"2023-06-08T03:50:03.876659+0000","last_unstale":"2023-06-08T03:50:05.550021+0000","last_undegraded":"2023-06-08T03:50:05.550021+0000","last_fullsized":"2023-06-08T03:50:05.550021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:54:32.337200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301263+0000","last_change":"2023-06-08T03:50:04.311544+0000","last_active":"2023-06-08T03:50:05.301263+0000","last_peered":"2023-06-08T03:50:05.301263+0000","last_clean":"2023-06-08T03:50:05.301263+0000","last_became_active":"2023-06-08T03:50:04.311270+0000","last_became_peered":"2023-06-08T03:50:04.311270+0000","last_unstale":"2023-06-08T03:50:05.301263+0000","last_undegraded":"2023-06-08T03:50:05.301263+0000","last_fullsized":"2023-06-08T03:50:05.301263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:14:22.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550709+0000","last_change":"2023-06-08T03:50:03.878921+0000","last_active":"2023-06-08T03:50:05.550709+0000","last_peered":"2023-06-08T03:50:05.550709+0000","last_clean":"2023-06-08T03:50:05.550709+0000","last_became_active":"2023-06-08T03:50:03.878442+0000","last_became_peered":"2023-06-08T03:50:03.878442+0000","last_unstale":"2023-06-08T03:50:05.550709+0000","last_undegraded":"2023-06-08T03:50:05.550709+0000","last_fullsized":"2023-06-08T03:50:05.550709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:35:34.620099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550578+0000","last_change":"2023-06-08T03:50:04.317113+0000","last_active":"2023-06-08T03:50:05.550578+0000","last_peered":"2023-06-08T03:50:05.550578+0000","last_clean":"2023-06-08T03:50:05.550578+0000","last_became_active":"2023-06-08T03:50:04.315872+0000","last_became_peered":"2023-06-08T03:50:04.315872+0000","last_unstale":"2023-06-08T03:50:05.550578+0000","last_undegraded":"2023-06-08T03:50:05.550578+0000","last_fullsized":"2023-06-08T03:50:05.550578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:25:59.502061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538567+0000","last_change":"2023-06-08T03:50:03.880936+0000","last_active":"2023-06-08T03:50:05.538567+0000","last_peered":"2023-06-08T03:50:05.538567+0000","last_clean":"2023-06-08T03:50:05.538567+0000","last_became_active":"2023-06-08T03:50:03.880497+0000","last_became_peered":"2023-06-08T03:50:03.880497+0000","last_unstale":"2023-06-08T03:50:05.538567+0000","last_undegraded":"2023-06-08T03:50:05.538567+0000","last_fullsized":"2023-06-08T03:50:05.538567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T03:56:14.233058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550148+0000","last_change":"2023-06-08T03:50:04.315117+0000","last_active":"2023-06-08T03:50:05.550148+0000","last_peered":"2023-06-08T03:50:05.550148+0000","last_clean":"2023-06-08T03:50:05.550148+0000","last_became_active":"2023-06-08T03:50:04.314843+0000","last_became_peered":"2023-06-08T03:50:04.314843+0000","last_unstale":"2023-06-08T03:50:05.550148+0000","last_undegraded":"2023-06-08T03:50:05.550148+0000","last_fullsized":"2023-06-08T03:50:05.550148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:12:06.202970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301416+0000","last_change":"2023-06-08T03:50:03.884316+0000","last_active":"2023-06-08T03:50:05.301416+0000","last_peered":"2023-06-08T03:50:05.301416+0000","last_clean":"2023-06-08T03:50:05.301416+0000","last_became_active":"2023-06-08T03:50:03.884048+0000","last_became_peered":"2023-06-08T03:50:03.884048+0000","last_unstale":"2023-06-08T03:50:05.301416+0000","last_undegraded":"2023-06-08T03:50:05.301416+0000","last_fullsized":"2023-06-08T03:50:05.301416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:22:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549889+0000","last_change":"2023-06-08T03:50:04.317380+0000","last_active":"2023-06-08T03:50:05.549889+0000","last_peered":"2023-06-08T03:50:05.549889+0000","last_clean":"2023-06-08T03:50:05.549889+0000","last_became_active":"2023-06-08T03:50:04.314482+0000","last_became_peered":"2023-06-08T03:50:04.314482+0000","last_unstale":"2023-06-08T03:50:05.549889+0000","last_undegraded":"2023-06-08T03:50:05.549889+0000","last_fullsized":"2023-06-08T03:50:05.549889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:28:37.647653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550219+0000","last_change":"2023-06-08T03:50:03.880451+0000","last_active":"2023-06-08T03:50:05.550219+0000","last_peered":"2023-06-08T03:50:05.550219+0000","last_clean":"2023-06-08T03:50:05.550219+0000","last_became_active":"2023-06-08T03:50:03.880179+0000","last_became_peered":"2023-06-08T03:50:03.880179+0000","last_unstale":"2023-06-08T03:50:05.550219+0000","last_undegraded":"2023-06-08T03:50:05.550219+0000","last_fullsized":"2023-06-08T03:50:05.550219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:59:36.792416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302256+0000","last_change":"2023-06-08T03:50:04.312827+0000","last_active":"2023-06-08T03:50:05.302256+0000","last_peered":"2023-06-08T03:50:05.302256+0000","last_clean":"2023-06-08T03:50:05.302256+0000","last_became_active":"2023-06-08T03:50:04.312528+0000","last_became_peered":"2023-06-08T03:50:04.312528+0000","last_unstale":"2023-06-08T03:50:05.302256+0000","last_undegraded":"2023-06-08T03:50:05.302256+0000","last_fullsized":"2023-06-08T03:50:05.302256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:59:46.988245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301522+0000","last_change":"2023-06-08T03:50:03.883994+0000","last_active":"2023-06-08T03:50:05.301522+0000","last_peered":"2023-06-08T03:50:05.301522+0000","last_clean":"2023-06-08T03:50:05.301522+0000","last_became_active":"2023-06-08T03:50:03.883726+0000","last_became_peered":"2023-06-08T03:50:03.883726+0000","last_unstale":"2023-06-08T03:50:05.301522+0000","last_undegraded":"2023-06-08T03:50:05.301522+0000","last_fullsized":"2023-06-08T03:50:05.301522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:40:39.111333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550539+0000","last_change":"2023-06-08T03:50:04.318397+0000","last_active":"2023-06-08T03:50:05.550539+0000","last_peered":"2023-06-08T03:50:05.550539+0000","last_clean":"2023-06-08T03:50:05.550539+0000","last_became_active":"2023-06-08T03:50:04.317903+0000","last_became_peered":"2023-06-08T03:50:04.317903+0000","last_unstale":"2023-06-08T03:50:05.550539+0000","last_undegraded":"2023-06-08T03:50:05.550539+0000","last_fullsized":"2023-06-08T03:50:05.550539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:04:16.466173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549948+0000","last_change":"2023-06-08T03:50:03.885850+0000","last_active":"2023-06-08T03:50:05.549948+0000","last_peered":"2023-06-08T03:50:05.549948+0000","last_clean":"2023-06-08T03:50:05.549948+0000","last_became_active":"2023-06-08T03:50:03.885548+0000","last_became_peered":"2023-06-08T03:50:03.885548+0000","last_unstale":"2023-06-08T03:50:05.549948+0000","last_undegraded":"2023-06-08T03:50:05.549948+0000","last_fullsized":"2023-06-08T03:50:05.549948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:30:50.782351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538633+0000","last_change":"2023-06-08T03:50:04.310276+0000","last_active":"2023-06-08T03:50:05.538633+0000","last_peered":"2023-06-08T03:50:05.538633+0000","last_clean":"2023-06-08T03:50:05.538633+0000","last_became_active":"2023-06-08T03:50:04.310003+0000","last_became_peered":"2023-06-08T03:50:04.310003+0000","last_unstale":"2023-06-08T03:50:05.538633+0000","last_undegraded":"2023-06-08T03:50:05.538633+0000","last_fullsized":"2023-06-08T03:50:05.538633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:05:31.737888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538557+0000","last_change":"2023-06-08T03:50:03.881684+0000","last_active":"2023-06-08T03:50:05.538557+0000","last_peered":"2023-06-08T03:50:05.538557+0000","last_clean":"2023-06-08T03:50:05.538557+0000","last_became_active":"2023-06-08T03:50:03.881392+0000","last_became_peered":"2023-06-08T03:50:03.881392+0000","last_unstale":"2023-06-08T03:50:05.538557+0000","last_undegraded":"2023-06-08T03:50:05.538557+0000","last_fullsized":"2023-06-08T03:50:05.538557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:24:43.007580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549981+0000","last_change":"2023-06-08T03:50:04.317966+0000","last_active":"2023-06-08T03:50:05.549981+0000","last_peered":"2023-06-08T03:50:05.549981+0000","last_clean":"2023-06-08T03:50:05.549981+0000","last_became_active":"2023-06-08T03:50:04.317706+0000","last_became_peered":"2023-06-08T03:50:04.317706+0000","last_unstale":"2023-06-08T03:50:05.549981+0000","last_undegraded":"2023-06-08T03:50:05.549981+0000","last_fullsized":"2023-06-08T03:50:05.549981+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:51:14.993458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305694+0000","last_change":"2023-06-08T03:50:03.887811+0000","last_active":"2023-06-08T03:50:05.305694+0000","last_peered":"2023-06-08T03:50:05.305694+0000","last_clean":"2023-06-08T03:50:05.305694+0000","last_became_active":"2023-06-08T03:50:03.887277+0000","last_became_peered":"2023-06-08T03:50:03.887277+0000","last_unstale":"2023-06-08T03:50:05.305694+0000","last_undegraded":"2023-06-08T03:50:05.305694+0000","last_fullsized":"2023-06-08T03:50:05.305694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:53:23.803343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550498+0000","last_change":"2023-06-08T03:50:04.306795+0000","last_active":"2023-06-08T03:50:05.550498+0000","last_peered":"2023-06-08T03:50:05.550498+0000","last_clean":"2023-06-08T03:50:05.550498+0000","last_became_active":"2023-06-08T03:50:04.306477+0000","last_became_peered":"2023-06-08T03:50:04.306477+0000","last_unstale":"2023-06-08T03:50:05.550498+0000","last_undegraded":"2023-06-08T03:50:05.550498+0000","last_fullsized":"2023-06-08T03:50:05.550498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:51:33.942083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451909+0000","last_change":"2023-06-08T03:50:03.887660+0000","last_active":"2023-06-08T03:50:05.451909+0000","last_peered":"2023-06-08T03:50:05.451909+0000","last_clean":"2023-06-08T03:50:05.451909+0000","last_became_active":"2023-06-08T03:50:03.887342+0000","last_became_peered":"2023-06-08T03:50:03.887342+0000","last_unstale":"2023-06-08T03:50:05.451909+0000","last_undegraded":"2023-06-08T03:50:05.451909+0000","last_fullsized":"2023-06-08T03:50:05.451909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:59:38.127160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550635+0000","last_change":"2023-06-08T03:50:04.316814+0000","last_active":"2023-06-08T03:50:05.550635+0000","last_peered":"2023-06-08T03:50:05.550635+0000","last_clean":"2023-06-08T03:50:05.550635+0000","last_became_active":"2023-06-08T03:50:04.316525+0000","last_became_peered":"2023-06-08T03:50:04.316525+0000","last_unstale":"2023-06-08T03:50:05.550635+0000","last_undegraded":"2023-06-08T03:50:05.550635+0000","last_fullsized":"2023-06-08T03:50:05.550635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:39:27.268069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301445+0000","last_change":"2023-06-08T03:50:03.877732+0000","last_active":"2023-06-08T03:50:05.301445+0000","last_peered":"2023-06-08T03:50:05.301445+0000","last_clean":"2023-06-08T03:50:05.301445+0000","last_became_active":"2023-06-08T03:50:03.877442+0000","last_became_peered":"2023-06-08T03:50:03.877442+0000","last_unstale":"2023-06-08T03:50:05.301445+0000","last_undegraded":"2023-06-08T03:50:05.301445+0000","last_fullsized":"2023-06-08T03:50:05.301445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:27.083847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302210+0000","last_change":"2023-06-08T03:50:04.312282+0000","last_active":"2023-06-08T03:50:05.302210+0000","last_peered":"2023-06-08T03:50:05.302210+0000","last_clean":"2023-06-08T03:50:05.302210+0000","last_became_active":"2023-06-08T03:50:04.312038+0000","last_became_peered":"2023-06-08T03:50:04.312038+0000","last_unstale":"2023-06-08T03:50:05.302210+0000","last_undegraded":"2023-06-08T03:50:05.302210+0000","last_fullsized":"2023-06-08T03:50:05.302210+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:59:37.794493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301428+0000","last_change":"2023-06-08T03:50:03.876943+0000","last_active":"2023-06-08T03:50:05.301428+0000","last_peered":"2023-06-08T03:50:05.301428+0000","last_clean":"2023-06-08T03:50:05.301428+0000","last_became_active":"2023-06-08T03:50:03.876602+0000","last_became_peered":"2023-06-08T03:50:03.876602+0000","last_unstale":"2023-06-08T03:50:05.301428+0000","last_undegraded":"2023-06-08T03:50:05.301428+0000","last_fullsized":"2023-06-08T03:50:05.301428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:27:29.901155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305989+0000","last_change":"2023-06-08T03:50:04.314691+0000","last_active":"2023-06-08T03:50:05.305989+0000","last_peered":"2023-06-08T03:50:05.305989+0000","last_clean":"2023-06-08T03:50:05.305989+0000","last_became_active":"2023-06-08T03:50:04.314366+0000","last_became_peered":"2023-06-08T03:50:04.314366+0000","last_unstale":"2023-06-08T03:50:05.305989+0000","last_undegraded":"2023-06-08T03:50:05.305989+0000","last_fullsized":"2023-06-08T03:50:05.305989+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:16:53.539487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451635+0000","last_change":"2023-06-08T03:50:03.885035+0000","last_active":"2023-06-08T03:50:05.451635+0000","last_peered":"2023-06-08T03:50:05.451635+0000","last_clean":"2023-06-08T03:50:05.451635+0000","last_became_active":"2023-06-08T03:50:03.884774+0000","last_became_peered":"2023-06-08T03:50:03.884774+0000","last_unstale":"2023-06-08T03:50:05.451635+0000","last_undegraded":"2023-06-08T03:50:05.451635+0000","last_fullsized":"2023-06-08T03:50:05.451635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:37:19.829154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.538545+0000","last_change":"2023-06-08T03:50:04.320011+0000","last_active":"2023-06-08T03:50:05.538545+0000","last_peered":"2023-06-08T03:50:05.538545+0000","last_clean":"2023-06-08T03:50:05.538545+0000","last_became_active":"2023-06-08T03:50:04.319740+0000","last_became_peered":"2023-06-08T03:50:04.319740+0000","last_unstale":"2023-06-08T03:50:05.538545+0000","last_undegraded":"2023-06-08T03:50:05.538545+0000","last_fullsized":"2023-06-08T03:50:05.538545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:30:41.491320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549465+0000","last_change":"2023-06-08T03:50:03.877730+0000","last_active":"2023-06-08T03:50:05.549465+0000","last_peered":"2023-06-08T03:50:05.549465+0000","last_clean":"2023-06-08T03:50:05.549465+0000","last_became_active":"2023-06-08T03:50:03.877442+0000","last_became_peered":"2023-06-08T03:50:03.877442+0000","last_unstale":"2023-06-08T03:50:05.549465+0000","last_undegraded":"2023-06-08T03:50:05.549465+0000","last_fullsized":"2023-06-08T03:50:05.549465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:30:31.608233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549595+0000","last_change":"2023-06-08T03:50:04.315095+0000","last_active":"2023-06-08T03:50:05.549595+0000","last_peered":"2023-06-08T03:50:05.549595+0000","last_clean":"2023-06-08T03:50:05.549595+0000","last_became_active":"2023-06-08T03:50:04.314840+0000","last_became_peered":"2023-06-08T03:50:04.314840+0000","last_unstale":"2023-06-08T03:50:05.549595+0000","last_undegraded":"2023-06-08T03:50:05.549595+0000","last_fullsized":"2023-06-08T03:50:05.549595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:12:29.831307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549781+0000","last_change":"2023-06-08T03:50:03.880493+0000","last_active":"2023-06-08T03:50:05.549781+0000","last_peered":"2023-06-08T03:50:05.549781+0000","last_clean":"2023-06-08T03:50:05.549781+0000","last_became_active":"2023-06-08T03:50:03.880166+0000","last_became_peered":"2023-06-08T03:50:03.880166+0000","last_unstale":"2023-06-08T03:50:05.549781+0000","last_undegraded":"2023-06-08T03:50:05.549781+0000","last_fullsized":"2023-06-08T03:50:05.549781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:51:00.870150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301348+0000","last_change":"2023-06-08T03:50:04.313838+0000","last_active":"2023-06-08T03:50:05.301348+0000","last_peered":"2023-06-08T03:50:05.301348+0000","last_clean":"2023-06-08T03:50:05.301348+0000","last_became_active":"2023-06-08T03:50:04.313152+0000","last_became_peered":"2023-06-08T03:50:04.313152+0000","last_unstale":"2023-06-08T03:50:05.301348+0000","last_undegraded":"2023-06-08T03:50:05.301348+0000","last_fullsized":"2023-06-08T03:50:05.301348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:36:24.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305546+0000","last_change":"2023-06-08T03:50:03.883840+0000","last_active":"2023-06-08T03:50:05.305546+0000","last_peered":"2023-06-08T03:50:05.305546+0000","last_clean":"2023-06-08T03:50:05.305546+0000","last_became_active":"2023-06-08T03:50:03.883408+0000","last_became_peered":"2023-06-08T03:50:03.883408+0000","last_unstale":"2023-06-08T03:50:05.305546+0000","last_undegraded":"2023-06-08T03:50:05.305546+0000","last_fullsized":"2023-06-08T03:50:05.305546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:18:12.586009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305589+0000","last_change":"2023-06-08T03:48:41.170966+0000","last_active":"2023-06-08T03:50:05.305589+0000","last_peered":"2023-06-08T03:50:05.305589+0000","last_clean":"2023-06-08T03:50:05.305589+0000","last_became_active":"2023-06-08T03:48:41.170701+0000","last_became_peered":"2023-06-08T03:48:41.170701+0000","last_unstale":"2023-06-08T03:50:05.305589+0000","last_undegraded":"2023-06-08T03:50:05.305589+0000","last_fullsized":"2023-06-08T03:50:05.305589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:06:13.293946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.302249+0000","last_change":"2023-06-08T03:50:04.319062+0000","last_active":"2023-06-08T03:50:05.302249+0000","last_peered":"2023-06-08T03:50:05.302249+0000","last_clean":"2023-06-08T03:50:05.302249+0000","last_became_active":"2023-06-08T03:50:04.318783+0000","last_became_peered":"2023-06-08T03:50:04.318783+0000","last_unstale":"2023-06-08T03:50:05.302249+0000","last_undegraded":"2023-06-08T03:50:05.302249+0000","last_fullsized":"2023-06-08T03:50:05.302249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:46:13.664232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550402+0000","last_change":"2023-06-08T03:50:03.878507+0000","last_active":"2023-06-08T03:50:05.550402+0000","last_peered":"2023-06-08T03:50:05.550402+0000","last_clean":"2023-06-08T03:50:05.550402+0000","last_became_active":"2023-06-08T03:50:03.878178+0000","last_became_peered":"2023-06-08T03:50:03.878178+0000","last_unstale":"2023-06-08T03:50:05.550402+0000","last_undegraded":"2023-06-08T03:50:05.550402+0000","last_fullsized":"2023-06-08T03:50:05.550402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:33:49.252611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301579+0000","last_change":"2023-06-08T03:48:41.175222+0000","last_active":"2023-06-08T03:50:05.301579+0000","last_peered":"2023-06-08T03:50:05.301579+0000","last_clean":"2023-06-08T03:50:05.301579+0000","last_became_active":"2023-06-08T03:48:41.174897+0000","last_became_peered":"2023-06-08T03:48:41.174897+0000","last_unstale":"2023-06-08T03:50:05.301579+0000","last_undegraded":"2023-06-08T03:50:05.301579+0000","last_fullsized":"2023-06-08T03:50:05.301579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:49:38.169180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550586+0000","last_change":"2023-06-08T03:50:04.313675+0000","last_active":"2023-06-08T03:50:05.550586+0000","last_peered":"2023-06-08T03:50:05.550586+0000","last_clean":"2023-06-08T03:50:05.550586+0000","last_became_active":"2023-06-08T03:50:04.313292+0000","last_became_peered":"2023-06-08T03:50:04.313292+0000","last_unstale":"2023-06-08T03:50:05.550586+0000","last_undegraded":"2023-06-08T03:50:05.550586+0000","last_fullsized":"2023-06-08T03:50:05.550586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:58:36.044898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305950+0000","last_change":"2023-06-08T03:50:03.885465+0000","last_active":"2023-06-08T03:50:05.305950+0000","last_peered":"2023-06-08T03:50:05.305950+0000","last_clean":"2023-06-08T03:50:05.305950+0000","last_became_active":"2023-06-08T03:50:03.885182+0000","last_became_peered":"2023-06-08T03:50:03.885182+0000","last_unstale":"2023-06-08T03:50:05.305950+0000","last_undegraded":"2023-06-08T03:50:05.305950+0000","last_fullsized":"2023-06-08T03:50:05.305950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:44:39.328383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305992+0000","last_change":"2023-06-08T03:48:41.177890+0000","last_active":"2023-06-08T03:50:05.305992+0000","last_peered":"2023-06-08T03:50:05.305992+0000","last_clean":"2023-06-08T03:50:05.305992+0000","last_became_active":"2023-06-08T03:48:41.177566+0000","last_became_peered":"2023-06-08T03:48:41.177566+0000","last_unstale":"2023-06-08T03:50:05.305992+0000","last_undegraded":"2023-06-08T03:50:05.305992+0000","last_fullsized":"2023-06-08T03:50:05.305992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:55:11.302743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":201,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550020+0000","last_change":"2023-06-08T03:48:41.177479+0000","last_active":"2023-06-08T03:50:05.550020+0000","last_peered":"2023-06-08T03:50:05.550020+0000","last_clean":"2023-06-08T03:50:05.550020+0000","last_became_active":"2023-06-08T03:48:41.177200+0000","last_became_peered":"2023-06-08T03:48:41.177200+0000","last_unstale":"2023-06-08T03:50:05.550020+0000","last_undegraded":"2023-06-08T03:50:05.550020+0000","last_fullsized":"2023-06-08T03:50:05.550020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:43:38.829097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549895+0000","last_change":"2023-06-08T03:50:04.311778+0000","last_active":"2023-06-08T03:50:05.549895+0000","last_peered":"2023-06-08T03:50:05.549895+0000","last_clean":"2023-06-08T03:50:05.549895+0000","last_became_active":"2023-06-08T03:50:04.311481+0000","last_became_peered":"2023-06-08T03:50:04.311481+0000","last_unstale":"2023-06-08T03:50:05.549895+0000","last_undegraded":"2023-06-08T03:50:05.549895+0000","last_fullsized":"2023-06-08T03:50:05.549895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:03:31.153229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550701+0000","last_change":"2023-06-08T03:50:03.879067+0000","last_active":"2023-06-08T03:50:05.550701+0000","last_peered":"2023-06-08T03:50:05.550701+0000","last_clean":"2023-06-08T03:50:05.550701+0000","last_became_active":"2023-06-08T03:50:03.878796+0000","last_became_peered":"2023-06-08T03:50:03.878796+0000","last_unstale":"2023-06-08T03:50:05.550701+0000","last_undegraded":"2023-06-08T03:50:05.550701+0000","last_fullsized":"2023-06-08T03:50:05.550701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:09:06.797807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550271+0000","last_change":"2023-06-08T03:48:41.368941+0000","last_active":"2023-06-08T03:50:05.550271+0000","last_peered":"2023-06-08T03:50:05.550271+0000","last_clean":"2023-06-08T03:50:05.550271+0000","last_became_active":"2023-06-08T03:48:41.368673+0000","last_became_peered":"2023-06-08T03:48:41.368673+0000","last_unstale":"2023-06-08T03:50:05.550271+0000","last_undegraded":"2023-06-08T03:50:05.550271+0000","last_fullsized":"2023-06-08T03:50:05.550271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:44:49.961184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550022+0000","last_change":"2023-06-08T03:50:04.319347+0000","last_active":"2023-06-08T03:50:05.550022+0000","last_peered":"2023-06-08T03:50:05.550022+0000","last_clean":"2023-06-08T03:50:05.550022+0000","last_became_active":"2023-06-08T03:50:04.319070+0000","last_became_peered":"2023-06-08T03:50:04.319070+0000","last_unstale":"2023-06-08T03:50:05.550022+0000","last_undegraded":"2023-06-08T03:50:05.550022+0000","last_fullsized":"2023-06-08T03:50:05.550022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:16:25.568919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.452103+0000","last_change":"2023-06-08T03:50:03.889567+0000","last_active":"2023-06-08T03:50:05.452103+0000","last_peered":"2023-06-08T03:50:05.452103+0000","last_clean":"2023-06-08T03:50:05.452103+0000","last_became_active":"2023-06-08T03:50:03.889230+0000","last_became_peered":"2023-06-08T03:50:03.889230+0000","last_unstale":"2023-06-08T03:50:05.452103+0000","last_undegraded":"2023-06-08T03:50:05.452103+0000","last_fullsized":"2023-06-08T03:50:05.452103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:22:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.549892+0000","last_change":"2023-06-08T03:48:41.368933+0000","last_active":"2023-06-08T03:50:05.549892+0000","last_peered":"2023-06-08T03:50:05.549892+0000","last_clean":"2023-06-08T03:50:05.549892+0000","last_became_active":"2023-06-08T03:48:41.368653+0000","last_became_peered":"2023-06-08T03:48:41.368653+0000","last_unstale":"2023-06-08T03:50:05.549892+0000","last_undegraded":"2023-06-08T03:50:05.549892+0000","last_fullsized":"2023-06-08T03:50:05.549892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:46:05.899110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550671+0000","last_change":"2023-06-08T03:50:04.314883+0000","last_active":"2023-06-08T03:50:05.550671+0000","last_peered":"2023-06-08T03:50:05.550671+0000","last_clean":"2023-06-08T03:50:05.550671+0000","last_became_active":"2023-06-08T03:50:04.314612+0000","last_became_peered":"2023-06-08T03:50:04.314612+0000","last_unstale":"2023-06-08T03:50:05.550671+0000","last_undegraded":"2023-06-08T03:50:05.550671+0000","last_fullsized":"2023-06-08T03:50:05.550671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:48:44.761868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.301539+0000","last_change":"2023-06-08T03:50:03.886787+0000","last_active":"2023-06-08T03:50:05.301539+0000","last_peered":"2023-06-08T03:50:05.301539+0000","last_clean":"2023-06-08T03:50:05.301539+0000","last_became_active":"2023-06-08T03:50:03.886490+0000","last_became_peered":"2023-06-08T03:50:03.886490+0000","last_unstale":"2023-06-08T03:50:05.301539+0000","last_undegraded":"2023-06-08T03:50:05.301539+0000","last_fullsized":"2023-06-08T03:50:05.301539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:34:01.308242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451806+0000","last_change":"2023-06-08T03:48:41.368938+0000","last_active":"2023-06-08T03:50:05.451806+0000","last_peered":"2023-06-08T03:50:05.451806+0000","last_clean":"2023-06-08T03:50:05.451806+0000","last_became_active":"2023-06-08T03:48:41.368634+0000","last_became_peered":"2023-06-08T03:48:41.368634+0000","last_unstale":"2023-06-08T03:50:05.451806+0000","last_undegraded":"2023-06-08T03:50:05.451806+0000","last_fullsized":"2023-06-08T03:50:05.451806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:39:58.820156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.451684+0000","last_change":"2023-06-08T03:50:04.315005+0000","last_active":"2023-06-08T03:50:05.451684+0000","last_peered":"2023-06-08T03:50:05.451684+0000","last_clean":"2023-06-08T03:50:05.451684+0000","last_became_active":"2023-06-08T03:50:04.314739+0000","last_became_peered":"2023-06-08T03:50:04.314739+0000","last_unstale":"2023-06-08T03:50:05.451684+0000","last_undegraded":"2023-06-08T03:50:05.451684+0000","last_fullsized":"2023-06-08T03:50:05.451684+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:03:28.497446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305877+0000","last_change":"2023-06-08T03:50:03.884645+0000","last_active":"2023-06-08T03:50:05.305877+0000","last_peered":"2023-06-08T03:50:05.305877+0000","last_clean":"2023-06-08T03:50:05.305877+0000","last_became_active":"2023-06-08T03:50:03.884324+0000","last_became_peered":"2023-06-08T03:50:03.884324+0000","last_unstale":"2023-06-08T03:50:05.305877+0000","last_undegraded":"2023-06-08T03:50:05.305877+0000","last_fullsized":"2023-06-08T03:50:05.305877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:37:43.814012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550809+0000","last_change":"2023-06-08T03:48:41.369080+0000","last_active":"2023-06-08T03:50:05.550809+0000","last_peered":"2023-06-08T03:50:05.550809+0000","last_clean":"2023-06-08T03:50:05.550809+0000","last_became_active":"2023-06-08T03:48:41.368636+0000","last_became_peered":"2023-06-08T03:48:41.368636+0000","last_unstale":"2023-06-08T03:50:05.550809+0000","last_undegraded":"2023-06-08T03:50:05.550809+0000","last_fullsized":"2023-06-08T03:50:05.550809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:02:53.673536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.305415+0000","last_change":"2023-06-08T03:50:04.305063+0000","last_active":"2023-06-08T03:50:05.305415+0000","last_peered":"2023-06-08T03:50:05.305415+0000","last_clean":"2023-06-08T03:50:05.305415+0000","last_became_active":"2023-06-08T03:50:04.302207+0000","last_became_peered":"2023-06-08T03:50:04.302207+0000","last_unstale":"2023-06-08T03:50:05.305415+0000","last_undegraded":"2023-06-08T03:50:05.305415+0000","last_fullsized":"2023-06-08T03:50:05.305415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:03.861371+0000","last_clean_scrub_stamp":"2023-06-08T03:50:03.861371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:52:54.122463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550031+0000","last_change":"2023-06-08T03:50:03.882733+0000","last_active":"2023-06-08T03:50:05.550031+0000","last_peered":"2023-06-08T03:50:05.550031+0000","last_clean":"2023-06-08T03:50:05.550031+0000","last_became_active":"2023-06-08T03:50:03.879940+0000","last_became_peered":"2023-06-08T03:50:03.879940+0000","last_unstale":"2023-06-08T03:50:05.550031+0000","last_undegraded":"2023-06-08T03:50:05.550031+0000","last_fullsized":"2023-06-08T03:50:05.550031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:50:02.859293+0000","last_clean_scrub_stamp":"2023-06-08T03:50:02.859293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:37:39.449770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-08T03:50:05.550925+0000","last_change":"2023-06-08T03:48:41.177502+0000","last_active":"2023-06-08T03:50:05.550925+0000","last_peered":"2023-06-08T03:50:05.550925+0000","last_clean":"2023-06-08T03:50:05.550925+0000","last_became_active":"2023-06-08T03:48:41.177177+0000","last_became_peered":"2023-06-08T03:48:41.177177+0000","last_unstale":"2023-06-08T03:50:05.550925+0000","last_undegraded":"2023-06-08T03:50:05.550925+0000","last_fullsized":"2023-06-08T03:50:05.550925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T03:48:40.158323+0000","last_clean_scrub_stamp":"2023-06-08T03:48:40.158323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:12:21.713193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":798734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.376},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jun 8 03:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":208948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.1279999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.1760000000000002,"5min":5.1760000000000002,"15min":5.1760000000000002},"last":1.169},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.626}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":798714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":7.0410000000000004,"5min":7.0410000000000004,"15min":7.0410000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.944,"5min":6.944,"15min":6.944},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.9870000000000001,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.5179999999999998,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jun 8 03:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":7.5570000000000004,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":208310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.432},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":209862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.923,"5min":11.923,"15min":11.923},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.877000000000001,"5min":11.877000000000001,"15min":11.877000000000001},"last":0.372},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":8.048,"5min":8.048,"15min":8.048},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.746}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.626}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":208914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.5339999999999998,"5min":5.5339999999999998,"15min":5.5339999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.623}]},{"osd":7,"last update":"Thu Jun 8 03:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.2089999999999996,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":209840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.437},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jun 8 03:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":208346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.626}]},{"osd":2,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.437},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jun 8 03:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T03:50:13.451 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-08T03:50:13.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-08T03:50:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.612+0000 7f6b7f547700 1 Processor -- start 2023-06-08T03:50:13.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.612+0000 7f6b7f547700 1 -- start start 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.613+0000 7f6b7f547700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 0x7f6b78071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.613+0000 7f6b7f547700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b78069db0 0x7f6b7806a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.613+0000 7f6b7f547700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7815c990 con 0x7f6b780b1a80 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.613+0000 7f6b7f547700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7806a710 con 0x7f6b78069db0 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.613+0000 7f6b7f547700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780cd2c0 con 0x7f6b7815c5c0 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.613+0000 7f6b7cae2700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6b780b1a80 0x7f6b780cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55506/0 (socket says 172.21.15.43:55506) 2023-06-08T03:50:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b7cae2700 1 -- 172.21.15.43:0/2855919401 learned_addr learned my addr 172.21.15.43:0/2855919401 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b7d2e3700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 0x7f6b78071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b7dae4700 1 --2- 172.21.15.43:0/2855919401 >> v2:172.21.15.135:3300/0 conn(0x7f6b78069db0 0x7f6b7806a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396324237 0 0) 0x7f6b7815c990 con 0x7f6b780b1a80 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b640035b0 con 0x7f6b780b1a80 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1130718485 0 0) 0x7f6b640035b0 con 0x7f6b780b1a80 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 msgr2=0x7f6b78071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 0x7f6b78071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 >> v2:172.21.15.135:3300/0 conn(0x7f6b78069db0 msgr2=0x7f6b7806a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 --2- 172.21.15.43:0/2855919401 >> v2:172.21.15.135:3300/0 conn(0x7f6b78069db0 0x7f6b7806a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780cd5a0 con 0x7f6b780b1a80 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 411187099 0 0) 0x7f6b74001670 con 0x7f6b780b1a80 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 >> v1:172.21.15.43:6789/0 conn(0x7f6b780b1a80 legacy=0x7f6b780cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64003a00 0x7f6b64003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b64004430 0x7f6b640048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 0x7f6b64005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7806a710 con 0x7f6b64004430 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780cd2c0 con 0x7f6b64003a00 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6400ba10 con 0x7f6b7815c5c0 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b7cae2700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b64004430 0x7f6b640048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b7d2e3700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64003a00 0x7f6b64003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.614+0000 7f6b7dae4700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 0x7f6b64005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7cae2700 1 -- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 msgr2=0x7f6b64005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7cae2700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815c5c0 0x7f6b64005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7cae2700 1 -- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64003a00 msgr2=0x7f6b64003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7cae2700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64003a00 0x7f6b64003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7cae2700 1 -- 172.21.15.43:0/2855919401 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b640035b0 con 0x7f6b64004430 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7cae2700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b64004430 0x7f6b640048f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c320 tx=0x7f6b64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77792b438a695a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400ce20 con 0x7f6b64004430 2023-06-08T03:50:13.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b74005960 con 0x7f6b64004430 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b6ffff700 1 -- 172.21.15.43:0/2855919401 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74005d10 con 0x7f6b64004430 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7f547700 1 -- 172.21.15.43:0/2855919401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b64004430 msgr2=0x7f6b640048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7f547700 1 --2- 172.21.15.43:0/2855919401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b64004430 0x7f6b640048f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c320 tx=0x7f6b64005880 comp rx=0 tx=0).stop 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7dae4700 1 -- 172.21.15.43:0/2855919401 reap_dead start 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7f547700 1 -- 172.21.15.43:0/2855919401 shutdown_connections 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7f547700 1 -- 172.21.15.43:0/2855919401 >> 172.21.15.43:0/2855919401 conn(0x7f6b7806aec0 msgr2=0x7f6b7806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.615+0000 7f6b7f547700 1 -- 172.21.15.43:0/2855919401 shutdown_connections 2023-06-08T03:50:13.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.616+0000 7f6b7f547700 1 -- 172.21.15.43:0/2855919401 wait complete. 2023-06-08T03:50:13.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 Processor -- start 2023-06-08T03:50:13.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 -- start start 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64004430 0x7f6b78152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815dff0 0x7f6b78152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 0x7f6b7815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7815db60 con 0x7f6b7815c990 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7815cf50 con 0x7f6b64004430 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.617+0000 7f6b7f547700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7815d230 con 0x7f6b7815dff0 2023-06-08T03:50:13.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 0x7f6b7815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 0x7f6b7815eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60618/0 (socket says 172.21.15.43:60618) 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 -- 172.21.15.43:0/237959919 learned_addr learned my addr 172.21.15.43:0/237959919 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7cae2700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815dff0 0x7f6b78152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7d2e3700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64004430 0x7f6b78152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 -- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815dff0 msgr2=0x7f6b78152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815dff0 0x7f6b78152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 -- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64004430 msgr2=0x7f6b78152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64004430 0x7f6b78152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 -- 172.21.15.43:0/237959919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7815d510 con 0x7f6b7815c990 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7cae2700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815dff0 0x7f6b78152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7d2e3700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64004430 0x7f6b78152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7dae4700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 0x7f6b7815eec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6b78070620 tx=0x7f6b7000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000e040 con 0x7f6b7815c990 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000f040 con 0x7f6b7815c990 2023-06-08T03:50:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70015430 con 0x7f6b7815c990 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7815d7f0 con 0x7f6b7815c990 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.618+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78153080 con 0x7f6b7815c990 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.619+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7815dd10 con 0x7f6b7815c990 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.620+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b70015590 con 0x7f6b7815c990 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.620+0000 7f6b6dffb700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6b5c06ace0 0x7f6b5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.620+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6b70089f20 con 0x7f6b7815c990 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.620+0000 7f6b7d2e3700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6b5c06ace0 0x7f6b5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:13.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.621+0000 7f6b7d2e3700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6b5c06ace0 0x7f6b5c06d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b780b3f60 tx=0x7f6b68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:13.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.625+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b7815dd10 con 0x7f6b7815c990 2023-06-08T03:50:13.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.907+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6b78073fa0 con 0x7f6b7815c990 2023-06-08T03:50:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.911+0000 7f6b6dffb700 1 -- 172.21.15.43:0/237959919 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6b70058910 con 0x7f6b7815c990 2023-06-08T03:50:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6b5c06ace0 msgr2=0x7f6b5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6b5c06ace0 0x7f6b5c06d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b780b3f60 tx=0x7f6b68008040 comp rx=0 tx=0).stop 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 msgr2=0x7f6b7815eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 0x7f6b7815eec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6b78070620 tx=0x7f6b7000f490 comp rx=0 tx=0).stop 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 shutdown_connections 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f6b5c06ace0 0x7f6b5c06d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b7815c990 0x7f6b7815eec0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b64004430 0x7f6b78152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 --2- 172.21.15.43:0/237959919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7815dff0 0x7f6b78152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 >> 172.21.15.43:0/237959919 conn(0x7f6b7806aec0 msgr2=0x7f6b780ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 shutdown_connections 2023-06-08T03:50:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:13.913+0000 7f6b7f547700 1 -- 172.21.15.43:0/237959919 wait complete. 2023-06-08T03:50:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-06-08T03:50:13.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T03:50:14.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.049+0000 7f912dd4a700 1 Processor -- start 2023-06-08T03:50:14.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.049+0000 7f912dd4a700 1 -- start start 2023-06-08T03:50:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f912dd4a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f912815c590 0x7f91280af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f912dd4a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91280ccba0 0x7f91280b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f912dd4a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9128069db0 0x7f912806a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f912dd4a700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91280afae0 con 0x7f912815c590 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f912dd4a700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912806a770 con 0x7f91280ccba0 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f912dd4a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280af050 con 0x7f9128069db0 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f91277fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f912815c590 0x7f91280af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f91277fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f912815c590 0x7f91280af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60622/0 (socket says 172.21.15.43:60622) 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.050+0000 7f91277fe700 1 -- 172.21.15.43:0/4134304352 learned_addr learned my addr 172.21.15.43:0/4134304352 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f9127fff700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9128069db0 0x7f912806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f9126ffd700 1 --2- 172.21.15.43:0/4134304352 >> v2:172.21.15.135:3300/0 conn(0x7f91280ccba0 0x7f91280b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91277fe700 1 -- 172.21.15.43:0/4134304352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9128069db0 msgr2=0x7f912806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91277fe700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9128069db0 0x7f912806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91277fe700 1 -- 172.21.15.43:0/4134304352 >> v2:172.21.15.135:3300/0 conn(0x7f91280ccba0 msgr2=0x7f91280b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91277fe700 1 --2- 172.21.15.43:0/4134304352 >> v2:172.21.15.135:3300/0 conn(0x7f91280ccba0 0x7f91280b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91277fe700 1 -- 172.21.15.43:0/4134304352 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280af800 con 0x7f912815c590 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f9127fff700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9128069db0 0x7f912806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f9126ffd700 1 --2- 172.21.15.43:0/4134304352 >> v2:172.21.15.135:3300/0 conn(0x7f91280ccba0 0x7f91280b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T03:50:14.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91277fe700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f912815c590 0x7f91280af220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f91280b21e0 tx=0x7f9118009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41eca004a449d905 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91267fc700 1 -- 172.21.15.43:0/4134304352 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118005e30 con 0x7f912815c590 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91267fc700 1 -- 172.21.15.43:0/4134304352 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118004030 con 0x7f912815c590 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f91267fc700 1 -- 172.21.15.43:0/4134304352 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180043e0 con 0x7f912815c590 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f912dd4a700 1 -- 172.21.15.43:0/4134304352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f912815c590 msgr2=0x7f91280af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.051+0000 7f912dd4a700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f912815c590 0x7f91280af220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f91280b21e0 tx=0x7f9118009bd0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 -- 172.21.15.43:0/4134304352 shutdown_connections 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9128069db0 0x7f912806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 --2- 172.21.15.43:0/4134304352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f912815c590 0x7f91280af220 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 --2- 172.21.15.43:0/4134304352 >> v2:172.21.15.135:3300/0 conn(0x7f91280ccba0 0x7f91280b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 -- 172.21.15.43:0/4134304352 >> 172.21.15.43:0/4134304352 conn(0x7f912806b7e0 msgr2=0x7f91280cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 -- 172.21.15.43:0/4134304352 shutdown_connections 2023-06-08T03:50:14.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.052+0000 7f912dd4a700 1 -- 172.21.15.43:0/4134304352 wait complete. 2023-06-08T03:50:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.053+0000 7f912dd4a700 1 Processor -- start 2023-06-08T03:50:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.053+0000 7f912dd4a700 1 -- start start 2023-06-08T03:50:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 0x7f91280c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91280ccba0 0x7f91281550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912815c590 0x7f91280c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280c37b0 con 0x7f9128069db0 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280c3a90 con 0x7f912815c590 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280c3d70 con 0x7f91280ccba0 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 0x7f91280c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 0x7f91280c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60628/0 (socket says 172.21.15.43:60628) 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 -- 172.21.15.43:0/3460043331 learned_addr learned my addr 172.21.15.43:0/3460043331 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f9126ffd700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91280ccba0 0x7f91281550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f9127fff700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912815c590 0x7f91280c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 -- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91280ccba0 msgr2=0x7f91281550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91280ccba0 0x7f91281550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 -- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912815c590 msgr2=0x7f91280c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912815c590 0x7f91280c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 -- 172.21.15.43:0/3460043331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009500 con 0x7f9128069db0 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f91277fe700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 0x7f91280c31d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9118000c00 tx=0x7f9118004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118003d10 con 0x7f9128069db0 2023-06-08T03:50:14.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118003e90 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91280c4050 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.054+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118011660 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.055+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9128156160 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.056+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912806bd30 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.056+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91180117c0 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.056+0000 7f911ffff700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f910806ace0 0x7f910806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.056+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f911808a4a0 con 0x7f9128069db0 2023-06-08T03:50:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.056+0000 7f9126ffd700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f910806ace0 0x7f910806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.057+0000 7f9126ffd700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f910806ace0 0x7f910806d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f91281f53b0 tx=0x7f9110008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.061+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91180554a0 con 0x7f9128069db0 2023-06-08T03:50:14.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.303+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9128073fa0 con 0x7f9128069db0 2023-06-08T03:50:14.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.304+0000 7f911ffff700 1 -- 172.21.15.43:0/3460043331 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f9118058ac0 con 0x7f9128069db0 2023-06-08T03:50:14.308 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:14.308 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/259769844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":259769844},{"type":"v1","addr":"172.21.15.135:6836","nonce":259769844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3929813218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3929813218},{"type":"v1","addr":"172.21.15.43:6835","nonce":3929813218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2982983469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2982983469},{"type":"v1","addr":"172.21.15.135:6837","nonce":2982983469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T03:50:04.290176+0000","modified":"2023-06-08T03:50:07.305956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6834/3038158097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3038158097},{"type":"v1","addr":"172.21.15.43:6834","nonce":3038158097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-08T03:50:14.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f910806ace0 msgr2=0x7f910806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f910806ace0 0x7f910806d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f91281f53b0 tx=0x7f9110008040 comp rx=0 tx=0).stop 2023-06-08T03:50:14.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 msgr2=0x7f91280c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 0x7f91280c31d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9118000c00 tx=0x7f9118004750 comp rx=0 tx=0).stop 2023-06-08T03:50:14.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 shutdown_connections 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f910806ace0 0x7f910806d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9128069db0 0x7f91280c31d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912815c590 0x7f91280c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 --2- 172.21.15.43:0/3460043331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91280ccba0 0x7f91281550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 >> 172.21.15.43:0/3460043331 conn(0x7f912806b7e0 msgr2=0x7f91280ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 shutdown_connections 2023-06-08T03:50:14.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.306+0000 7f912dd4a700 1 -- 172.21.15.43:0/3460043331 wait complete. 2023-06-08T03:50:14.312 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-06-08T03:50:14.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-08T03:50:04.290176+0000', 'modified': '2023-06-08T03:50:07.305956+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5334': {'gid': 5334, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6834/3038158097', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6832', 'nonce': 3038158097}, {'type': 'v1', 'addr': '172.21.15.43:6834', 'nonce': 3038158097}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-08T03:50:14.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-08T03:50:14.725 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-08T03:50:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.853+0000 7fde1916b700 1 Processor -- start 2023-06-08T03:50:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 -- start start 2023-06-08T03:50:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde140b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde14072090 0x7fde140cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde14069db0 0x7fde1406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1406a790 con 0x7fde14072090 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde140b20f0 con 0x7fde14069db0 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1916b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde14071850 con 0x7fde1415c420 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.854+0000 7fde1259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde14072090 0x7fde140cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde14072090 0x7fde140cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60638/0 (socket says 172.21.15.43:60638) 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 -- 172.21.15.43:0/2950149740 learned_addr learned my addr 172.21.15.43:0/2950149740 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde12d9d700 1 --2- 172.21.15.43:0/2950149740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde140b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1359e700 1 --2- 172.21.15.43:0/2950149740 >> v2:172.21.15.135:3300/0 conn(0x7fde14069db0 0x7fde1406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 -- 172.21.15.43:0/2950149740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 msgr2=0x7fde140b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 --2- 172.21.15.43:0/2950149740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde140b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 -- 172.21.15.43:0/2950149740 >> v2:172.21.15.135:3300/0 conn(0x7fde14069db0 msgr2=0x7fde1406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 --2- 172.21.15.43:0/2950149740 >> v2:172.21.15.135:3300/0 conn(0x7fde14069db0 0x7fde1406a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 -- 172.21.15.43:0/2950149740 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde140cec30 con 0x7fde14072090 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde1259c700 1 --2- 172.21.15.43:0/2950149740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde140cd220 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde140c66b0 tx=0x7fde04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ce5f2c0a5b5ba9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde11d9b700 1 -- 172.21.15.43:0/2950149740 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04011830 con 0x7fde14072090 2023-06-08T03:50:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde11d9b700 1 -- 172.21.15.43:0/2950149740 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde04011990 con 0x7fde14072090 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.855+0000 7fde11d9b700 1 -- 172.21.15.43:0/2950149740 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04011d20 con 0x7fde14072090 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 -- 172.21.15.43:0/2950149740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 msgr2=0x7fde140cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 --2- 172.21.15.43:0/2950149740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde140cd220 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde140c66b0 tx=0x7fde04009c00 comp rx=0 tx=0).stop 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 -- 172.21.15.43:0/2950149740 shutdown_connections 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 --2- 172.21.15.43:0/2950149740 >> v2:172.21.15.135:3300/0 conn(0x7fde14069db0 0x7fde1406a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 --2- 172.21.15.43:0/2950149740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde140b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 --2- 172.21.15.43:0/2950149740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde140cd220 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 -- 172.21.15.43:0/2950149740 >> 172.21.15.43:0/2950149740 conn(0x7fde1406aec0 msgr2=0x7fde1406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 -- 172.21.15.43:0/2950149740 shutdown_connections 2023-06-08T03:50:14.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.856+0000 7fde1916b700 1 -- 172.21.15.43:0/2950149740 wait complete. 2023-06-08T03:50:14.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.857+0000 7fde1916b700 1 Processor -- start 2023-06-08T03:50:14.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.857+0000 7fde1916b700 1 -- start start 2023-06-08T03:50:14.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1916b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde14069db0 0x7fde141590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1916b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde1415f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1916b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde14150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1916b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde140adfc0 con 0x7fde14072090 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1916b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1415c890 con 0x7fde14069db0 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1916b700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1415cb70 con 0x7fde1415c420 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde1415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde1415f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60644/0 (socket says 172.21.15.43:60644) 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 -- 172.21.15.43:0/2864158194 learned_addr learned my addr 172.21.15.43:0/2864158194 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1359e700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde14150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde12d9d700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde14069db0 0x7fde141590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 -- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 msgr2=0x7fde14150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde14150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 -- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde14069db0 msgr2=0x7fde141590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde14069db0 0x7fde141590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1259c700 1 -- 172.21.15.43:0/2864158194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04009550 con 0x7fde14072090 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde1359e700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde14150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.858+0000 7fde12d9d700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde14069db0 0x7fde141590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:14.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.859+0000 7fde1259c700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde1415f030 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fde040098f0 tx=0x7fde04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.859+0000 7fde0b7fe700 1 -- 172.21.15.43:0/2864158194 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04004300 con 0x7fde14072090 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.859+0000 7fde0b7fe700 1 -- 172.21.15.43:0/2864158194 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0401f070 con 0x7fde14072090 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.859+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1415ce50 con 0x7fde14072090 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.859+0000 7fde0b7fe700 1 -- 172.21.15.43:0/2864158194 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde040036a0 con 0x7fde14072090 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.859+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1415f570 con 0x7fde14072090 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.861+0000 7fde0b7fe700 1 -- 172.21.15.43:0/2864158194 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde04021030 con 0x7fde14072090 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.861+0000 7fde0b7fe700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddf406ace0 0x7fddf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.861+0000 7fde0b7fe700 1 -- 172.21.15.43:0/2864158194 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde0408a7c0 con 0x7fde14072090 2023-06-08T03:50:14.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.862+0000 7fde12d9d700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddf406ace0 0x7fddf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.862+0000 7fde12d9d700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddf406ace0 0x7fddf406d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009b10 tx=0x7fddfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.863+0000 7fde252f0b80 1 Processor -- start 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.863+0000 7fde252f0b80 1 -- start start 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x5607901bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607902090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde252f0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607900c53b0 con 0x5607901bf6c0 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607900c6c60 con 0x5607901bf2f0 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x560790119570 con 0x560790208c70 2023-06-08T03:50:14.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x5607901bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x5607901bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60652/0 (socket says 172.21.15.43:60652) 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 -- 172.21.15.43:0/2402749125 learned_addr learned my addr 172.21.15.43:0/2402749125 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1359e700 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607902090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde12d9d700 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 -- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 msgr2=0x5607902090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607902090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 -- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 msgr2=0x5607901bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901bb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.864+0000 7fde1259c700 1 -- 172.21.15.43:0/2402749125 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56078ff40d90 con 0x5607901bf6c0 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde1259c700 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x5607901bfb30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fde04059180 tx=0x7fde04058e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267ff6d09c4ab48f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde08ff9700 1 -- 172.21.15.43:0/2402749125 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0405d170 con 0x5607901bf6c0 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde08ff9700 1 -- 172.21.15.43:0/2402749125 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde04057820 con 0x5607901bf6c0 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde08ff9700 1 -- 172.21.15.43:0/2402749125 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0405f2e0 con 0x5607901bf6c0 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 -- 172.21.15.43:0/2402749125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 msgr2=0x5607901bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x5607901bfb30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fde04059180 tx=0x7fde04058e60 comp rx=0 tx=0).stop 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 -- 172.21.15.43:0/2402749125 shutdown_connections 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607902090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 --2- 172.21.15.43:0/2402749125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x5607901bfb30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 -- 172.21.15.43:0/2402749125 >> 172.21.15.43:0/2402749125 conn(0x5607901bdce0 msgr2=0x5607902064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.865+0000 7fde252f0b80 1 -- 172.21.15.43:0/2402749125 shutdown_connections 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.866+0000 7fde252f0b80 1 -- 172.21.15.43:0/2402749125 wait complete. 2023-06-08T03:50:14.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.866+0000 7fde252f0b80 1 -- start start 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.866+0000 7fde252f0b80 1 Processor -- start 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf6c0 0x5607901e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 0x5607901e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560790112a00 con 0x560790208c70 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607900b2a70 con 0x5607901bf6c0 2023-06-08T03:50:14.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607900b2770 con 0x5607901bf2f0 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde252f0b80 10 client.0 _ll_register_callbacks cb 0x5607900b0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 0x5607901e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 0x5607901e3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60660/0 (socket says 172.21.15.43:60660) 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 -- 172.21.15.43:0/1036468389 learned_addr learned my addr 172.21.15.43:0/1036468389 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde12d9d700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1259c700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf6c0 0x5607901e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 -- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf2f0 msgr2=0x560790215510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 -- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf6c0 msgr2=0x5607901e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf6c0 0x5607901e3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.867+0000 7fde1359e700 1 -- 172.21.15.43:0/1036468389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde04088e70 con 0x560790208c70 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde1359e700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 0x5607901e3110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fde0c007dd0 tx=0x7fde0c012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8212fd21540662 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fddf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fddf1ffb700 1 -- 172.21.15.43:0/1036468389 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c00e040 con 0x560790208c70 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fddf1ffb700 1 -- 172.21.15.43:0/1036468389 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde0c012c10 con 0x560790208c70 2023-06-08T03:50:14.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607901b3850 con 0x560790208c70 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fddf1ffb700 1 -- 172.21.15.43:0/1036468389 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde0c012dd0 con 0x560790208c70 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 10 client.5541 fetch_fsmap learned FSMap version 17 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56078ff29c10 con 0x560790208c70 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fddf1ffb700 1 -- 172.21.15.43:0/1036468389 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607901b3850 con 0x560790208c70 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fddf1ffb700 1 -- 172.21.15.43:0/1036468389 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fde0c014040 con 0x560790208c70 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 10 client.5541 fetch_fsmap finished waiting for FSMap version 17 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 10 client.5541 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-08T03:50:14.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 20 client.5541 populate_metadata read hostname 'smithi043' 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x5607901e6480 0x5607901e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 4 client.5541 mds_command: new command op to 5334 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 --> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56079010b9e0 con 0x5607901e6480 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.868+0000 7fde12d9d700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x5607901e6480 0x5607901e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde12d9d700 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x5607901e6480 0x5607901e4e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5400cc9bb0f055dc server_cookie=cbf489f3174a9af0 in_seq=0 out_seq=0 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fddf1ffb700 10 client.5541 ms_handle_connect on v2:172.21.15.43:6832/3038158097 2023-06-08T03:50:14.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fddf1ffb700 1 -- 172.21.15.43:0/1036468389 <== mds.0 v2:172.21.15.43:6832/3038158097 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56079010b9e0 con 0x5607901e6480 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fddf1ffb700 10 client.5541 handle_command_reply: tid=0 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 client.5541 shutdown 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 msgr2=0x5607901e3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 0x5607901e3110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fde0c007dd0 tx=0x7fde0c012520 comp rx=0 tx=0).stop 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 shutdown_connections 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560790208c70 0x5607901e3110 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x5607901e6480 0x5607901e4e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1036468389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf6c0 0x5607901e3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fddf1ffb700 0 client.5541 ms_handle_reset on v2:172.21.15.43:6832/3038158097 2023-06-08T03:50:14.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.869+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 >> 172.21.15.43:0/1036468389 conn(0x5607901bdce0 msgr2=0x560790206420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.870+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 shutdown_connections 2023-06-08T03:50:14.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.870+0000 7fde252f0b80 1 -- 172.21.15.43:0/1036468389 wait complete. 2023-06-08T03:50:14.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.870+0000 7fde252f0b80 20 client.5541 trim_cache size 0 max 16384 2023-06-08T03:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 Processor -- start 2023-06-08T03:50:14.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 -- start start 2023-06-08T03:50:14.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf6c0 0x5607901bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560790208c70 0x5607901b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607901bc670 con 0x5607901bf2f0 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078ff968d0 con 0x560790208c70 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607901e6880 con 0x5607901bf6c0 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde12d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde12d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60664/0 (socket says 172.21.15.43:60664) 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.888+0000 7fde12d9d700 1 -- 172.21.15.43:0/1511084373 learned_addr learned my addr 172.21.15.43:0/1511084373 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde1259c700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf6c0 0x5607901bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde1359e700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560790208c70 0x5607901b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde12d9d700 1 -- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf6c0 msgr2=0x5607901bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde12d9d700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf6c0 0x5607901bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde12d9d700 1 -- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560790208c70 msgr2=0x5607901b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde12d9d700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560790208c70 0x5607901b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde12d9d700 1 -- 172.21.15.43:0/1511084373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56078ff67200 con 0x5607901bf2f0 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde1259c700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf6c0 0x5607901bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde1359e700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560790208c70 0x5607901b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:14.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde12d9d700 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 0x560790215510 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fddfc011540 tx=0x7fddfc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36596c39f83bb1d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde097fa700 1 -- 172.21.15.43:0/1511084373 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc02d030 con 0x5607901bf2f0 2023-06-08T03:50:14.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde097fa700 1 -- 172.21.15.43:0/1511084373 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc011e50 con 0x5607901bf2f0 2023-06-08T03:50:14.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.889+0000 7fde097fa700 1 -- 172.21.15.43:0/1511084373 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0038a0 con 0x5607901bf2f0 2023-06-08T03:50:14.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 -- 172.21.15.43:0/1511084373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 msgr2=0x560790215510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 0x560790215510 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fddfc011540 tx=0x7fddfc014000 comp rx=0 tx=0).stop 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 -- 172.21.15.43:0/1511084373 shutdown_connections 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf2f0 0x560790215510 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560790208c70 0x5607901b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 --2- 172.21.15.43:0/1511084373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5607901bf6c0 0x5607901bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 -- 172.21.15.43:0/1511084373 >> 172.21.15.43:0/1511084373 conn(0x5607901bdce0 msgr2=0x5607901c2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 -- 172.21.15.43:0/1511084373 shutdown_connections 2023-06-08T03:50:14.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 -- 172.21.15.43:0/1511084373 wait complete. 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 -- start start 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.890+0000 7fde252f0b80 1 Processor -- start 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901e4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x56079026d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607901b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607901e4f80 con 0x5607901bf6c0 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607901bb2c0 con 0x5607901bf2f0 2023-06-08T03:50:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x560790209fc0 con 0x560790208c70 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde252f0b80 10 client.0 _ll_register_callbacks cb 0x5607900b0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x56079026d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x56079026d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60672/0 (socket says 172.21.15.43:60672) 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 -- 172.21.15.43:0/3654320487 learned_addr learned my addr 172.21.15.43:0/3654320487 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1359e700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607901b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde12d9d700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 -- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 msgr2=0x5607901b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607901b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 -- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 msgr2=0x5607901e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde1259c700 1 -- 172.21.15.43:0/3654320487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc004440 con 0x5607901bf6c0 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.891+0000 7fde12d9d700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde1259c700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x56079026d680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fde04059180 tx=0x7fde04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66f2c7e5feb0483 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fddf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-06-08T03:50:14.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fddf1ffb700 1 -- 172.21.15.43:0/3654320487 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0405f0e0 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fddf1ffb700 1 -- 172.21.15.43:0/3654320487 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde0405f240 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde04057820 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fddf1ffb700 1 -- 172.21.15.43:0/3654320487 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde0400bc80 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 10 client.5547 fetch_fsmap learned FSMap version 17 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56078ff3f260 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fddf1ffb700 1 -- 172.21.15.43:0/3654320487 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde04057820 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fddf1ffb700 1 -- 172.21.15.43:0/3654320487 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fde04058970 con 0x5607901bf6c0 2023-06-08T03:50:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 10 client.5547 fetch_fsmap finished waiting for FSMap version 17 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 10 client.5547 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 20 client.5547 populate_metadata read hostname 'smithi043' 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x560790207980 0x560790207d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 4 client.5547 mds_command: new command op to 5334 tid=0[{"prefix": "status"}] 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 --> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5607900ce000 con 0x560790207980 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.892+0000 7fde12d9d700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x560790207980 0x560790207d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fddf1ffb700 10 client.5547 ms_handle_connect on v2:172.21.15.43:6832/3038158097 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde12d9d700 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x560790207980 0x560790207d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc27067f9bc1304 server_cookie=695fa5b7677481e0 in_seq=0 out_seq=0 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fddf1ffb700 1 -- 172.21.15.43:0/3654320487 <== mds.0 v2:172.21.15.43:6832/3038158097 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5607900ce000 con 0x560790207980 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fddf1ffb700 10 client.5547 handle_command_reply: tid=0 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 client.5547 shutdown 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 msgr2=0x56079026d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x56079026d680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fde04059180 tx=0x7fde04000bc0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 shutdown_connections 2023-06-08T03:50:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:6832/3038158097,v1:172.21.15.43:6834/3038158097] conn(0x560790207980 0x560790207d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x560790208c70 0x5607901b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fddf1ffb700 0 client.5547 ms_handle_reset on v2:172.21.15.43:6832/3038158097 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607901bf2f0 0x5607901e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 --2- 172.21.15.43:0/3654320487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607901bf6c0 0x56079026d680 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 >> 172.21.15.43:0/3654320487 conn(0x5607901bdce0 msgr2=0x5607901ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 shutdown_connections 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 1 -- 172.21.15.43:0/3654320487 wait complete. 2023-06-08T03:50:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.893+0000 7fde252f0b80 20 client.5547 trim_cache size 0 max 16384 2023-06-08T03:50:14.908 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-06-08T03:50:14.908 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "5ca92cbd-c0c8-4573-b70a-f139aab8d7d6", 2023-06-08T03:50:14.908 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-06-08T03:50:14.908 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 5334, 2023-06-08T03:50:14.908 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 10.601682789, 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 17, 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 40, 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 40, 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 18.878535202999998 2023-06-08T03:50:14.909 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddf406ace0 msgr2=0x7fddf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddf406ace0 0x7fddf406d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009b10 tx=0x7fddfc008040 comp rx=0 tx=0).stop 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 msgr2=0x7fde1415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde1415f030 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fde040098f0 tx=0x7fde04004750 comp rx=0 tx=0).stop 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 shutdown_connections 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fddf406ace0 0x7fddf406d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde1415c420 0x7fde14150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde14069db0 0x7fde141590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 --2- 172.21.15.43:0/2864158194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14072090 0x7fde1415f030 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:14.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 >> 172.21.15.43:0/2864158194 conn(0x7fde1406aec0 msgr2=0x7fde140aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:14.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 shutdown_connections 2023-06-08T03:50:14.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:14.894+0000 7fde1916b700 1 -- 172.21.15.43:0/2864158194 wait complete. 2023-06-08T03:50:14.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T03:50:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.032+0000 7f41a518e700 1 Processor -- start 2023-06-08T03:50:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.032+0000 7f41a518e700 1 -- start start 2023-06-08T03:50:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.033+0000 7f41a518e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41a00afa30 0x7f41a00b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.033+0000 7f41a518e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00cd980 0x7f41a00cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.033+0000 7f41a518e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a00b01a0 con 0x7f41a00b0c40 2023-06-08T03:50:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.033+0000 7f41a518e700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a00b06f0 con 0x7f41a00afa30 2023-06-08T03:50:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.033+0000 7f41a518e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00b0900 con 0x7f41a00cd980 2023-06-08T03:50:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.033+0000 7f419ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41a00afa30 0x7f41a00b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41a00afa30 0x7f41a00b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60678/0 (socket says 172.21.15.43:60678) 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 -- 172.21.15.43:0/3902618846 learned_addr learned my addr 172.21.15.43:0/3902618846 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419f59e700 1 --2- 172.21.15.43:0/3902618846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00cd980 0x7f41a00cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 -- 172.21.15.43:0/3902618846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00cd980 msgr2=0x7f41a00cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 --2- 172.21.15.43:0/3902618846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00cd980 0x7f41a00cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 -- 172.21.15.43:0/3902618846 >> v1:172.21.15.135:6789/0 conn(0x7f41a00b0c40 legacy=0x7f41a00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 -- 172.21.15.43:0/3902618846 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a00ca7a0 con 0x7f41a00afa30 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419ed9d700 1 --2- 172.21.15.43:0/3902618846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00afa30 0x7f41a00b24f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4190006fd0 tx=0x7f419000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322eca10f2edd2b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419dd9b700 1 -- 172.21.15.43:0/3902618846 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190005e30 con 0x7f41a00afa30 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419dd9b700 1 -- 172.21.15.43:0/3902618846 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190004030 con 0x7f41a00afa30 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.034+0000 7f419dd9b700 1 -- 172.21.15.43:0/3902618846 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900043e0 con 0x7f41a00afa30 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 -- 172.21.15.43:0/3902618846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00afa30 msgr2=0x7f41a00b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 --2- 172.21.15.43:0/3902618846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00afa30 0x7f41a00b24f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4190006fd0 tx=0x7f419000be70 comp rx=0 tx=0).stop 2023-06-08T03:50:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 -- 172.21.15.43:0/3902618846 shutdown_connections 2023-06-08T03:50:15.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 --2- 172.21.15.43:0/3902618846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00cd980 0x7f41a00cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 --2- 172.21.15.43:0/3902618846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00afa30 0x7f41a00b24f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 -- 172.21.15.43:0/3902618846 >> 172.21.15.43:0/3902618846 conn(0x7f41a006b7e0 msgr2=0x7f41a00cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:15.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 -- 172.21.15.43:0/3902618846 shutdown_connections 2023-06-08T03:50:15.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.035+0000 7f41a518e700 1 -- 172.21.15.43:0/3902618846 wait complete. 2023-06-08T03:50:15.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.036+0000 7f41a518e700 1 Processor -- start 2023-06-08T03:50:15.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.036+0000 7f41a518e700 1 -- start start 2023-06-08T03:50:15.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f41a518e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00afa30 0x7f41a015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:15.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f41a518e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00b0c40 0x7f41a0151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:15.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f41a518e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 0x7f41a015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f41a518e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a015b7b0 con 0x7f41a00cd980 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f41a518e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a015ba90 con 0x7f41a00b0c40 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f41a518e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a015bd70 con 0x7f41a00afa30 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 0x7f41a015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 0x7f41a015a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60686/0 (socket says 172.21.15.43:60686) 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 -- 172.21.15.43:0/482282343 learned_addr learned my addr 172.21.15.43:0/482282343 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:15.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419ed9d700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00afa30 0x7f41a015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419e59c700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00b0c40 0x7f41a0151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 -- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00afa30 msgr2=0x7f41a015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00afa30 0x7f41a015b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 -- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00b0c40 msgr2=0x7f41a0151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00b0c40 0x7f41a0151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.037+0000 7f419f59e700 1 -- 172.21.15.43:0/482282343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419000b7a0 con 0x7f41a00cd980 2023-06-08T03:50:15.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.038+0000 7f419f59e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 0x7f41a015a8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f419800efc0 tx=0x7f419800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.038+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419800cd40 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.038+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419800f040 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.038+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a015c050 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.038+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980146c0 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.038+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a015c330 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.039+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a0073fa0 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.039+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4198014820 con 0x7f41a00cd980 2023-06-08T03:50:15.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.040+0000 7f41977fe700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f418006ace0 0x7f418006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:15.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.040+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f419808a230 con 0x7f41a00cd980 2023-06-08T03:50:15.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.040+0000 7f419ed9d700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f418006ace0 0x7f418006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:15.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.041+0000 7f419ed9d700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f418006ace0 0x7f418006d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4190000c00 tx=0x7f419001b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:15.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.044+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4198058c30 con 0x7f41a00cd980 2023-06-08T03:50:15.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.285+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41a00ca4b0 con 0x7f41a00cd980 2023-06-08T03:50:15.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.286+0000 7f41977fe700 1 -- 172.21.15.43:0/482282343 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f419800cea0 con 0x7f41a00cd980 2023-06-08T03:50:15.290 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-08T03:50:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f418006ace0 msgr2=0x7f418006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f418006ace0 0x7f418006d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4190000c00 tx=0x7f419001b040 comp rx=0 tx=0).stop 2023-06-08T03:50:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 msgr2=0x7f41a015a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 0x7f41a015a8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f419800efc0 tx=0x7f419800c3a0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 shutdown_connections 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f418006ace0 0x7f418006d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41a00cd980 0x7f41a015a8f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00afa30 0x7f41a015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 --2- 172.21.15.43:0/482282343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00b0c40 0x7f41a0151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 >> 172.21.15.43:0/482282343 conn(0x7f41a006b7e0 msgr2=0x7f41a00caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 shutdown_connections 2023-06-08T03:50:15.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:15.288+0000 7f41a518e700 1 -- 172.21.15.43:0/482282343 wait complete. 2023-06-08T03:50:15.304 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-08T03:50:15.304 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T03:50:15.305 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2023-06-08T03:50:15.305 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-08T03:50:15.305 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-08T03:50:15.306 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-08T03:50:15.306 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-08T03:50:15.306 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T03:50:15.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-08T03:50:15.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.307 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2023-06-08T03:50:15.324 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T03:50:15.324 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T03:50:15.324 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:50:15.325 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T03:50:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 92:f0:b7:39:93:75 brd ff:ff:ff:ff:ff:ff 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::a052:77ff:fe3b:8b55/64 scope link 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T03:50:15.327 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 92:f0:b7:39:93:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::90f0:b7ff:fe39:9375/64 scope link 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run.smithi043.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether b2:81:29:02:fa:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::b081:29ff:fe02:faa6/64 scope link 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-06-08T03:50:15.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.329 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T03:50:15.390 INFO:teuthology.orchestra.run.smithi043.stdout:1 2023-06-08T03:50:15.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.392 DEBUG:teuthology.orchestra.run.smithi043:> route 2023-06-08T03:50:15.450 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2023-06-08T03:50:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T03:50:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T03:50:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T03:50:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T03:50:15.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.452 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-06-08T03:50:15.452 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-06-08T03:50:15.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T03:50:15.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T03:50:15.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T03:50:15.453 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-06-08T03:50:15.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.558 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-06-08T03:50:15.574 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-08T03:50:15.574 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-08T03:50:15.575 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-08T03:50:15.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2023-06-08T03:50:15.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:50:15.642 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-08T03:50:15.698 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-08T03:50:15.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T03:50:15.699 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-08T03:50:15.755 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-08T03:50:15.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:50:15.841 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:50:15.841 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:50:15.872 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:50:15.873 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:50:15.904 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-08T03:50:15.904 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-08T03:50:15.904 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-06-08T03:50:15.904 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@5ca92cbd-c0c8-4573-b70a-f139aab8d7d6.cephfs=/ 2023-06-08T03:50:15.904 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-06-08T03:50:15.904 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: v2 mount support check returned 2 2023-06-08T03:50:15.905 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: kernel does not support v2 syntax 2023-06-08T03:50:15.905 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T03:50:15.905 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-06-08T03:50:15.905 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-06-08T03:50:15.905 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=5ca92cbd-c0c8-4573-b70a-f139aab8d7d6" will pass to kernel 2023-06-08T03:50:15.930 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T03:50:15.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-08T03:50:15.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:15.960 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T03:50:16.036 INFO:teuthology.orchestra.run.smithi043.stdout:client5556 2023-06-08T03:50:16.036 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:50:16.037 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T03:50:16.093 DEBUG:teuthology.orchestra.run.smithi043:> mktemp -d --suffix=xfstests-dev 2023-06-08T03:50:16.149 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.CQ6jNRznugxfstests-dev 2023-06-08T03:50:16.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:16.150 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.CQ6jNRznugxfstests-dev) 2023-06-08T03:50:16.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:16.218 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.CQ6jNRznugxfstests-dev) 2023-06-08T03:50:16.274 INFO:teuthology.orchestra.run.smithi043.stderr:Cloning into '/tmp/tmp.CQ6jNRznugxfstests-dev'... 2023-06-08T03:50:16.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:16.905 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-08T03:50:16.965 DEBUG:teuthology.orchestra.run.smithi043:> mktemp -d --suffix=test 2023-06-08T03:50:17.021 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.1Kn6ZLhw2Utest 2023-06-08T03:50:17.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:50:17.022 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-08T03:50:17.080 DEBUG:teuthology.orchestra.run.smithi043:> mktemp -d --suffix=scratch 2023-06-08T03:50:17.136 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:50:17.137 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-06-08T03:50:17.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-08T03:50:17.552 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-06-08T03:50:18.425 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:04:33 ago on Thu 08 Jun 2023 03:45:45 AM UTC. 2023-06-08T03:50:19.848 INFO:teuthology.orchestra.run.smithi043.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T03:50:19.849 INFO:teuthology.orchestra.run.smithi043.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T03:50:19.851 INFO:teuthology.orchestra.run.smithi043.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-08T03:50:19.852 INFO:teuthology.orchestra.run.smithi043.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-08T03:50:19.853 INFO:teuthology.orchestra.run.smithi043.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-08T03:50:19.855 INFO:teuthology.orchestra.run.smithi043.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-06-08T03:50:19.857 INFO:teuthology.orchestra.run.smithi043.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-08T03:50:19.859 INFO:teuthology.orchestra.run.smithi043.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-06-08T03:50:19.861 INFO:teuthology.orchestra.run.smithi043.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-08T03:50:19.862 INFO:teuthology.orchestra.run.smithi043.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-06-08T03:50:19.863 INFO:teuthology.orchestra.run.smithi043.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-08T03:50:19.864 INFO:teuthology.orchestra.run.smithi043.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-08T03:50:19.865 INFO:teuthology.orchestra.run.smithi043.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-08T03:50:19.867 INFO:teuthology.orchestra.run.smithi043.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-08T03:50:19.868 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-08T03:50:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:50:19.870 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T03:50:19.871 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T03:50:19.872 INFO:teuthology.orchestra.run.smithi043.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-08T03:50:19.874 INFO:teuthology.orchestra.run.smithi043.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-06-08T03:50:19.875 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:50:19.877 INFO:teuthology.orchestra.run.smithi043.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-06-08T03:50:19.882 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:50:20.006 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-06-08T03:50:20.008 INFO:teuthology.orchestra.run.smithi043.stdout:==================================================================================================================== 2023-06-08T03:50:20.008 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-06-08T03:50:20.008 INFO:teuthology.orchestra.run.smithi043.stdout:==================================================================================================================== 2023-06-08T03:50:20.008 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-06-08T03:50:20.009 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-06-08T03:50:20.010 INFO:teuthology.orchestra.run.smithi043.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling module streams: 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout: python27 2.7 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:20.011 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-06-08T03:50:20.012 INFO:teuthology.orchestra.run.smithi043.stdout:==================================================================================================================== 2023-06-08T03:50:20.012 INFO:teuthology.orchestra.run.smithi043.stdout:Install 14 Packages 2023-06-08T03:50:20.012 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 2 Packages 2023-06-08T03:50:20.012 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:20.012 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 12 M 2023-06-08T03:50:20.013 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-06-08T03:50:20.212 INFO:teuthology.orchestra.run.smithi043.stdout:(1/16): python2-setuptools-wheel-39.0.1-13.modu 4.3 MB/s | 287 kB 00:00 2023-06-08T03:50:20.253 INFO:teuthology.orchestra.run.smithi043.stdout:(2/16): python2-setuptools-39.0.1-13.module+el8 5.9 MB/s | 642 kB 00:00 2023-06-08T03:50:20.279 INFO:teuthology.orchestra.run.smithi043.stdout:(3/16): python2-wheel-wheel-0.31.1-3.module+el8 717 kB/s | 45 kB 00:00 2023-06-08T03:50:20.312 INFO:teuthology.orchestra.run.smithi043.stdout:(4/16): fio-3.19-3.el8.x86_64.rpm 9.0 MB/s | 538 kB 00:00 2023-06-08T03:50:20.337 INFO:teuthology.orchestra.run.smithi043.stdout:(5/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2023-06-08T03:50:20.363 INFO:teuthology.orchestra.run.smithi043.stdout:(6/16): python2-2.7.18-10.module+el8.6.0+14191+ 2.1 MB/s | 110 kB 00:00 2023-06-08T03:50:20.430 INFO:teuthology.orchestra.run.smithi043.stdout:(7/16): python2-pip-9.0.3-19.module+el8.6.0+130 25 MB/s | 1.6 MB 00:00 2023-06-08T03:50:20.480 INFO:teuthology.orchestra.run.smithi043.stdout:(8/16): python2-pip-wheel-9.0.3-19.module+el8.6 17 MB/s | 892 kB 00:00 2023-06-08T03:50:20.589 INFO:teuthology.orchestra.run.smithi043.stdout:(9/16): python2-libs-2.7.18-10.module+el8.6.0+1 24 MB/s | 6.0 MB 00:00 2023-06-08T03:50:20.614 INFO:teuthology.orchestra.run.smithi043.stdout:(10/16): indent-2.2.13-2.el8.x86_64.rpm 399 kB/s | 187 kB 00:00 2023-06-08T03:50:20.639 INFO:teuthology.orchestra.run.smithi043.stdout:(11/16): rmt-1.5.3-13.el8.x86_64.rpm 1.0 MB/s | 51 kB 00:00 2023-06-08T03:50:20.673 INFO:teuthology.orchestra.run.smithi043.stdout:(12/16): dump-0.4-0.36.b46.el8.x86_64.rpm 853 kB/s | 164 kB 00:00 2023-06-08T03:50:20.698 INFO:teuthology.orchestra.run.smithi043.stdout:(13/16): daxctl-libs-71.1-3.el8.x86_64.rpm 497 kB/s | 42 kB 00:00 2023-06-08T03:50:20.732 INFO:teuthology.orchestra.run.smithi043.stdout:(14/16): ndctl-libs-71.1-3.el8.x86_64.rpm 933 kB/s | 79 kB 00:00 2023-06-08T03:50:20.766 INFO:teuthology.orchestra.run.smithi043.stdout:(15/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2023-06-08T03:50:20.791 INFO:teuthology.orchestra.run.smithi043.stdout:(16/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 5.5 MB/s | 668 kB 00:00 2023-06-08T03:50:20.792 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:50:20.792 INFO:teuthology.orchestra.run.smithi043.stdout:Total 15 MB/s | 12 MB 00:00 2023-06-08T03:50:21.002 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-06-08T03:50:21.045 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-06-08T03:50:21.046 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-06-08T03:50:21.244 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-06-08T03:50:21.250 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-06-08T03:50:22.012 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-06-08T03:50:22.395 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-06-08T03:50:22.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-08T03:50:22.587 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-08T03:50:22.764 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-08T03:50:22.841 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-08T03:50:22.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-08T03:50:23.067 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-08T03:50:23.280 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-06-08T03:50:23.419 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 6/18 2023-06-08T03:50:23.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:50:23.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:50:23.697 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 7/18 2023-06-08T03:50:24.367 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 8/18 2023-06-08T03:50:24.597 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-06-08T03:50:24.913 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-06-08T03:50:26.127 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-06-08T03:50:26.399 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 11/18 2023-06-08T03:50:26.694 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-08T03:50:26.955 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-06-08T03:50:27.134 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-06-08T03:50:27.348 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-06-08T03:50:27.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-06-08T03:50:27.673 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-06-08T03:50:27.846 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-08T03:50:28.151 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-08T03:50:28.151 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-06-08T03:50:28.151 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 2/18 2023-06-08T03:50:28.151 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 3/18 2023-06-08T03:50:28.151 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 4/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-3.19-3.el8.x86_64 5/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 6/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 7/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 8/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 10/18 2023-06-08T03:50:28.152 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-06-08T03:50:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 12/18 2023-06-08T03:50:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 13/18 2023-06-08T03:50:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 14/18 2023-06-08T03:50:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-06-08T03:50:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-06-08T03:50:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-06-08T03:50:29.398 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-08T03:50:29.398 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:04:44 ago on Thu 08 Jun 2023 03:45:45 AM UTC. 2023-06-08T03:50:32.021 INFO:teuthology.orchestra.run.smithi043.stdout:Installed products updated. 2023-06-08T03:50:32.232 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:32.232 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2023-06-08T03:50:32.232 INFO:teuthology.orchestra.run.smithi043.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-06-08T03:50:32.232 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-06-08T03:50:32.232 INFO:teuthology.orchestra.run.smithi043.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: fio-3.19-3.el8.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: indent-2.2.13-2.el8.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-08T03:50:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-08T03:50:32.234 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:32.235 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-06-08T03:50:32.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo useradd -m fsgqa 2023-06-08T03:50:32.446 INFO:teuthology.orchestra.run.smithi043.stderr:useradd: user 'fsgqa' already exists 2023-06-08T03:50:32.447 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-08T03:50:32.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo groupadd fsgqa 2023-06-08T03:50:32.515 INFO:teuthology.orchestra.run.smithi043.stderr:groupadd: group 'fsgqa' already exists 2023-06-08T03:50:32.516 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-08T03:50:32.517 DEBUG:teuthology.orchestra.run.smithi043:> sudo useradd fsgqa2 2023-06-08T03:50:33.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo useradd 123456-fsgqa 2023-06-08T03:50:36.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-08T03:50:36.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.417+0000 7f946351c700 1 Processor -- start 2023-06-08T03:50:36.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.417+0000 7f946351c700 1 -- start start 2023-06-08T03:50:36.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.418+0000 7f946351c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f945c158840 0x7f945c0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.418+0000 7f946351c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c0cebf0 0x7f945c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.418+0000 7f946351c700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0c8ba0 con 0x7f945c0701b0 2023-06-08T03:50:36.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.418+0000 7f946351c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c0c8e80 con 0x7f945c158840 2023-06-08T03:50:36.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.418+0000 7f946351c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c9160 con 0x7f945c0cebf0 2023-06-08T03:50:36.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f94612b8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f945c158840 0x7f945c0c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f9461ab9700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c0cebf0 0x7f945c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f9460ab7700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f945c0701b0 0x7f945c0ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:42838/0 (socket says 172.21.15.43:42838) 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f9460ab7700 1 -- 172.21.15.43:0/3376069266 learned_addr learned my addr 172.21.15.43:0/3376069266 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f9453fff700 1 -- 172.21.15.43:0/3376069266 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258597463 0 0) 0x7f945c0c8ba0 con 0x7f945c0701b0 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f9453fff700 1 -- 172.21.15.43:0/3376069266 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94480035b0 con 0x7f945c0701b0 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f94612b8700 1 -- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c0cebf0 msgr2=0x7f945c0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f94612b8700 1 --2- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c0cebf0 0x7f945c0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f94612b8700 1 -- 172.21.15.43:0/3376069266 >> v1:172.21.15.135:6789/0 conn(0x7f945c0701b0 legacy=0x7f945c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f94612b8700 1 -- 172.21.15.43:0/3376069266 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0ccb60 con 0x7f945c158840 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f9461ab9700 1 --2- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c0cebf0 0x7f945c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.419+0000 7f94612b8700 1 --2- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c158840 0x7f945c0c9570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f944c009840 tx=0x7f944c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f079713dab9725 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f9453fff700 1 -- 172.21.15.43:0/3376069266 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c011830 con 0x7f945c158840 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f9453fff700 1 -- 172.21.15.43:0/3376069266 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c011990 con 0x7f945c158840 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f9453fff700 1 -- 172.21.15.43:0/3376069266 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c011d00 con 0x7f945c158840 2023-06-08T03:50:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 -- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c158840 msgr2=0x7f945c0c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 --2- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c158840 0x7f945c0c9570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f944c009840 tx=0x7f944c009b50 comp rx=0 tx=0).stop 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 -- 172.21.15.43:0/3376069266 shutdown_connections 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 --2- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c0cebf0 0x7f945c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 --2- 172.21.15.43:0/3376069266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c158840 0x7f945c0c9570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 -- 172.21.15.43:0/3376069266 >> 172.21.15.43:0/3376069266 conn(0x7f945c06aa40 msgr2=0x7f945c0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 -- 172.21.15.43:0/3376069266 shutdown_connections 2023-06-08T03:50:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.420+0000 7f946351c700 1 -- 172.21.15.43:0/3376069266 wait complete. 2023-06-08T03:50:36.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 Processor -- start 2023-06-08T03:50:36.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 -- start start 2023-06-08T03:50:36.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c0701b0 0x7f945c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 0x7f945c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c158840 0x7f945c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c150a60 con 0x7f945c0cebf0 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c14fde0 con 0x7f945c0701b0 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f946351c700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c1500c0 con 0x7f945c158840 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.422+0000 7f9460ab7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 0x7f945c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 0x7f945c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60720/0 (socket says 172.21.15.43:60720) 2023-06-08T03:50:36.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 -- 172.21.15.43:0/2479483566 learned_addr learned my addr 172.21.15.43:0/2479483566 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9461ab9700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c158840 0x7f945c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f94612b8700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c0701b0 0x7f945c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 -- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c158840 msgr2=0x7f945c0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c158840 0x7f945c0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 -- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c0701b0 msgr2=0x7f945c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c0701b0 0x7f945c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 -- 172.21.15.43:0/2479483566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009a70 con 0x7f945c0cebf0 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f94612b8700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c0701b0 0x7f945c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9461ab9700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c158840 0x7f945c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9460ab7700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 0x7f945c14f750 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9458001eb0 tx=0x7f945800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458005d70 con 0x7f945c0cebf0 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c0094a0 con 0x7f945c0cebf0 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580070d0 con 0x7f945c0cebf0 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458007480 con 0x7f945c0cebf0 2023-06-08T03:50:36.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.423+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c150680 con 0x7f945c0cebf0 2023-06-08T03:50:36.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.424+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c150ba0 con 0x7f945c0cebf0 2023-06-08T03:50:36.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.425+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94580075e0 con 0x7f945c0cebf0 2023-06-08T03:50:36.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.425+0000 7f9451ffb700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f944006ace0 0x7f944006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.425+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9458088bb0 con 0x7f945c0cebf0 2023-06-08T03:50:36.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.425+0000 7f94612b8700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f944006ace0 0x7f944006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.426+0000 7f94612b8700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f944006ace0 0x7f944006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f944c000c00 tx=0x7f944c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:36.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.430+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f945c150ba0 con 0x7f945c0cebf0 2023-06-08T03:50:36.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.708+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f945c150ba0 con 0x7f945c0cebf0 2023-06-08T03:50:36.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.709+0000 7f9451ffb700 1 -- 172.21.15.43:0/2479483566 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f945c150ba0 con 0x7f945c0cebf0 2023-06-08T03:50:36.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:50:36.712 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":1,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","modified":"2023-06-08T03:47:55.090873Z","created":"2023-06-08T03:47:55.090873Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-08T03:50:36.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f944006ace0 msgr2=0x7f944006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f944006ace0 0x7f944006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f944c000c00 tx=0x7f944c01c040 comp rx=0 tx=0).stop 2023-06-08T03:50:36.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 msgr2=0x7f945c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 0x7f945c14f750 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9458001eb0 tx=0x7f945800c860 comp rx=0 tx=0).stop 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 shutdown_connections 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f944006ace0 0x7f944006d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945c158840 0x7f945c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945c0701b0 0x7f945c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 --2- 172.21.15.43:0/2479483566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f945c0cebf0 0x7f945c14f750 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 >> 172.21.15.43:0/2479483566 conn(0x7f945c06aa40 msgr2=0x7f945c0ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:36.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 shutdown_connections 2023-06-08T03:50:36.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.711+0000 7f946351c700 1 -- 172.21.15.43:0/2479483566 wait complete. 2023-06-08T03:50:36.716 INFO:teuthology.orchestra.run.smithi043.stderr:dumped monmap epoch 1 2023-06-08T03:50:36.726 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-08T03:50:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.849+0000 7f287073d700 1 Processor -- start 2023-06-08T03:50:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.849+0000 7f287073d700 1 -- start start 2023-06-08T03:50:36.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f287073d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f28680b43f0 0x7f28680b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f287073d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680ccfc0 0x7f28680d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f287073d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28680cd430 0x7f28680d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f287073d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680d0180 con 0x7f28680b43f0 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f287073d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680cf690 con 0x7f28680cd430 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f287073d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680d0770 con 0x7f28680ccfc0 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f28680b43f0 0x7f28680b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f28680b43f0 0x7f28680b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60728/0 (socket says 172.21.15.43:60728) 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 -- 172.21.15.43:0/701009300 learned_addr learned my addr 172.21.15.43:0/701009300 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286dcd8700 1 --2- 172.21.15.43:0/701009300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680ccfc0 0x7f28680d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286ecda700 1 --2- 172.21.15.43:0/701009300 >> v2:172.21.15.135:3300/0 conn(0x7f28680cd430 0x7f28680d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 -- 172.21.15.43:0/701009300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680ccfc0 msgr2=0x7f28680d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 --2- 172.21.15.43:0/701009300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680ccfc0 0x7f28680d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 -- 172.21.15.43:0/701009300 >> v2:172.21.15.135:3300/0 conn(0x7f28680cd430 msgr2=0x7f28680d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 --2- 172.21.15.43:0/701009300 >> v2:172.21.15.135:3300/0 conn(0x7f28680cd430 0x7f28680d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 -- 172.21.15.43:0/701009300 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680b4d00 con 0x7f28680b43f0 2023-06-08T03:50:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286e4d9700 1 --2- 172.21.15.43:0/701009300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b43f0 0x7f28680b47c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f286806cbb0 tx=0x7f2864009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59d174bc2581bfc server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286d4d7700 1 -- 172.21.15.43:0/701009300 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864005e30 con 0x7f28680b43f0 2023-06-08T03:50:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286d4d7700 1 -- 172.21.15.43:0/701009300 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864004030 con 0x7f28680b43f0 2023-06-08T03:50:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.850+0000 7f286d4d7700 1 -- 172.21.15.43:0/701009300 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640043e0 con 0x7f28680b43f0 2023-06-08T03:50:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 -- 172.21.15.43:0/701009300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b43f0 msgr2=0x7f28680b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 --2- 172.21.15.43:0/701009300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b43f0 0x7f28680b47c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f286806cbb0 tx=0x7f2864009bd0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 -- 172.21.15.43:0/701009300 shutdown_connections 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 --2- 172.21.15.43:0/701009300 >> v2:172.21.15.135:3300/0 conn(0x7f28680cd430 0x7f28680d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 --2- 172.21.15.43:0/701009300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b43f0 0x7f28680b47c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 --2- 172.21.15.43:0/701009300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680ccfc0 0x7f28680d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 -- 172.21.15.43:0/701009300 >> 172.21.15.43:0/701009300 conn(0x7f286806afb0 msgr2=0x7f286806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 -- 172.21.15.43:0/701009300 shutdown_connections 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.851+0000 7f287073d700 1 -- 172.21.15.43:0/701009300 wait complete. 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.852+0000 7f287073d700 1 Processor -- start 2023-06-08T03:50:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.852+0000 7f287073d700 1 -- start start 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f287073d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680b43f0 0x7f28681e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f287073d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 0x7f28681e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f287073d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28680cd430 0x7f28681587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f287073d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28681e2450 con 0x7f28680ccfc0 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f287073d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28681e5c90 con 0x7f28680cd430 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f287073d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28681e6120 con 0x7f28680b43f0 2023-06-08T03:50:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 0x7f28681e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 0x7f28681e1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60734/0 (socket says 172.21.15.43:60734) 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 -- 172.21.15.43:0/2598859151 learned_addr learned my addr 172.21.15.43:0/2598859151 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286e4d9700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680b43f0 0x7f28681e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286ecda700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28680cd430 0x7f28681587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 -- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680b43f0 msgr2=0x7f28681e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680b43f0 0x7f28681e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 -- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28680cd430 msgr2=0x7f28681587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28680cd430 0x7f28681587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.853+0000 7f286dcd8700 1 -- 172.21.15.43:0/2598859151 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009500 con 0x7f28680ccfc0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.854+0000 7f286dcd8700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 0x7f28681e1f10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f285800e810 tx=0x7f285800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.854+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858013610 con 0x7f28680ccfc0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.854+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858013770 con 0x7f28680ccfc0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.854+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28681e5080 con 0x7f28680ccfc0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.854+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858013b20 con 0x7f28680ccfc0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.854+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28681e5640 con 0x7f28680ccfc0 2023-06-08T03:50:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.855+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2868073fa0 con 0x7f28680ccfc0 2023-06-08T03:50:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.855+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2858013c80 con 0x7f28680ccfc0 2023-06-08T03:50:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.856+0000 7f285effd700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f284c06ace0 0x7f284c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T03:50:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.856+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2858089330 con 0x7f28680ccfc0 2023-06-08T03:50:36.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.856+0000 7f286e4d9700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f284c06ace0 0x7f284c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T03:50:36.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.856+0000 7f286e4d9700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f284c06ace0 0x7f284c06d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2864000c00 tx=0x7f2864008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T03:50:36.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:36.860+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2858054270 con 0x7f28680ccfc0 2023-06-08T03:50:37.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.136+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f28681e5dd0 con 0x7f28680ccfc0 2023-06-08T03:50:37.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.136+0000 7f285effd700 1 -- 172.21.15.43:0/2598859151 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f2858057890 con 0x7f28680ccfc0 2023-06-08T03:50:37.139 INFO:teuthology.orchestra.run.smithi043.stdout:[client.admin] 2023-06-08T03:50:37.140 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== 2023-06-08T03:50:37.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f284c06ace0 msgr2=0x7f284c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:37.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f284c06ace0 0x7f284c06d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2864000c00 tx=0x7f2864008070 comp rx=0 tx=0).stop 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 msgr2=0x7f28681e1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 0x7f28681e1f10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f285800e810 tx=0x7f285800ebd0 comp rx=0 tx=0).stop 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 shutdown_connections 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f284c06ace0 0x7f284c06d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28680cd430 0x7f28681587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28680b43f0 0x7f28681e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:37.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 --2- 172.21.15.43:0/2598859151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680ccfc0 0x7f28681e1f10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T03:50:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 >> 172.21.15.43:0/2598859151 conn(0x7f286806afb0 msgr2=0x7f28680b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T03:50:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 shutdown_connections 2023-06-08T03:50:37.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T03:50:37.138+0000 7f287073d700 1 -- 172.21.15.43:0/2598859151 wait complete. 2023-06-08T03:50:37.153 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:50:37.154 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/tmp/tmp.CQ6jNRznugxfstests-dev/local.config 2023-06-08T03:50:37.180 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.43:6789:/test export TEST_DIR=/tmp/tmp.1Kn6ZLhw2Utest export SCRATCH_DEV=172.21.15.43:6789:/scratch export SCRATCH_MNT=/tmp/tmp.5VE9MAOWDRscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag==" 2023-06-08T03:50:37.181 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T03:50:37.181 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/tmp/tmp.CQ6jNRznugxfstests-dev/ceph.exclude 2023-06-08T03:50:37.247 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo make) 2023-06-08T03:50:37.324 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize -cfi 2023-06-08T03:50:37.796 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-08T03:50:37.796 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './config.guess' 2023-06-08T03:50:37.800 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './config.sub' 2023-06-08T03:50:37.803 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './install-sh' 2023-06-08T03:50:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './ltmain.sh' 2023-06-08T03:50:37.828 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-08T03:50:37.828 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-08T03:50:37.832 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-08T03:50:37.837 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-08T03:50:37.841 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-08T03:50:37.845 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-08T03:50:37.851 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-08T03:50:37.852 INFO:teuthology.orchestra.run.smithi043.stdout:cp include/install-sh . 2023-06-08T03:50:37.853 INFO:teuthology.orchestra.run.smithi043.stdout:aclocal -I m4 2023-06-08T03:50:39.052 INFO:teuthology.orchestra.run.smithi043.stdout:autoheader 2023-06-08T03:50:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:autoconf 2023-06-08T03:50:39.526 INFO:teuthology.orchestra.run.smithi043.stdout:./configure \ 2023-06-08T03:50:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: --libexecdir=/usr/lib \ 2023-06-08T03:50:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: --exec_prefix=/var/lib 2023-06-08T03:50:40.020 INFO:teuthology.orchestra.run.smithi043.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-08T03:50:40.020 INFO:teuthology.orchestra.run.smithi043.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-08T03:50:40.021 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to print strings... printf 2023-06-08T03:50:40.022 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc... gcc 2023-06-08T03:50:40.137 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether the C compiler works... yes 2023-06-08T03:50:40.137 INFO:teuthology.orchestra.run.smithi043.stdout:checking for C compiler default output file name... a.out 2023-06-08T03:50:40.165 INFO:teuthology.orchestra.run.smithi043.stdout:checking for suffix of executables... 2023-06-08T03:50:40.211 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether we are cross compiling... no 2023-06-08T03:50:40.229 INFO:teuthology.orchestra.run.smithi043.stdout:checking for suffix of object files... o 2023-06-08T03:50:40.245 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether we are using the GNU C compiler... yes 2023-06-08T03:50:40.262 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether gcc accepts -g... yes 2023-06-08T03:50:40.289 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-08T03:50:40.291 INFO:teuthology.orchestra.run.smithi043.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-08T03:50:40.293 INFO:teuthology.orchestra.run.smithi043.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-08T03:50:40.294 INFO:teuthology.orchestra.run.smithi043.stdout:checking for egrep... /bin/grep -E 2023-06-08T03:50:40.295 INFO:teuthology.orchestra.run.smithi043.stdout:checking for fgrep... /bin/grep -F 2023-06-08T03:50:40.299 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ld used by gcc... /bin/ld 2023-06-08T03:50:40.300 INFO:teuthology.orchestra.run.smithi043.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-08T03:50:40.305 INFO:teuthology.orchestra.run.smithi043.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-08T03:50:40.322 INFO:teuthology.orchestra.run.smithi043.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-08T03:50:40.322 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether ln -s works... yes 2023-06-08T03:50:40.332 INFO:teuthology.orchestra.run.smithi043.stdout:checking the maximum length of command line arguments... 1572864 2023-06-08T03:50:40.334 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-08T03:50:40.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-08T03:50:40.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking for /bin/ld option to reload object files... -r 2023-06-08T03:50:40.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking for objdump... objdump 2023-06-08T03:50:40.336 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to recognize dependent libraries... pass_all 2023-06-08T03:50:40.336 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dlltool... no 2023-06-08T03:50:40.336 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-08T03:50:40.337 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ar... ar 2023-06-08T03:50:40.366 INFO:teuthology.orchestra.run.smithi043.stdout:checking for archiver @FILE support... @ 2023-06-08T03:50:40.366 INFO:teuthology.orchestra.run.smithi043.stdout:checking for strip... strip 2023-06-08T03:50:40.367 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ranlib... ranlib 2023-06-08T03:50:40.367 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gawk... gawk 2023-06-08T03:50:40.419 INFO:teuthology.orchestra.run.smithi043.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-08T03:50:40.420 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sysroot... no 2023-06-08T03:50:40.423 INFO:teuthology.orchestra.run.smithi043.stdout:checking for a working dd... /bin/dd 2023-06-08T03:50:40.425 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-08T03:50:40.438 INFO:teuthology.orchestra.run.smithi043.stdout:checking for mt... no 2023-06-08T03:50:40.440 INFO:teuthology.orchestra.run.smithi043.stdout:checking if : is a manifest tool... no 2023-06-08T03:50:40.465 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to run the C preprocessor... gcc -E 2023-06-08T03:50:40.585 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ANSI C header files... yes 2023-06-08T03:50:40.606 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/types.h... yes 2023-06-08T03:50:40.630 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/stat.h... yes 2023-06-08T03:50:40.653 INFO:teuthology.orchestra.run.smithi043.stdout:checking for stdlib.h... yes 2023-06-08T03:50:40.677 INFO:teuthology.orchestra.run.smithi043.stdout:checking for string.h... yes 2023-06-08T03:50:40.702 INFO:teuthology.orchestra.run.smithi043.stdout:checking for memory.h... yes 2023-06-08T03:50:40.727 INFO:teuthology.orchestra.run.smithi043.stdout:checking for strings.h... yes 2023-06-08T03:50:40.754 INFO:teuthology.orchestra.run.smithi043.stdout:checking for inttypes.h... yes 2023-06-08T03:50:40.779 INFO:teuthology.orchestra.run.smithi043.stdout:checking for stdint.h... yes 2023-06-08T03:50:40.807 INFO:teuthology.orchestra.run.smithi043.stdout:checking for unistd.h... yes 2023-06-08T03:50:40.833 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dlfcn.h... yes 2023-06-08T03:50:40.836 INFO:teuthology.orchestra.run.smithi043.stdout:checking for objdir... .libs 2023-06-08T03:50:40.903 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-08T03:50:40.903 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-08T03:50:40.918 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-08T03:50:40.938 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc static flag -static works... no 2023-06-08T03:50:40.959 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc supports -c -o file.o... yes 2023-06-08T03:50:40.959 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-08T03:50:40.965 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-08T03:50:40.990 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether -lc should be explicitly linked in... no 2023-06-08T03:50:41.034 INFO:teuthology.orchestra.run.smithi043.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-08T03:50:41.034 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to hardcode library paths into programs... immediate 2023-06-08T03:50:41.040 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether stripping libraries is possible... yes 2023-06-08T03:50:41.040 INFO:teuthology.orchestra.run.smithi043.stdout:checking if libtool supports shared libraries... yes 2023-06-08T03:50:41.040 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether to build shared libraries... yes 2023-06-08T03:50:41.040 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether to build static libraries... yes 2023-06-08T03:50:41.045 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc... (cached) gcc 2023-06-08T03:50:41.060 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-08T03:50:41.060 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-08T03:50:41.060 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-08T03:50:41.061 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gmake... /usr/bin/gmake 2023-06-08T03:50:41.061 INFO:teuthology.orchestra.run.smithi043.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-08T03:50:41.062 INFO:teuthology.orchestra.run.smithi043.stdout:checking for tar... /bin/tar 2023-06-08T03:50:41.062 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gzip... /bin/gzip 2023-06-08T03:50:41.069 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether gcc -MM is supported... yes 2023-06-08T03:50:41.069 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sort... /bin/sort 2023-06-08T03:50:41.069 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether ln -s works... yes 2023-06-08T03:50:41.070 INFO:teuthology.orchestra.run.smithi043.stdout:checking for rpm... /bin/rpm 2023-06-08T03:50:41.073 INFO:teuthology.orchestra.run.smithi043.stdout:checking for rpmbuild... no 2023-06-08T03:50:41.109 INFO:teuthology.orchestra.run.smithi043.stdout:checking assert.h usability... yes 2023-06-08T03:50:41.115 INFO:teuthology.orchestra.run.smithi043.stdout:checking assert.h presence... yes 2023-06-08T03:50:41.116 INFO:teuthology.orchestra.run.smithi043.stdout:checking for assert.h... yes 2023-06-08T03:50:41.142 INFO:teuthology.orchestra.run.smithi043.stdout:checking bstring.h usability... no 2023-06-08T03:50:41.152 INFO:teuthology.orchestra.run.smithi043.stdout:checking bstring.h presence... no 2023-06-08T03:50:41.152 INFO:teuthology.orchestra.run.smithi043.stdout:checking for bstring.h... no 2023-06-08T03:50:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:checking libgen.h usability... yes 2023-06-08T03:50:41.184 INFO:teuthology.orchestra.run.smithi043.stdout:checking libgen.h presence... yes 2023-06-08T03:50:41.184 INFO:teuthology.orchestra.run.smithi043.stdout:checking for libgen.h... yes 2023-06-08T03:50:41.212 INFO:teuthology.orchestra.run.smithi043.stdout:checking dirent.h usability... yes 2023-06-08T03:50:41.219 INFO:teuthology.orchestra.run.smithi043.stdout:checking dirent.h presence... yes 2023-06-08T03:50:41.220 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dirent.h... yes 2023-06-08T03:50:41.277 INFO:teuthology.orchestra.run.smithi043.stdout:checking errno.h usability... yes 2023-06-08T03:50:41.283 INFO:teuthology.orchestra.run.smithi043.stdout:checking errno.h presence... yes 2023-06-08T03:50:41.284 INFO:teuthology.orchestra.run.smithi043.stdout:checking for errno.h... yes 2023-06-08T03:50:41.312 INFO:teuthology.orchestra.run.smithi043.stdout:checking malloc.h usability... yes 2023-06-08T03:50:41.320 INFO:teuthology.orchestra.run.smithi043.stdout:checking malloc.h presence... yes 2023-06-08T03:50:41.320 INFO:teuthology.orchestra.run.smithi043.stdout:checking for malloc.h... yes 2023-06-08T03:50:41.346 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid.h usability... no 2023-06-08T03:50:41.355 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid.h presence... no 2023-06-08T03:50:41.356 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid.h... no 2023-06-08T03:50:41.382 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid/uuid.h usability... yes 2023-06-08T03:50:41.391 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid/uuid.h presence... yes 2023-06-08T03:50:41.391 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid/uuid.h... yes 2023-06-08T03:50:41.417 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/uuid.h usability... no 2023-06-08T03:50:41.426 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/uuid.h presence... no 2023-06-08T03:50:41.427 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/uuid.h... no 2023-06-08T03:50:41.453 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/file.h usability... yes 2023-06-08T03:50:41.460 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/file.h presence... yes 2023-06-08T03:50:41.460 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/file.h... yes 2023-06-08T03:50:41.488 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fcntl.h usability... yes 2023-06-08T03:50:41.496 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fcntl.h presence... yes 2023-06-08T03:50:41.497 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/fcntl.h... yes 2023-06-08T03:50:41.522 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/syssgi.h usability... no 2023-06-08T03:50:41.531 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/syssgi.h presence... no 2023-06-08T03:50:41.531 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/syssgi.h... no 2023-06-08T03:50:41.603 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/param.h usability... yes 2023-06-08T03:50:41.613 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/param.h presence... yes 2023-06-08T03:50:41.614 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/param.h... yes 2023-06-08T03:50:41.618 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/stat.h... (cached) yes 2023-06-08T03:50:41.646 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/statvfs.h usability... yes 2023-06-08T03:50:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/statvfs.h presence... yes 2023-06-08T03:50:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/statvfs.h... yes 2023-06-08T03:50:41.681 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/time.h usability... yes 2023-06-08T03:50:41.688 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/time.h presence... yes 2023-06-08T03:50:41.688 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/time.h... yes 2023-06-08T03:50:41.717 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/ioctl.h usability... yes 2023-06-08T03:50:41.724 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/ioctl.h presence... yes 2023-06-08T03:50:41.724 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/ioctl.h... yes 2023-06-08T03:50:41.754 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/wait.h usability... yes 2023-06-08T03:50:41.763 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/wait.h presence... yes 2023-06-08T03:50:41.763 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/wait.h... yes 2023-06-08T03:50:41.768 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/types.h... (cached) yes 2023-06-08T03:50:41.773 INFO:teuthology.orchestra.run.smithi043.stdout:checking for strings.h... (cached) yes 2023-06-08T03:50:41.810 INFO:teuthology.orchestra.run.smithi043.stdout:checking err.h usability... yes 2023-06-08T03:50:41.816 INFO:teuthology.orchestra.run.smithi043.stdout:checking err.h presence... yes 2023-06-08T03:50:41.817 INFO:teuthology.orchestra.run.smithi043.stdout:checking for err.h... yes 2023-06-08T03:50:41.844 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/falloc.h usability... yes 2023-06-08T03:50:41.851 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/falloc.h presence... yes 2023-06-08T03:50:41.851 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/falloc.h... yes 2023-06-08T03:50:41.877 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-08T03:50:41.886 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-08T03:50:41.887 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-08T03:50:41.910 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-08T03:50:41.919 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-08T03:50:41.919 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-08T03:50:41.943 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/platform_defs.h usability... no 2023-06-08T03:50:41.952 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/platform_defs.h presence... no 2023-06-08T03:50:41.952 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/platform_defs.h... no 2023-06-08T03:50:41.976 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfs/ioctl.h usability... no 2023-06-08T03:50:41.985 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfs/ioctl.h presence... no 2023-06-08T03:50:41.985 INFO:teuthology.orchestra.run.smithi043.stdout:checking for btrfs/ioctl.h... no 2023-06-08T03:50:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:checking cifs/ioctl.h usability... no 2023-06-08T03:50:42.018 INFO:teuthology.orchestra.run.smithi043.stdout:checking cifs/ioctl.h presence... no 2023-06-08T03:50:42.018 INFO:teuthology.orchestra.run.smithi043.stdout:checking for cifs/ioctl.h... no 2023-06-08T03:50:42.044 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/mman.h usability... yes 2023-06-08T03:50:42.051 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/mman.h presence... yes 2023-06-08T03:50:42.051 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/mman.h... yes 2023-06-08T03:50:42.066 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/xfs_log_format.h... no 2023-06-08T03:50:42.101 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid_compare... no 2023-06-08T03:50:42.132 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid_compare in -luuid... yes 2023-06-08T03:50:42.190 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/xfs.h... yes 2023-06-08T03:50:42.212 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/libxfs.h... no 2023-06-08T03:50:42.227 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-08T03:50:42.254 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/xqm.h... yes 2023-06-08T03:50:42.300 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-08T03:50:42.323 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/handle.h usability... yes 2023-06-08T03:50:42.330 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/handle.h presence... yes 2023-06-08T03:50:42.330 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/handle.h... yes 2023-06-08T03:50:42.370 INFO:teuthology.orchestra.run.smithi043.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-08T03:50:42.400 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/acl.h usability... yes 2023-06-08T03:50:42.408 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/acl.h presence... yes 2023-06-08T03:50:42.409 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/acl.h... yes 2023-06-08T03:50:42.460 INFO:teuthology.orchestra.run.smithi043.stdout:checking acl/libacl.h usability... yes 2023-06-08T03:50:42.468 INFO:teuthology.orchestra.run.smithi043.stdout:checking acl/libacl.h presence... yes 2023-06-08T03:50:42.468 INFO:teuthology.orchestra.run.smithi043.stdout:checking for acl/libacl.h... yes 2023-06-08T03:50:42.500 INFO:teuthology.orchestra.run.smithi043.stdout:checking for acl_init in -lacl... yes 2023-06-08T03:50:42.522 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm-ndbm.h usability... no 2023-06-08T03:50:42.531 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm-ndbm.h presence... no 2023-06-08T03:50:42.531 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gdbm-ndbm.h... no 2023-06-08T03:50:42.553 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm/ndbm.h usability... no 2023-06-08T03:50:42.563 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm/ndbm.h presence... no 2023-06-08T03:50:42.563 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gdbm/ndbm.h... no 2023-06-08T03:50:42.584 INFO:teuthology.orchestra.run.smithi043.stdout:checking ndbm.h usability... no 2023-06-08T03:50:42.593 INFO:teuthology.orchestra.run.smithi043.stdout:checking ndbm.h presence... no 2023-06-08T03:50:42.594 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ndbm.h... no 2023-06-08T03:50:42.619 INFO:teuthology.orchestra.run.smithi043.stdout:checking libaio.h usability... yes 2023-06-08T03:50:42.629 INFO:teuthology.orchestra.run.smithi043.stdout:checking libaio.h presence... yes 2023-06-08T03:50:42.629 INFO:teuthology.orchestra.run.smithi043.stdout:checking for libaio.h... yes 2023-06-08T03:50:42.651 INFO:teuthology.orchestra.run.smithi043.stdout:checking liburing.h usability... no 2023-06-08T03:50:42.660 INFO:teuthology.orchestra.run.smithi043.stdout:checking liburing.h presence... no 2023-06-08T03:50:42.661 INFO:teuthology.orchestra.run.smithi043.stdout:checking for liburing.h... no 2023-06-08T03:50:42.682 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/capability.h usability... no 2023-06-08T03:50:42.691 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/capability.h presence... no 2023-06-08T03:50:42.691 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/capability.h... no 2023-06-08T03:50:42.714 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fiemap.h usability... yes 2023-06-08T03:50:42.721 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fiemap.h presence... yes 2023-06-08T03:50:42.721 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/fiemap.h... yes 2023-06-08T03:50:42.756 INFO:teuthology.orchestra.run.smithi043.stdout:checking for fallocate... yes 2023-06-08T03:50:42.789 INFO:teuthology.orchestra.run.smithi043.stdout:checking for open_by_handle_at... yes 2023-06-08T03:50:42.813 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/prctl.h usability... yes 2023-06-08T03:50:42.821 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/prctl.h presence... yes 2023-06-08T03:50:42.821 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/prctl.h... yes 2023-06-08T03:50:42.845 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fs.h usability... yes 2023-06-08T03:50:42.853 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fs.h presence... yes 2023-06-08T03:50:42.853 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/fs.h... yes 2023-06-08T03:50:42.874 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfsutil.h usability... no 2023-06-08T03:50:42.883 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfsutil.h presence... no 2023-06-08T03:50:42.883 INFO:teuthology.orchestra.run.smithi043.stdout:checking for btrfsutil.h... no 2023-06-08T03:50:42.924 INFO:teuthology.orchestra.run.smithi043.stdout:checking for copy_file_range... yes 2023-06-08T03:50:42.959 INFO:teuthology.orchestra.run.smithi043.stdout:checking for SEEK_DATA... yes 2023-06-08T03:50:43.005 INFO:teuthology.orchestra.run.smithi043.stdout:checking for BMV_OF_SHARED... yes 2023-06-08T03:50:43.047 INFO:teuthology.orchestra.run.smithi043.stdout:checking for nftw... yes 2023-06-08T03:50:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:checking for RLIMIT_NOFILE... yes 2023-06-08T03:50:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-08T03:50:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:checking for renameat2... yes 2023-06-08T03:50:43.172 INFO:teuthology.orchestra.run.smithi043.stdout:checking for reallocarray... yes 2023-06-08T03:50:43.186 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct mount_attr... no 2023-06-08T03:50:43.221 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-08T03:50:43.256 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-08T03:50:43.290 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-08T03:50:43.325 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-08T03:50:43.359 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-08T03:50:43.394 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-08T03:50:43.429 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-08T03:50:43.456 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs.h usability... yes 2023-06-08T03:50:43.463 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs.h presence... yes 2023-06-08T03:50:43.464 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/btrfs.h... yes 2023-06-08T03:50:43.494 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-08T03:50:43.501 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-08T03:50:43.502 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/btrfs_tree.h... yes 2023-06-08T03:50:43.532 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-08T03:50:43.549 INFO:teuthology.orchestra.run.smithi043.stdout:configure: creating ./config.status 2023-06-08T03:50:43.852 INFO:teuthology.orchestra.run.smithi043.stdout:config.status: creating include/builddefs 2023-06-08T03:50:43.862 INFO:teuthology.orchestra.run.smithi043.stdout:config.status: creating include/config.h 2023-06-08T03:50:43.870 INFO:teuthology.orchestra.run.smithi043.stdout:config.status: executing libtool commands 2023-06-08T03:50:43.909 INFO:teuthology.orchestra.run.smithi043.stdout:Building include 2023-06-08T03:50:43.912 INFO:teuthology.orchestra.run.smithi043.stdout:Building lib 2023-06-08T03:50:43.915 INFO:teuthology.orchestra.run.smithi043.stdout: [LTDEP] 2023-06-08T03:50:44.020 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dataascii.lo 2023-06-08T03:50:44.134 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] databin.lo 2023-06-08T03:50:44.275 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] datapid.lo 2023-06-08T03:50:44.376 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] file_lock.lo 2023-06-08T03:50:44.517 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] forker.lo 2023-06-08T03:50:44.643 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] pattern.lo 2023-06-08T03:50:44.760 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] open_flags.lo 2023-06-08T03:50:44.895 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] random_range.lo 2023-06-08T03:50:45.110 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] string_to_tokens.lo 2023-06-08T03:50:45.211 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] str_to_bytes.lo 2023-06-08T03:50:45.335 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] tlibio.lo 2023-06-08T03:50:45.554 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] write_log.lo 2023-06-08T03:50:45.781 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] random.lo 2023-06-08T03:50:45.891 INFO:teuthology.orchestra.run.smithi043.stdout: [LD] 2023-06-08T03:50:45.975 INFO:teuthology.orchestra.run.smithi043.stdout:Building ltp 2023-06-08T03:50:45.978 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2023-06-08T03:50:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] doio 2023-06-08T03:50:46.716 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsstress 2023-06-08T03:50:47.959 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsx 2023-06-08T03:50:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] growfiles 2023-06-08T03:50:49.254 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] iogen 2023-06-08T03:50:49.585 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-stress 2023-06-08T03:50:49.979 INFO:teuthology.orchestra.run.smithi043.stdout:Building src 2023-06-08T03:50:49.985 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2023-06-08T03:50:51.348 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2023-06-08T03:50:51.374 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2023-06-08T03:50:51.381 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2023-06-08T03:50:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2023-06-08T03:50:51.589 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dirstress 2023-06-08T03:50:51.811 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fill 2023-06-08T03:50:51.956 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fill2 2023-06-08T03:50:52.169 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] getpagesize 2023-06-08T03:50:52.297 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] holes 2023-06-08T03:50:52.480 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] lstat64 2023-06-08T03:50:52.651 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] nametest 2023-06-08T03:50:52.873 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] permname 2023-06-08T03:50:53.059 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] randholes 2023-06-08T03:50:53.290 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] runas 2023-06-08T03:50:53.478 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] truncfile 2023-06-08T03:50:53.630 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:50:53.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:50:53.645 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] usemem 2023-06-08T03:50:53.787 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mmapcat 2023-06-08T03:50:53.927 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] append_reader 2023-06-08T03:50:54.069 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] append_writer 2023-06-08T03:50:54.212 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dirperf 2023-06-08T03:50:54.416 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] metaperf 2023-06-08T03:50:54.654 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] devzero 2023-06-08T03:50:54.817 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] feature 2023-06-08T03:50:55.017 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] alloc 2023-06-08T03:50:55.213 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fault 2023-06-08T03:50:55.365 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fstest 2023-06-08T03:50:55.585 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_access_root 2023-06-08T03:50:55.729 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] godown 2023-06-08T03:50:55.887 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] resvtest 2023-06-08T03:50:56.060 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] writemod 2023-06-08T03:50:56.195 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] writev_on_pagefault 2023-06-08T03:50:56.345 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] makeextents 2023-06-08T03:50:56.512 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] itrash 2023-06-08T03:50:56.659 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] rename 2023-06-08T03:50:56.791 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] multi_open_unlink 2023-06-08T03:50:56.945 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] unwritten_sync 2023-06-08T03:50:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] genhashnames 2023-06-08T03:50:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_holes 2023-06-08T03:50:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_writev 2023-06-08T03:50:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_truncate_cmtime 2023-06-08T03:50:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dirhash_collide 2023-06-08T03:50:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_rename_overwrite 2023-06-08T03:50:58.018 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] holetest 2023-06-08T03:50:58.222 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_truncate_self 2023-06-08T03:50:58.354 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] af_unix 2023-06-08T03:50:58.497 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_stale_pmd 2023-06-08T03:50:58.641 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_cow_race 2023-06-08T03:50:58.796 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_fallocate 2023-06-08T03:50:58.938 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsync-err 2023-06-08T03:50:59.114 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_write_ro 2023-06-08T03:50:59.256 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-08T03:50:59.406 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-08T03:50:59.552 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_ofd_locks 2023-06-08T03:50:59.739 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_collision 2023-06-08T03:50:59.926 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mmap-write-concurrent 2023-06-08T03:51:00.086 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_get_file_time 2023-06-08T03:51:00.224 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_create_short_dirs 2023-06-08T03:51:00.382 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_create_long_dirs 2023-06-08T03:51:00.537 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_enospc 2023-06-08T03:51:00.711 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_writev_overlap 2023-06-08T03:51:00.870 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] checkpoint_journal 2023-06-08T03:51:01.015 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mmap-rw-fault 2023-06-08T03:51:01.185 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] allocstale 2023-06-08T03:51:01.342 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_cow_memory_failure 2023-06-08T03:51:01.501 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fake-dump-rootino 2023-06-08T03:51:01.642 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dio-buf-fault 2023-06-08T03:51:01.788 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] xfsctl 2023-06-08T03:51:01.963 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bstat 2023-06-08T03:51:02.152 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mtab 2023-06-08T03:51:02.325 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] getdevicesize 2023-06-08T03:51:02.459 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] preallo_rw_pattern_reader 2023-06-08T03:51:02.609 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] preallo_rw_pattern_writer 2023-06-08T03:51:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] ftrunc 2023-06-08T03:51:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] trunc 2023-06-08T03:51:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fs_perms 2023-06-08T03:51:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] testx 2023-06-08T03:51:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] looptest 2023-06-08T03:51:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] locktest 2023-06-08T03:51:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] unwritten_mmap 2023-06-08T03:51:03.951 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bulkstat_unlink_test 2023-06-08T03:51:04.139 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] deduperace 2023-06-08T03:51:04.321 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bulkstat_unlink_test_modified 2023-06-08T03:51:04.505 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_dir_offset 2023-06-08T03:51:04.686 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_futimens 2023-06-08T03:51:04.820 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_immutable 2023-06-08T03:51:05.388 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] stale_handle 2023-06-08T03:51:05.547 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] pwrite_mmap_blocked 2023-06-08T03:51:05.691 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_dir_offset2 2023-06-08T03:51:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] seek_sanity_test 2023-06-08T03:51:06.261 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] seek_copy_test 2023-06-08T03:51:06.426 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_readdir_1 2023-06-08T03:51:06.566 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_readdir_2 2023-06-08T03:51:06.708 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsync-tester 2023-06-08T03:51:06.941 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] nsexec 2023-06-08T03:51:07.106 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] cloner 2023-06-08T03:51:07.273 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] renameat2 2023-06-08T03:51:07.428 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_getcwd 2023-06-08T03:51:07.576 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] e4compact 2023-06-08T03:51:07.764 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] test-nextquota 2023-06-08T03:51:07.925 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] punch-alternating 2023-06-08T03:51:08.085 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-08T03:51:08.242 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] listxattr 2023-06-08T03:51:08.383 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dio-interleaved 2023-06-08T03:51:08.532 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_dir_type 2023-06-08T03:51:08.679 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dio-invalidate-cache 2023-06-08T03:51:08.871 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] stat_test 2023-06-08T03:51:09.150 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_encrypted_d_revalidate 2023-06-08T03:51:09.305 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] attr_replace_test 2023-06-08T03:51:09.459 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] swapon 2023-06-08T03:51:09.614 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mkswap 2023-06-08T03:51:09.756 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_attr_corruption 2023-06-08T03:51:09.898 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_open_tmpfiles 2023-06-08T03:51:10.066 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fscrypt-crypt-util 2023-06-08T03:51:10.662 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bulkstat_null_ocount 2023-06-08T03:51:10.810 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] splice-test 2023-06-08T03:51:10.981 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] chprojid_fail 2023-06-08T03:51:11.134 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] detached_mounts_propagation 2023-06-08T03:51:11.306 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] ext4_resize 2023-06-08T03:51:11.447 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_readdir_3 2023-06-08T03:51:11.629 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] splice2pipe 2023-06-08T03:51:11.783 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] uuid_ioctl 2023-06-08T03:51:11.928 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fiemap-tester 2023-06-08T03:51:12.179 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_stripealign 2023-06-08T03:51:12.324 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] open_by_handle 2023-06-08T03:51:12.563 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_dio 2023-06-08T03:51:12.716 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] xfsfind 2023-06-08T03:51:12.898 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fssum 2023-06-08T03:51:13.302 INFO:teuthology.orchestra.run.smithi043.stdout:Building log-writes 2023-06-08T03:51:13.307 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] replay-log 2023-06-08T03:51:13.597 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2023-06-08T03:51:13.601 INFO:teuthology.orchestra.run.smithi043.stdout:Building aio-dio-regress 2023-06-08T03:51:13.607 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-08T03:51:13.771 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-fcntl-race 2023-06-08T03:51:13.927 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-subblock-eof-read 2023-06-08T03:51:14.066 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-append-write-read-race 2023-06-08T03:51:14.234 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-invalidate-readahead 2023-06-08T03:51:14.392 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-write-verify 2023-06-08T03:51:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-08T03:51:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-last-ref-held-by-io 2023-06-08T03:51:14.873 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-cycle-write 2023-06-08T03:51:15.050 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-extend-stat 2023-06-08T03:51:15.208 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-08T03:51:15.337 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-hole-filling-race 2023-06-08T03:51:15.481 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-invalidate-failure 2023-06-08T03:51:15.634 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aiodio_sparse2 2023-06-08T03:51:15.839 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aiocp 2023-06-08T03:51:16.055 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-cow-race 2023-06-08T03:51:16.203 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-eof-race 2023-06-08T03:51:16.380 INFO:teuthology.orchestra.run.smithi043.stdout:Building vfs 2023-06-08T03:51:16.385 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] vfstest 2023-06-08T03:51:18.123 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mount-idmapped 2023-06-08T03:51:18.467 INFO:teuthology.orchestra.run.smithi043.stdout:Building m4 2023-06-08T03:51:18.470 INFO:teuthology.orchestra.run.smithi043.stdout:Building common 2023-06-08T03:51:18.473 INFO:teuthology.orchestra.run.smithi043.stdout:Building tests 2023-06-08T03:51:18.478 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2023-06-08T03:51:18.483 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/perf/group.list 2023-06-08T03:51:18.494 INFO:teuthology.orchestra.run.smithi043.stdout:Building ext4 2023-06-08T03:51:18.499 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ext4/group.list 2023-06-08T03:51:18.533 INFO:teuthology.orchestra.run.smithi043.stdout:Building ocfs2 2023-06-08T03:51:18.538 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ocfs2/group.list 2023-06-08T03:51:18.550 INFO:teuthology.orchestra.run.smithi043.stdout:Building overlay 2023-06-08T03:51:18.556 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/overlay/group.list 2023-06-08T03:51:18.590 INFO:teuthology.orchestra.run.smithi043.stdout:Building cifs 2023-06-08T03:51:18.595 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/cifs/group.list 2023-06-08T03:51:18.606 INFO:teuthology.orchestra.run.smithi043.stdout:Building generic 2023-06-08T03:51:18.613 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/generic/group.list 2023-06-08T03:51:18.705 INFO:teuthology.orchestra.run.smithi043.stdout:Building shared 2023-06-08T03:51:18.710 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/shared/group.list 2023-06-08T03:51:18.726 INFO:teuthology.orchestra.run.smithi043.stdout:Building nfs 2023-06-08T03:51:18.730 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/nfs/group.list 2023-06-08T03:51:18.743 INFO:teuthology.orchestra.run.smithi043.stdout:Building f2fs 2023-06-08T03:51:18.748 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/f2fs/group.list 2023-06-08T03:51:18.764 INFO:teuthology.orchestra.run.smithi043.stdout:Building udf 2023-06-08T03:51:18.769 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/udf/group.list 2023-06-08T03:51:18.779 INFO:teuthology.orchestra.run.smithi043.stdout:Building ceph 2023-06-08T03:51:18.784 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ceph/group.list 2023-06-08T03:51:18.798 INFO:teuthology.orchestra.run.smithi043.stdout:Building xfs 2023-06-08T03:51:18.804 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/xfs/group.list 2023-06-08T03:51:18.897 INFO:teuthology.orchestra.run.smithi043.stdout:Building btrfs 2023-06-08T03:51:18.902 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/btrfs/group.list 2023-06-08T03:51:18.956 INFO:teuthology.orchestra.run.smithi043.stdout:Building tmpfs 2023-06-08T03:51:18.961 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/tmpfs/group.list 2023-06-08T03:51:18.974 INFO:teuthology.orchestra.run.smithi043.stdout:Building selftest 2023-06-08T03:51:18.979 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/selftest/group.list 2023-06-08T03:51:18.992 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo make install) 2023-06-08T03:51:19.031 INFO:teuthology.orchestra.run.smithi043.stdout:Building include 2023-06-08T03:51:19.034 INFO:teuthology.orchestra.run.smithi043.stdout:Building lib 2023-06-08T03:51:19.038 INFO:teuthology.orchestra.run.smithi043.stdout:Building ltp 2023-06-08T03:51:19.042 INFO:teuthology.orchestra.run.smithi043.stdout:Building src 2023-06-08T03:51:19.075 INFO:teuthology.orchestra.run.smithi043.stdout:Building log-writes 2023-06-08T03:51:19.079 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2023-06-08T03:51:19.082 INFO:teuthology.orchestra.run.smithi043.stdout:Building aio-dio-regress 2023-06-08T03:51:19.086 INFO:teuthology.orchestra.run.smithi043.stdout:Building vfs 2023-06-08T03:51:19.090 INFO:teuthology.orchestra.run.smithi043.stdout:Building m4 2023-06-08T03:51:19.093 INFO:teuthology.orchestra.run.smithi043.stdout:Building common 2023-06-08T03:51:19.096 INFO:teuthology.orchestra.run.smithi043.stdout:Building tests 2023-06-08T03:51:19.101 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2023-06-08T03:51:19.106 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/perf/group.list 2023-06-08T03:51:19.117 INFO:teuthology.orchestra.run.smithi043.stdout:Building ext4 2023-06-08T03:51:19.122 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ext4/group.list 2023-06-08T03:51:19.156 INFO:teuthology.orchestra.run.smithi043.stdout:Building ocfs2 2023-06-08T03:51:19.161 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ocfs2/group.list 2023-06-08T03:51:19.173 INFO:teuthology.orchestra.run.smithi043.stdout:Building overlay 2023-06-08T03:51:19.178 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/overlay/group.list 2023-06-08T03:51:19.213 INFO:teuthology.orchestra.run.smithi043.stdout:Building cifs 2023-06-08T03:51:19.218 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/cifs/group.list 2023-06-08T03:51:19.229 INFO:teuthology.orchestra.run.smithi043.stdout:Building generic 2023-06-08T03:51:19.236 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/generic/group.list 2023-06-08T03:51:19.327 INFO:teuthology.orchestra.run.smithi043.stdout:Building shared 2023-06-08T03:51:19.332 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/shared/group.list 2023-06-08T03:51:19.348 INFO:teuthology.orchestra.run.smithi043.stdout:Building nfs 2023-06-08T03:51:19.352 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/nfs/group.list 2023-06-08T03:51:19.366 INFO:teuthology.orchestra.run.smithi043.stdout:Building f2fs 2023-06-08T03:51:19.370 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/f2fs/group.list 2023-06-08T03:51:19.386 INFO:teuthology.orchestra.run.smithi043.stdout:Building udf 2023-06-08T03:51:19.391 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/udf/group.list 2023-06-08T03:51:19.401 INFO:teuthology.orchestra.run.smithi043.stdout:Building ceph 2023-06-08T03:51:19.406 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ceph/group.list 2023-06-08T03:51:19.419 INFO:teuthology.orchestra.run.smithi043.stdout:Building xfs 2023-06-08T03:51:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/xfs/group.list 2023-06-08T03:51:19.517 INFO:teuthology.orchestra.run.smithi043.stdout:Building btrfs 2023-06-08T03:51:19.522 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/btrfs/group.list 2023-06-08T03:51:19.576 INFO:teuthology.orchestra.run.smithi043.stdout:Building tmpfs 2023-06-08T03:51:19.581 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/tmpfs/group.list 2023-06-08T03:51:19.593 INFO:teuthology.orchestra.run.smithi043.stdout:Building selftest 2023-06-08T03:51:19.598 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.CQ6jNRznugxfstests-dev/tests/selftest/group.list 2023-06-08T03:51:19.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-08T03:51:19.611 INFO:teuthology.orchestra.run.smithi043.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-08T03:51:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-08T03:51:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-08T03:51:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-08T03:51:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-08T03:51:19.624 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-08T03:51:19.703 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-08T03:51:19.712 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-08T03:51:19.728 INFO:teuthology.orchestra.run.smithi043.stdout:Building log-writes 2023-06-08T03:51:19.731 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2023-06-08T03:51:19.735 INFO:teuthology.orchestra.run.smithi043.stdout:Building aio-dio-regress 2023-06-08T03:51:19.739 INFO:teuthology.orchestra.run.smithi043.stdout:Building vfs 2023-06-08T03:51:19.741 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C log-writes install 2023-06-08T03:51:19.743 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-08T03:51:19.752 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-08T03:51:19.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C perf install 2023-06-08T03:51:19.762 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-08T03:51:19.771 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-08T03:51:19.795 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-08T03:51:19.796 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-08T03:51:19.805 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-08T03:51:19.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C vfs install 2023-06-08T03:51:19.862 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-08T03:51:19.870 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-08T03:51:19.883 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-08T03:51:19.891 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-08T03:51:21.118 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-08T03:51:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-08T03:51:21.244 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-08T03:51:21.246 INFO:teuthology.orchestra.run.smithi043.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-08T03:51:21.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-08T03:51:21.247 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-08T03:51:21.256 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-08T03:51:21.392 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-08T03:51:21.393 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/btrfs/ install 2023-06-08T03:51:21.396 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-08T03:51:21.405 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-08T03:51:22.222 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-08T03:51:22.231 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-06-08T03:51:23.053 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ceph/ install 2023-06-08T03:51:23.055 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-08T03:51:23.063 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-08T03:51:23.083 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-08T03:51:23.092 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-08T03:51:23.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/cifs/ install 2023-06-08T03:51:23.114 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-08T03:51:23.122 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-08T03:51:23.131 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-08T03:51:23.140 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-08T03:51:23.149 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ext4/ install 2023-06-08T03:51:23.151 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-08T03:51:23.160 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-08T03:51:23.355 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-08T03:51:23.364 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-08T03:51:23.571 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/f2fs/ install 2023-06-08T03:51:23.573 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-08T03:51:23.582 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-08T03:51:23.593 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-08T03:51:23.602 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-08T03:51:23.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/generic/ install 2023-06-08T03:51:23.618 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-08T03:51:23.627 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-08T03:51:23.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:51:23.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:51:25.664 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-08T03:51:25.672 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 555.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 255.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 645.out 673.out 190.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 309.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 342.out 041.out 664.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 599.out 476.out 087.out 199.out 458.out 233.out 639.out 721.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 451.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 382.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 044.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 519.out 567.out 299.out 474.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 443.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 357.out 072.out 068.out 229.out 038.out 084.out 056.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 308.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 097.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out /var/lib/xfstests/tests/generic 2023-06-08T03:51:27.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/nfs/ install 2023-06-08T03:51:27.744 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-08T03:51:27.753 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-08T03:51:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-08T03:51:27.771 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-08T03:51:27.780 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/ocfs2/ install 2023-06-08T03:51:27.782 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-08T03:51:27.790 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-08T03:51:27.799 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-08T03:51:27.808 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-08T03:51:27.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/overlay/ install 2023-06-08T03:51:27.819 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-08T03:51:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-08T03:51:28.102 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-08T03:51:28.111 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-06-08T03:51:28.387 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/perf/ install 2023-06-08T03:51:28.388 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-08T03:51:28.397 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-08T03:51:28.406 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-08T03:51:28.415 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-08T03:51:28.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/selftest/ install 2023-06-08T03:51:28.426 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-08T03:51:28.434 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-08T03:51:28.457 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-08T03:51:28.466 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-08T03:51:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/shared/ install 2023-06-08T03:51:28.490 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-08T03:51:28.499 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-08T03:51:28.513 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-08T03:51:28.522 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-08T03:51:28.537 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/tmpfs/ install 2023-06-08T03:51:28.539 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-08T03:51:28.547 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-08T03:51:28.556 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-08T03:51:28.565 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-08T03:51:28.574 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/udf/ install 2023-06-08T03:51:28.576 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-08T03:51:28.585 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-08T03:51:28.594 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-08T03:51:28.603 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-08T03:51:28.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CQ6jNRznugxfstests-dev/tests/xfs/ install 2023-06-08T03:51:28.616 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-08T03:51:28.625 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-08T03:51:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-08T03:51:30.575 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-06-08T03:51:32.552 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-08T03:51:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-08T03:51:32.569 INFO:teuthology.orchestra.run.smithi043.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-08T03:51:32.578 INFO:teuthology.orchestra.run.smithi043.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-08T03:51:32.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T03:51:32.590 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec ls tests/generic) 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:001 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:001.out 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:002 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:002.out 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:003 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:003.out 2023-06-08T03:51:32.608 INFO:teuthology.orchestra.run.smithi043.stdout:004 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:004.out 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:005 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:005.out 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:006 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:006.out 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:007 2023-06-08T03:51:32.609 INFO:teuthology.orchestra.run.smithi043.stdout:007.out 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:008 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:008.out 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:009 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:009.out 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:010 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:010.out 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:011 2023-06-08T03:51:32.610 INFO:teuthology.orchestra.run.smithi043.stdout:011.out 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:012 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:012.out 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:013 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:013.out 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:014 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:014.out 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:015 2023-06-08T03:51:32.611 INFO:teuthology.orchestra.run.smithi043.stdout:015.out 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:016 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:016.out 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:017 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:017.out 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:018 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:018.out 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:019 2023-06-08T03:51:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:019.out 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:020 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:020.out 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:021 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:021.out 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:022 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:022.out 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:023 2023-06-08T03:51:32.613 INFO:teuthology.orchestra.run.smithi043.stdout:023.out 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:024 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:024.out 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:025 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:025.out 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:026 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:026.out 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:027 2023-06-08T03:51:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:027.out 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:028 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:028.out 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:029 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:029.out 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:030 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:030.out 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:031 2023-06-08T03:51:32.615 INFO:teuthology.orchestra.run.smithi043.stdout:031.out 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:032 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:032.out 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:033 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:033.out 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:034 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:034.out 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:035 2023-06-08T03:51:32.616 INFO:teuthology.orchestra.run.smithi043.stdout:035.cfg 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:035.out.default 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:035.out.nfs 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:036 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:036.out 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:037 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:037.out 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:038 2023-06-08T03:51:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:038.out 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:039 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:039.out 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:040 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:040.out 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:041 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:041.out 2023-06-08T03:51:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:042 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:042.out 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:043 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:043.out 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:044 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:044.out 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:045 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:045.out 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:046 2023-06-08T03:51:32.619 INFO:teuthology.orchestra.run.smithi043.stdout:046.out 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:047 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:047.out 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:048 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:048.out 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:049 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:049.out 2023-06-08T03:51:32.620 INFO:teuthology.orchestra.run.smithi043.stdout:050 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:050.cfg 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:050.out.default 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:050.out.nojournal 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:050.out.xfsquota 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:051 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:051.out 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:052 2023-06-08T03:51:32.621 INFO:teuthology.orchestra.run.smithi043.stdout:052.out 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:053 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:053.out 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:054 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:054.out 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:055 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:055.out 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:056 2023-06-08T03:51:32.622 INFO:teuthology.orchestra.run.smithi043.stdout:056.out 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:057 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:057.out 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:058 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:058.out 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:059 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:059.out 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:060 2023-06-08T03:51:32.623 INFO:teuthology.orchestra.run.smithi043.stdout:060.out 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:061 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:061.out 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:062 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:062.out 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:063 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:063.out 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:064 2023-06-08T03:51:32.624 INFO:teuthology.orchestra.run.smithi043.stdout:064.out 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:065 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:065.out 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:066 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:066.out 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:067 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:067.out 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:068 2023-06-08T03:51:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:068.out 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:069 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:069.out 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:070 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:070.out 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:071 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:071.out 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:072 2023-06-08T03:51:32.626 INFO:teuthology.orchestra.run.smithi043.stdout:072.out 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:073 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:073.out 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:074 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:074.out 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:075 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:075.out 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:076 2023-06-08T03:51:32.627 INFO:teuthology.orchestra.run.smithi043.stdout:076.out 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:077 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:077.out 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:078 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:078.out 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:079 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:079.out 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:080 2023-06-08T03:51:32.628 INFO:teuthology.orchestra.run.smithi043.stdout:080.out 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:081 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:081.out 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:082 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:082.out 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:083 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:083.out 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:084 2023-06-08T03:51:32.629 INFO:teuthology.orchestra.run.smithi043.stdout:084.out 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:085 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:085.out 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:086 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:086.out 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:087 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:087.out 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:088 2023-06-08T03:51:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:088.out 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:089 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:089.out 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:090 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:090.out 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:091 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:091.out 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:092 2023-06-08T03:51:32.631 INFO:teuthology.orchestra.run.smithi043.stdout:092.out 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:093 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:093.out 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:094 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:094.out 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:095 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:095.out 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:096 2023-06-08T03:51:32.632 INFO:teuthology.orchestra.run.smithi043.stdout:096.out 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:097 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:097.out 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:098 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:098.out 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:099 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:099.out 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:100 2023-06-08T03:51:32.633 INFO:teuthology.orchestra.run.smithi043.stdout:100.out 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:101 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:101.out 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:102 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:102.out 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:103 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:103.out 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:104 2023-06-08T03:51:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:104.out 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:105 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:105.out 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:106 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:106.out 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:107 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:107.out 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:108 2023-06-08T03:51:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:108.out 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:109 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:109.out 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:110 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:110.out 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:111 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:111.out 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:112 2023-06-08T03:51:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:112.out 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:113 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:113.out 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:114 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:114.out 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:115 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:115.out 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:116 2023-06-08T03:51:32.637 INFO:teuthology.orchestra.run.smithi043.stdout:116.out 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:117 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:117.out 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:118 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:118.out 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:119 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:119.out 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:120 2023-06-08T03:51:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:120.out 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:121 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:121.out 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:122 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:122.out 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:123 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:123.out 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:124 2023-06-08T03:51:32.639 INFO:teuthology.orchestra.run.smithi043.stdout:124.out 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:125 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:125.out 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:126 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:126.out 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:127 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:127.out 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:128 2023-06-08T03:51:32.640 INFO:teuthology.orchestra.run.smithi043.stdout:128.out 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:129 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:129.out 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:130 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:130.out 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:131 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:131.out 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:132 2023-06-08T03:51:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:132.out 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:133 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:133.out 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:134 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:134.out 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:135 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:135.out 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:136 2023-06-08T03:51:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:136.out 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:137 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:137.out 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:138 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:138.out 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:139 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:139.out 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:140 2023-06-08T03:51:32.643 INFO:teuthology.orchestra.run.smithi043.stdout:140.out 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:141 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:141.out 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:142 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:142.out 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:143 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:143.out 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:144 2023-06-08T03:51:32.644 INFO:teuthology.orchestra.run.smithi043.stdout:144.out 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:145 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:145.out 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:146 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:146.out 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:147 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:147.out 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:148 2023-06-08T03:51:32.645 INFO:teuthology.orchestra.run.smithi043.stdout:148.out 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:149 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:149.out 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:150 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:150.out 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:151 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:151.out 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:152 2023-06-08T03:51:32.646 INFO:teuthology.orchestra.run.smithi043.stdout:152.out 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:153 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:153.out 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:154 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:154.out 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:155 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:155.out 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:156 2023-06-08T03:51:32.647 INFO:teuthology.orchestra.run.smithi043.stdout:156.out 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:157 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:157.out 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:158 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:158.out 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:159 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:159.out 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:160 2023-06-08T03:51:32.648 INFO:teuthology.orchestra.run.smithi043.stdout:160.out 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:161 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:161.out 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:162 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:162.out 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:163 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:163.out 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:164 2023-06-08T03:51:32.649 INFO:teuthology.orchestra.run.smithi043.stdout:164.out 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:165 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:165.out 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:166 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:166.out 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:167 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:167.out 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:168 2023-06-08T03:51:32.650 INFO:teuthology.orchestra.run.smithi043.stdout:168.out 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:169 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:169.out 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:170 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:170.out 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:171 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:171.out 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:172 2023-06-08T03:51:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:172.out 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:173 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:173.out 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:174 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:174.out 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:175 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:175.out 2023-06-08T03:51:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:176 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:176.out 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:177 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:177.out 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:178 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:178.out 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:179 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:179.out 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:180 2023-06-08T03:51:32.653 INFO:teuthology.orchestra.run.smithi043.stdout:180.out 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:181 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:181.out 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:182 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:182.out 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:183 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:183.out 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:184 2023-06-08T03:51:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:184.out 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:185 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:185.out 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:186 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:186.out 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:187 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:187.out 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:188 2023-06-08T03:51:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:188.out 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:189 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:189.out 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:190 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:190.out 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:191 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:191.out 2023-06-08T03:51:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:192 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:192.out 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:193 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:193.out 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:194 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:194.out 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:195 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:195.out 2023-06-08T03:51:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:196 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:196.out 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:197 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:197.out 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:198 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:198.out 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:199 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:199.out 2023-06-08T03:51:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:200 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:200.out 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:201 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:201.out 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:202 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:202.out 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:203 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:203.out 2023-06-08T03:51:32.659 INFO:teuthology.orchestra.run.smithi043.stdout:204 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:204.out 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:205 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:205.out 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:206 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:206.out 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:207 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:207.out 2023-06-08T03:51:32.660 INFO:teuthology.orchestra.run.smithi043.stdout:208 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:208.out 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:209 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:209.out 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:210 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:210.out 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:211 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:211.out 2023-06-08T03:51:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:212 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:212.out 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:213 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:213.out 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:214 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:214.out 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:215 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:215.out 2023-06-08T03:51:32.662 INFO:teuthology.orchestra.run.smithi043.stdout:216 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:216.out 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:217 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:217.out 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:218 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:218.out 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:219 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:219.out 2023-06-08T03:51:32.663 INFO:teuthology.orchestra.run.smithi043.stdout:220 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:220.out 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:221 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:221.out 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:222 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:222.out 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:223 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:223.out 2023-06-08T03:51:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:224 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:224.out 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:225 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:225.out 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:226 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:226.out 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:227 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:227.out 2023-06-08T03:51:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:228 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:228.out 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:229 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:229.out 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:230 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:230.out 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:231 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:231.out 2023-06-08T03:51:32.666 INFO:teuthology.orchestra.run.smithi043.stdout:232 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:232.out 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:233 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:233.out 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:234 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:234.out 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:235 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:235.out 2023-06-08T03:51:32.667 INFO:teuthology.orchestra.run.smithi043.stdout:236 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:236.out 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:237 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:237.out 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:238 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:238.out 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:239 2023-06-08T03:51:32.668 INFO:teuthology.orchestra.run.smithi043.stdout:239.out 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:240 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:240.out 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:241 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:241.out 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:242 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:242.out 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:243 2023-06-08T03:51:32.669 INFO:teuthology.orchestra.run.smithi043.stdout:243.out 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:244 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:244.out 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:245 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:245.out 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:246 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:246.out 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:247 2023-06-08T03:51:32.670 INFO:teuthology.orchestra.run.smithi043.stdout:247.out 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:248 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:248.out 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:249 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:249.out 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:250 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:250.out 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:251 2023-06-08T03:51:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:251.out 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:252 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:252.out 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:253 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:253.out 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:254 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:254.out 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:255 2023-06-08T03:51:32.672 INFO:teuthology.orchestra.run.smithi043.stdout:255.out 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:256 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:256.out 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:257 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:257.out 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:258 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:258.out 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:259 2023-06-08T03:51:32.673 INFO:teuthology.orchestra.run.smithi043.stdout:259.out 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:260 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:260.out 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:261 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:261.out 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:262 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:262.out 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:263 2023-06-08T03:51:32.674 INFO:teuthology.orchestra.run.smithi043.stdout:263.out 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:264 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:264.out 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:265 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:265.out 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:266 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:266.out 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:267 2023-06-08T03:51:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:267.out 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:268 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:268.out 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:269 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:269.out 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:270 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:270.out 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:271 2023-06-08T03:51:32.676 INFO:teuthology.orchestra.run.smithi043.stdout:271.out 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:272 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:272.out 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:273 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:273.out 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:274 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:274.out 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:275 2023-06-08T03:51:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:275.out 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:276 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:276.out 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:277 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:277.out 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:278 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:278.out 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:279 2023-06-08T03:51:32.678 INFO:teuthology.orchestra.run.smithi043.stdout:279.out 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:280 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:280.out 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:281 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:281.out 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:282 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:282.out 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:283 2023-06-08T03:51:32.679 INFO:teuthology.orchestra.run.smithi043.stdout:283.out 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:284 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:284.out 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:285 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:285.out 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:286 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:286.out 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:287 2023-06-08T03:51:32.680 INFO:teuthology.orchestra.run.smithi043.stdout:287.out 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:288 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:288.out 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:289 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:289.out 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:290 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:290.out 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:291 2023-06-08T03:51:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:291.out 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:292 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:292.out 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:293 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:293.out 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:294 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:294.out 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:295 2023-06-08T03:51:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:295.out 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:296 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:296.out 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:297 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:297.out 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:298 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:298.out 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:299 2023-06-08T03:51:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:299.out 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:300 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:300.out 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:301 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:301.out 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:302 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:302.out 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:303 2023-06-08T03:51:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:303.out 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:304 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:304.out 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:305 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:305.out 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:306 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:306.out 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:307 2023-06-08T03:51:32.685 INFO:teuthology.orchestra.run.smithi043.stdout:307.out 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:308 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:308.out 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:309 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:309.out 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:310 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:310.out 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:311 2023-06-08T03:51:32.686 INFO:teuthology.orchestra.run.smithi043.stdout:311.out 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:312 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:312.out 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:313 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:313.out 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:314 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:314.out 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:315 2023-06-08T03:51:32.687 INFO:teuthology.orchestra.run.smithi043.stdout:315.out 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:316 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:316.out 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:317 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:317.out 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:318 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:318.out 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:319 2023-06-08T03:51:32.688 INFO:teuthology.orchestra.run.smithi043.stdout:319.out 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:320 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:320.out 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:321 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:321.out 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:322 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:322.out 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:323 2023-06-08T03:51:32.689 INFO:teuthology.orchestra.run.smithi043.stdout:323.out 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:324 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:324.out 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:325 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:325.out 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:326 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:326.out 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:327 2023-06-08T03:51:32.690 INFO:teuthology.orchestra.run.smithi043.stdout:327.out 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:328 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:328.out 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:329 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:329.out 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:330 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:330.out 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:331 2023-06-08T03:51:32.691 INFO:teuthology.orchestra.run.smithi043.stdout:331.out 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:332 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:332.out 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:333 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:333.out 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:334 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:334.out 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:335 2023-06-08T03:51:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:335.out 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:336 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:336.out 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:337 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:337.out 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:338 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:338.out 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:339 2023-06-08T03:51:32.693 INFO:teuthology.orchestra.run.smithi043.stdout:339.out 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:340 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:340.out 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:341 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:341.out 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:342 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:342.out 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:343 2023-06-08T03:51:32.694 INFO:teuthology.orchestra.run.smithi043.stdout:343.out 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:344 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:344.out 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:345 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:345.out 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:346 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:346.out 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:347 2023-06-08T03:51:32.695 INFO:teuthology.orchestra.run.smithi043.stdout:347.out 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:348 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:348.out 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:349 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:349.out 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:350 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:350.out 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:351 2023-06-08T03:51:32.696 INFO:teuthology.orchestra.run.smithi043.stdout:351.out 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:352 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:352.out 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:353 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:353.out 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:354 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:354.out 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:355 2023-06-08T03:51:32.697 INFO:teuthology.orchestra.run.smithi043.stdout:355.out 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:356 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:356.out 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:357 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:357.out 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:358 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:358.out 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:359 2023-06-08T03:51:32.698 INFO:teuthology.orchestra.run.smithi043.stdout:359.out 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:360 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:360.out 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:361 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:361.out 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:362 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:362.out 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:363 2023-06-08T03:51:32.699 INFO:teuthology.orchestra.run.smithi043.stdout:363.out 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:364 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:364.out 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:365 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:365.out 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:366 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:366.out 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:367 2023-06-08T03:51:32.700 INFO:teuthology.orchestra.run.smithi043.stdout:367.out 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:368 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:368.out 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:369 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:369.out 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:370 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:370.out 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:371 2023-06-08T03:51:32.701 INFO:teuthology.orchestra.run.smithi043.stdout:371.out 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:372 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:372.out 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:373 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:373.out 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:374 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:374.out 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:375 2023-06-08T03:51:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:375.out 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:376 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:376.out 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:377 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:377.out 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:378 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:378.out 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:379 2023-06-08T03:51:32.703 INFO:teuthology.orchestra.run.smithi043.stdout:379.out 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:380 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:380.out 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:381 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:381.out 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:382 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:382.out 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:383 2023-06-08T03:51:32.704 INFO:teuthology.orchestra.run.smithi043.stdout:383.out 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:384 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:384.out 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:385 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:385.out 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:386 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:386.out 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:387 2023-06-08T03:51:32.705 INFO:teuthology.orchestra.run.smithi043.stdout:387.out 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:388 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:388.out 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:389 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:389.out 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:390 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:390.out 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:391 2023-06-08T03:51:32.706 INFO:teuthology.orchestra.run.smithi043.stdout:391.out 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:392 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:392.out 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:393 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:393.out 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:394 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:394.out 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:395 2023-06-08T03:51:32.707 INFO:teuthology.orchestra.run.smithi043.stdout:395.out 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:396 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:396.out 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:397 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:397.out 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:398 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:398.out 2023-06-08T03:51:32.708 INFO:teuthology.orchestra.run.smithi043.stdout:399 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:399.out 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:400 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:400.out 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:401 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:401.out 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:402 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:402.out 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:403 2023-06-08T03:51:32.709 INFO:teuthology.orchestra.run.smithi043.stdout:403.out 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:404 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:404.out 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:405 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:405.out 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:406 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:406.out 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:407 2023-06-08T03:51:32.710 INFO:teuthology.orchestra.run.smithi043.stdout:407.out 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:408 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:408.out 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:409 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:409.out 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:410 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:410.out 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:411 2023-06-08T03:51:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:411.out 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:412 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:412.out 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:413 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:413.out 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:414 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:414.out 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:415 2023-06-08T03:51:32.712 INFO:teuthology.orchestra.run.smithi043.stdout:415.out 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:416 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:416.out 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:417 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:417.out 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:418 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:418.out 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:419 2023-06-08T03:51:32.713 INFO:teuthology.orchestra.run.smithi043.stdout:419.out 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:420 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:420.out 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:421 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:421.out 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:422 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:422.out 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:423 2023-06-08T03:51:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:423.out 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:424 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:424.out 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:425 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:425.out 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:426 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:426.out 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:427 2023-06-08T03:51:32.715 INFO:teuthology.orchestra.run.smithi043.stdout:427.out 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:428 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:428.out 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:429 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:429.out 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:430 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:430.out 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:431 2023-06-08T03:51:32.716 INFO:teuthology.orchestra.run.smithi043.stdout:431.out 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:432 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:432.out 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:433 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:433.out 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:434 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:434.out 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:435 2023-06-08T03:51:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:435.out 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:436 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:436.out 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:437 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:437.out 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:438 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:438.out 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:439 2023-06-08T03:51:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:439.out 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:440 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:440.out 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:441 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:441.out 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:442 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:442.out 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:443 2023-06-08T03:51:32.719 INFO:teuthology.orchestra.run.smithi043.stdout:443.out 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:444 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:444.out 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:445 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:445.out 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:446 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:446.out 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:447 2023-06-08T03:51:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:447.out 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:448 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:448.out 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:449 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:449.out 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:450 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:450.out 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:451 2023-06-08T03:51:32.721 INFO:teuthology.orchestra.run.smithi043.stdout:451.out 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:452 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:452.out 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:453 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:453.out 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:454 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:454.out 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:455 2023-06-08T03:51:32.722 INFO:teuthology.orchestra.run.smithi043.stdout:455.out 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:456 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:456.out 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:457 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:457.out 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:458 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:458.out 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:459 2023-06-08T03:51:32.723 INFO:teuthology.orchestra.run.smithi043.stdout:459.out 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:460 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:460.out 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:461 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:461.out 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:462 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:462.out 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:463 2023-06-08T03:51:32.724 INFO:teuthology.orchestra.run.smithi043.stdout:463.out 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:464 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:464.out 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:465 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:465.out 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:466 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:466.out 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:467 2023-06-08T03:51:32.725 INFO:teuthology.orchestra.run.smithi043.stdout:467.out 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:468 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:468.out 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:469 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:469.out 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:470 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:470.out 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:471 2023-06-08T03:51:32.726 INFO:teuthology.orchestra.run.smithi043.stdout:471.out 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:472 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:472.out 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:473 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:473.out 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:474 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:474.out 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:475 2023-06-08T03:51:32.727 INFO:teuthology.orchestra.run.smithi043.stdout:475.out 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:476 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:476.out 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:477 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:477.out 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:478 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:478.out 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:479 2023-06-08T03:51:32.728 INFO:teuthology.orchestra.run.smithi043.stdout:479.out 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:480 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:480.out 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:481 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:481.out 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:482 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:482.out 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:483 2023-06-08T03:51:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:483.out 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:484 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:484.out 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:485 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:485.out 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:486 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:486.out 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:487 2023-06-08T03:51:32.730 INFO:teuthology.orchestra.run.smithi043.stdout:487.out 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:488 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:488.out 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:489 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:489.out 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:490 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:490.out 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:491 2023-06-08T03:51:32.731 INFO:teuthology.orchestra.run.smithi043.stdout:491.out 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:492 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:492.out 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:493 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:493.out 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:494 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:494.out 2023-06-08T03:51:32.732 INFO:teuthology.orchestra.run.smithi043.stdout:495 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:495.out 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:496 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:496.out 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:497 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:497.out 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:498 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:498.out 2023-06-08T03:51:32.733 INFO:teuthology.orchestra.run.smithi043.stdout:499 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:499.out 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:500 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:500.out 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:501 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:501.out 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:502 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:502.out 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:503 2023-06-08T03:51:32.734 INFO:teuthology.orchestra.run.smithi043.stdout:503.out 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:504 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:504.out 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:505 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:505.out 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:506 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:506.out 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:507 2023-06-08T03:51:32.735 INFO:teuthology.orchestra.run.smithi043.stdout:507.out 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:508 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:508.out 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:509 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:509.out 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:510 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:510.out 2023-06-08T03:51:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:511 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:511.out 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:512 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:512.out 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:513 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:513.out 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:514 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:514.out 2023-06-08T03:51:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:515 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:515.out 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:516 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:516.out 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:517 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:517.out 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:518 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:518.out 2023-06-08T03:51:32.738 INFO:teuthology.orchestra.run.smithi043.stdout:519 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:519.out 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:520 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:520.out 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:521 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:521.out 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:522 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:522.out 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:523 2023-06-08T03:51:32.739 INFO:teuthology.orchestra.run.smithi043.stdout:523.out 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:524 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:524.out 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:525 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:525.out 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:526 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:526.out 2023-06-08T03:51:32.740 INFO:teuthology.orchestra.run.smithi043.stdout:527 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:527.out 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:528 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:528.out 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:529 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:529.out 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:530 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:530.out 2023-06-08T03:51:32.741 INFO:teuthology.orchestra.run.smithi043.stdout:531 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:531.out 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:532 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:532.out 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:533 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:533.out 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:534 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:534.out 2023-06-08T03:51:32.742 INFO:teuthology.orchestra.run.smithi043.stdout:535 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:535.out 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:536 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:536.out 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:537 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:537.out 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:538 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:538.out 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:539 2023-06-08T03:51:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:539.out 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:540 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:540.out 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:541 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:541.out 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:542 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:542.out 2023-06-08T03:51:32.744 INFO:teuthology.orchestra.run.smithi043.stdout:543 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:543.out 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:544 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:544.out 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:545 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:545.out 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:546 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:546.out 2023-06-08T03:51:32.745 INFO:teuthology.orchestra.run.smithi043.stdout:547 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:547.out 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:548 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:548.out 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:549 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:549.out 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:550 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:550.out 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:551 2023-06-08T03:51:32.746 INFO:teuthology.orchestra.run.smithi043.stdout:551.out 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:552 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:552.out 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:553 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:553.out 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:554 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:554.out 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:555 2023-06-08T03:51:32.747 INFO:teuthology.orchestra.run.smithi043.stdout:555.out 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:556 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:556.out 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:557 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:557.out 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:558 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:558.out 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:559 2023-06-08T03:51:32.748 INFO:teuthology.orchestra.run.smithi043.stdout:559.out 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:560 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:560.out 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:561 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:561.out 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:562 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:562.out 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:563 2023-06-08T03:51:32.749 INFO:teuthology.orchestra.run.smithi043.stdout:563.out 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:564 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:564.out 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:565 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:565.out 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:566 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:566.out 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:567 2023-06-08T03:51:32.750 INFO:teuthology.orchestra.run.smithi043.stdout:567.out 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:568 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:568.out 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:569 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:569.out 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:570 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:570.out 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:571 2023-06-08T03:51:32.751 INFO:teuthology.orchestra.run.smithi043.stdout:571.out 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:572 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:572.out 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:573 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:573.out 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:574 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:574.out 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:575 2023-06-08T03:51:32.752 INFO:teuthology.orchestra.run.smithi043.stdout:575.out 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:576 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:576.out 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:577 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:577.out 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:578 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:578.out 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:579 2023-06-08T03:51:32.753 INFO:teuthology.orchestra.run.smithi043.stdout:579.out 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:580 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:580.out 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:581 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:581.out 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:582 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:582.out 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:583 2023-06-08T03:51:32.754 INFO:teuthology.orchestra.run.smithi043.stdout:583.out 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:584 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:584.out 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:585 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:585.out 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:586 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:586.out 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:587 2023-06-08T03:51:32.755 INFO:teuthology.orchestra.run.smithi043.stdout:587.out 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:588 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:588.out 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:589 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:589.out 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:590 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:590.out 2023-06-08T03:51:32.756 INFO:teuthology.orchestra.run.smithi043.stdout:591 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:591.out 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:592 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:592.out 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:593 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:593.out 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:594 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:594.out 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:595 2023-06-08T03:51:32.757 INFO:teuthology.orchestra.run.smithi043.stdout:595.out 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:596 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:596.out 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:597 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:597.out 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:598 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:598.out 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:599 2023-06-08T03:51:32.758 INFO:teuthology.orchestra.run.smithi043.stdout:599.out 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:600 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:600.out 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:601 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:601.out 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:602 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:602.out 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:603 2023-06-08T03:51:32.759 INFO:teuthology.orchestra.run.smithi043.stdout:603.out 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:604 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:604.out 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:605 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:605.out 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:606 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:606.out 2023-06-08T03:51:32.760 INFO:teuthology.orchestra.run.smithi043.stdout:607 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:607.out 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:608 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:608.out 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:609 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:609.out 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:610 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:610.out 2023-06-08T03:51:32.761 INFO:teuthology.orchestra.run.smithi043.stdout:611 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:611.out 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:612 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:612.out 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:613 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:613.out 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:614 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:614.out 2023-06-08T03:51:32.762 INFO:teuthology.orchestra.run.smithi043.stdout:615 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:615.out 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:616 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:616.out 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:617 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:617.out 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:618 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:618.out 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:619 2023-06-08T03:51:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:619.out 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:620 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:620.out 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:621 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:621.out 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:622 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:622.out 2023-06-08T03:51:32.764 INFO:teuthology.orchestra.run.smithi043.stdout:623 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:623.out 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:624 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:624.out 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:625 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:625.out 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:626 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:626.out 2023-06-08T03:51:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:627 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:627.out 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:628 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:628.out 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:629 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:629.out 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:630 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:630.out 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:631 2023-06-08T03:51:32.766 INFO:teuthology.orchestra.run.smithi043.stdout:631.out 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:632 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:632.out 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:633 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:633.out 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:634 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:634.out 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:635 2023-06-08T03:51:32.767 INFO:teuthology.orchestra.run.smithi043.stdout:635.out 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:636 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:636.out 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:637 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:637.out 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:638 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:638.out 2023-06-08T03:51:32.768 INFO:teuthology.orchestra.run.smithi043.stdout:639 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:639.out 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:640 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:640.out 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:641 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:641.out 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:642 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:642.out 2023-06-08T03:51:32.769 INFO:teuthology.orchestra.run.smithi043.stdout:643 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:643.out 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:644 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:644.out 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:645 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:645.out 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:646 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:646.out 2023-06-08T03:51:32.770 INFO:teuthology.orchestra.run.smithi043.stdout:647 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:647.out 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:648 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:648.out 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:649 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:649.out 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:650 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:650.out 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:651 2023-06-08T03:51:32.771 INFO:teuthology.orchestra.run.smithi043.stdout:651.out 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:652 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:652.out 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:653 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:653.out 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:654 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:654.out 2023-06-08T03:51:32.772 INFO:teuthology.orchestra.run.smithi043.stdout:655 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:655.out 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:656 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:656.out 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:657 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:657.out 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:658 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:658.out 2023-06-08T03:51:32.773 INFO:teuthology.orchestra.run.smithi043.stdout:659 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:659.out 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:660 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:660.out 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:661 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:661.out 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:662 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:662.out 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:663 2023-06-08T03:51:32.774 INFO:teuthology.orchestra.run.smithi043.stdout:663.out 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:664 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:664.out 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:665 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:665.out 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:666 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:666.out 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:667 2023-06-08T03:51:32.775 INFO:teuthology.orchestra.run.smithi043.stdout:667.out 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:668 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:668.out 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:669 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:669.out 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:670 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:670.out 2023-06-08T03:51:32.776 INFO:teuthology.orchestra.run.smithi043.stdout:671 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:671.out 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:672 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:672.out 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:673 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:673.out 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:674 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:674.out 2023-06-08T03:51:32.777 INFO:teuthology.orchestra.run.smithi043.stdout:675 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:675.out 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:676 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:676.out 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:677 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:677.out 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:678 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:678.out 2023-06-08T03:51:32.778 INFO:teuthology.orchestra.run.smithi043.stdout:679 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:679.out 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:680 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:680.out 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:681 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:681.out 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:682 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:682.out 2023-06-08T03:51:32.779 INFO:teuthology.orchestra.run.smithi043.stdout:683 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:683.out 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:684 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:684.out 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:685 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:685.out 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:686 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:686.out 2023-06-08T03:51:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:687 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:687.out 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:688 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:688.out 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:689 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:689.out 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:690 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:690.out 2023-06-08T03:51:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:691 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:691.out 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:692 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:692.out 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:693 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:693.out 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:694 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:694.out 2023-06-08T03:51:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:695 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:695.out 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:696 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:696.out 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:697 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:697.out 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:698 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:698.out 2023-06-08T03:51:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:699 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:699.out 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:700 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:700.out 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:701 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:701.out 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:702 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:702.out 2023-06-08T03:51:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:703 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:703.out 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:704 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:704.out 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:705 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:705.out 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:706 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:706.out 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:707 2023-06-08T03:51:32.785 INFO:teuthology.orchestra.run.smithi043.stdout:707.out 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:708 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:708.out 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:709 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:709.out 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:710 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:710.out 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:711 2023-06-08T03:51:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:711.out 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:712 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:712.out 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:713 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:713.out 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:714 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:714.out 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:715 2023-06-08T03:51:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:715.out 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:716 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:716.out 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:717 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:717.out 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:718 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:718.out 2023-06-08T03:51:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:719 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:719.out 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:720 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:720.out 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:721 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:721.out 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:722 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:722.out 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:723 2023-06-08T03:51:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:723.out 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:724 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:724.out 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:725 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:725.out 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:726 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:726.out 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:727 2023-06-08T03:51:32.790 INFO:teuthology.orchestra.run.smithi043.stdout:727.out 2023-06-08T03:51:32.791 INFO:teuthology.orchestra.run.smithi043.stdout:group.list 2023-06-08T03:51:32.791 INFO:teuthology.orchestra.run.smithi043.stdout:Makefile 2023-06-08T03:51:32.791 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-08T03:51:33.024 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:51:33.028 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:51:33.029 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:51:33.030 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:51:33.030 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:37.765 INFO:teuthology.orchestra.run.smithi043.stdout:generic/001 4s 2023-06-08T03:51:37.770 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/001 2023-06-08T03:51:37.770 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:51:37.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:38.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:51:38.488 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-08T03:51:38.706 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:51:38.710 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:51:38.711 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:51:38.712 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:51:38.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:39.189 INFO:teuthology.orchestra.run.smithi043.stdout:generic/002 1s 2023-06-08T03:51:39.194 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/002 2023-06-08T03:51:39.194 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:51:39.196 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:39.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:51:39.262 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-08T03:51:39.641 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:51:39.650 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:51:39.651 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:51:39.652 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:51:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:40.027 INFO:teuthology.orchestra.run.smithi043.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-08T03:51:40.031 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/003 2023-06-08T03:51:40.031 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/003 2023-06-08T03:51:40.031 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:51:40.033 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:40.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:51:40.061 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-08T03:51:40.281 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:51:40.285 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:51:40.285 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:51:40.286 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:51:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:40.623 INFO:teuthology.orchestra.run.smithi043.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-08T03:51:40.627 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/004 2023-06-08T03:51:40.627 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/004 2023-06-08T03:51:40.627 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:51:40.629 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:40.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:51:40.650 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-08T03:51:40.868 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:51:40.872 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:51:40.872 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:51:40.873 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:51:40.873 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:41.361 INFO:teuthology.orchestra.run.smithi043.stdout:generic/005 0s 2023-06-08T03:51:41.366 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/005 2023-06-08T03:51:41.366 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:51:41.368 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:41.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:51:41.464 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-08T03:51:41.691 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:51:41.695 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:51:41.695 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:51:41.696 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:51:41.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:51:53.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:51:53.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:52:06.444 INFO:teuthology.orchestra.run.smithi043.stdout:generic/006 25s 2023-06-08T03:52:06.504 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/006 2023-06-08T03:52:06.504 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:52:06.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:06.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:52:06.552 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-08T03:52:06.925 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:52:06.929 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:52:06.930 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:52:06.931 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:52:06.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:23.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:52:23.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:52:54.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:52:54.233 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:52:56.959 INFO:teuthology.orchestra.run.smithi043.stdout:generic/007 49s 2023-06-08T03:52:56.964 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/007 2023-06-08T03:52:56.964 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:52:56.966 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:57.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:52:57.061 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-08T03:52:57.283 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:52:57.287 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:52:57.288 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:52:57.289 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:52:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:57.724 INFO:teuthology.orchestra.run.smithi043.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T03:52:57.728 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/008 2023-06-08T03:52:57.729 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/008 2023-06-08T03:52:57.729 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:52:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:57.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:52:57.767 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-08T03:52:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:52:57.982 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:52:57.982 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:52:57.983 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:52:57.983 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:58.371 INFO:teuthology.orchestra.run.smithi043.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T03:52:58.375 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/009 2023-06-08T03:52:58.375 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/009 2023-06-08T03:52:58.375 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:52:58.378 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:58.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:52:58.398 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-08T03:52:58.619 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:52:58.623 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:52:58.624 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:52:58.625 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:52:58.625 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:58.949 INFO:teuthology.orchestra.run.smithi043.stdout:generic/010 [not run] /tmp/tmp.CQ6jNRznugxfstests-dev/src/dbtest not built 2023-06-08T03:52:58.953 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/010 2023-06-08T03:52:58.953 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/010 2023-06-08T03:52:58.953 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:52:58.955 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:52:58.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:52:58.973 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-08T03:52:59.193 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:52:59.197 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:52:59.198 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:52:59.199 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:52:59.199 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:53:24.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:53:24.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:53:29.994 INFO:teuthology.orchestra.run.smithi043.stdout:generic/011 30s 2023-06-08T03:53:29.998 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/011 2023-06-08T03:53:29.998 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:53:30.000 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:53:30.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:53:30.260 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-08T03:53:30.466 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:53:30.470 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:53:30.470 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:53:30.471 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:53:30.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:53:30.969 INFO:teuthology.orchestra.run.smithi043.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T03:53:30.973 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/012 2023-06-08T03:53:30.973 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/012 2023-06-08T03:53:30.974 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:53:30.975 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:53:31.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:53:31.041 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-08T03:53:31.271 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:53:31.275 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:53:31.275 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:53:31.276 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:53:31.276 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:53:54.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:53:54.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:54:25.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:54:25.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:54:41.096 INFO:teuthology.orchestra.run.smithi043.stdout:generic/013 70s 2023-06-08T03:54:41.169 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/013 2023-06-08T03:54:41.170 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:54:41.174 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:54:41.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:54:41.203 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-08T03:54:41.555 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:54:41.563 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:54:41.563 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:54:41.564 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:54:41.565 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:54:55.273 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:54:55.276 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:55:25.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:55:25.397 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:55:55.811 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:55:55.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:56:25.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:56:25.926 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:56:56.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:56:56.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:57:26.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:57:26.169 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:57:56.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:57:56.293 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:58:26.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:58:26.413 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:58:56.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:58:56.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:59:26.559 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:59:26.569 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:59:36.939 INFO:teuthology.orchestra.run.smithi043.stdout:generic/014 295s 2023-06-08T03:59:36.951 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/014 2023-06-08T03:59:36.952 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:37.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:37.011 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-08T03:59:37.397 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:37.403 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:37.403 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:37.404 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:37.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:37.918 INFO:teuthology.orchestra.run.smithi043.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T03:59:37.931 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/015 2023-06-08T03:59:37.931 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/015 2023-06-08T03:59:37.931 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:37.933 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:37.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:37.972 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-08T03:59:38.355 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:38.366 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:38.367 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:38.370 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:39.037 INFO:teuthology.orchestra.run.smithi043.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T03:59:39.041 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/016 2023-06-08T03:59:39.041 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/016 2023-06-08T03:59:39.042 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:39.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:39.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:39.319 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-08T03:59:39.815 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:39.820 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:39.820 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:39.821 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:39.821 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:40.401 INFO:teuthology.orchestra.run.smithi043.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T03:59:40.412 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/017 2023-06-08T03:59:40.413 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/017 2023-06-08T03:59:40.413 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:40.415 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:40.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:40.448 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-08T03:59:40.816 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:40.825 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:40.828 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:40.833 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:40.833 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:41.564 INFO:teuthology.orchestra.run.smithi043.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-08T03:59:41.585 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/018 2023-06-08T03:59:41.586 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/018 2023-06-08T03:59:41.586 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:41.588 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:41.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:41.628 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-08T03:59:42.017 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:42.033 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:42.034 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:42.037 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:42.037 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:42.540 INFO:teuthology.orchestra.run.smithi043.stdout:generic/019 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T03:59:42.545 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/019 2023-06-08T03:59:42.545 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/019 2023-06-08T03:59:42.545 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:42.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:42.577 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-08T03:59:42.975 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:42.980 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:42.980 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:42.981 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:47.064 INFO:teuthology.orchestra.run.smithi043.stdout:generic/020 4s 2023-06-08T03:59:47.074 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/020 2023-06-08T03:59:47.074 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:47.077 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:47.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:47.200 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-08T03:59:47.821 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:47.825 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:47.826 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:47.827 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:47.828 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:48.509 INFO:teuthology.orchestra.run.smithi043.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T03:59:48.515 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/021 2023-06-08T03:59:48.515 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/021 2023-06-08T03:59:48.515 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:48.518 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:48.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:48.877 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-08T03:59:49.234 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:49.247 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:49.248 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:49.249 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:49.249 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:49.912 INFO:teuthology.orchestra.run.smithi043.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T03:59:49.918 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/022 2023-06-08T03:59:49.918 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/022 2023-06-08T03:59:49.918 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T03:59:49.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:50.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T03:59:50.251 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-08T03:59:50.656 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T03:59:50.664 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T03:59:50.664 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T03:59:50.665 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T03:59:50.666 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T03:59:56.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T03:59:56.963 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:27.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:27.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:51.239 INFO:teuthology.orchestra.run.smithi043.stdout:generic/023 61s 2023-06-08T04:00:51.244 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/023 2023-06-08T04:00:51.245 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:00:51.247 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:51.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:00:51.656 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-08T04:00:51.876 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:00:51.880 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:00:51.880 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:00:51.881 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:00:51.881 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:52.223 INFO:teuthology.orchestra.run.smithi043.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-08T04:00:52.227 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/024 2023-06-08T04:00:52.227 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/024 2023-06-08T04:00:52.227 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:00:52.229 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:52.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:00:52.519 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-08T04:00:52.805 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:00:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:00:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:00:52.811 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:00:52.811 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:53.159 INFO:teuthology.orchestra.run.smithi043.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-08T04:00:53.163 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/025 2023-06-08T04:00:53.163 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/025 2023-06-08T04:00:53.163 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:00:53.165 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:53.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:00:53.485 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-08T04:00:53.718 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:00:53.722 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:00:53.723 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:00:53.724 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:00:53.724 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:54.093 INFO:teuthology.orchestra.run.smithi043.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-08T04:00:54.097 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/026 2023-06-08T04:00:54.098 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/026 2023-06-08T04:00:54.098 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:00:54.099 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:54.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:00:54.127 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-08T04:00:54.344 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:00:54.348 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:00:54.349 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:00:54.350 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:00:54.350 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:54.672 INFO:teuthology.orchestra.run.smithi043.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:00:54.676 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/027 2023-06-08T04:00:54.676 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/027 2023-06-08T04:00:54.677 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:00:54.678 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:54.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:00:54.706 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-08T04:00:54.916 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:00:54.920 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:00:54.920 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:00:54.921 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:00:54.921 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:00:57.442 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:57.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:00.237 INFO:teuthology.orchestra.run.smithi043.stdout:generic/028 5s 2023-06-08T04:01:00.242 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/028 2023-06-08T04:01:00.242 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:00.244 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:00.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:00.271 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-08T04:01:00.491 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:00.495 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:00.495 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:00.496 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:00.496 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:02.704 INFO:teuthology.orchestra.run.smithi043.stdout:generic/029 2s 2023-06-08T04:01:02.709 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/029 2023-06-08T04:01:02.709 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:02.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:02.720 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-08T04:01:02.938 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:02.942 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:02.943 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:02.944 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:06.580 INFO:teuthology.orchestra.run.smithi043.stdout:generic/030 3s 2023-06-08T04:01:06.585 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/030 2023-06-08T04:01:06.585 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:06.587 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:06.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:06.596 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-08T04:01:06.818 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:06.823 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:06.824 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:07.240 INFO:teuthology.orchestra.run.smithi043.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-08T04:01:07.243 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/031 2023-06-08T04:01:07.244 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/031 2023-06-08T04:01:07.244 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:07.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:07.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:07.267 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-08T04:01:07.492 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:07.496 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:07.497 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:07.498 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:07.498 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:07.843 INFO:teuthology.orchestra.run.smithi043.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:01:07.847 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/032 2023-06-08T04:01:07.847 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/032 2023-06-08T04:01:07.847 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:07.849 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:07.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:07.870 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-08T04:01:08.092 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:08.096 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:08.097 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:08.098 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:08.098 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:08.506 INFO:teuthology.orchestra.run.smithi043.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T04:01:08.510 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/033 2023-06-08T04:01:08.510 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/033 2023-06-08T04:01:08.510 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:08.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:08.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:08.538 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-08T04:01:08.759 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:08.763 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:08.763 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:08.764 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:08.764 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:09.119 INFO:teuthology.orchestra.run.smithi043.stdout:generic/034 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:09.123 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/034 2023-06-08T04:01:09.124 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/034 2023-06-08T04:01:09.124 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:09.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:09.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:09.152 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-08T04:01:09.373 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:09.377 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:09.377 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:09.378 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:09.378 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:09.752 INFO:teuthology.orchestra.run.smithi043.stdout:generic/035 0s 2023-06-08T04:01:09.757 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/035 2023-06-08T04:01:09.757 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:09.759 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:09.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:09.938 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-08T04:01:10.341 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:10.345 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:10.346 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:10.347 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:10.347 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:20.790 INFO:teuthology.orchestra.run.smithi043.stdout:generic/036 10s 2023-06-08T04:01:20.794 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/036 2023-06-08T04:01:20.795 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:20.796 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:21.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:21.014 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-08T04:01:21.349 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:21.353 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:21.353 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:21.354 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:21.354 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:24.095 INFO:teuthology.orchestra.run.smithi043.stdout:generic/037 3s 2023-06-08T04:01:24.099 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/037 2023-06-08T04:01:24.100 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:24.101 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:24.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:24.110 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-08T04:01:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:24.335 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:24.677 INFO:teuthology.orchestra.run.smithi043.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:01:24.680 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/038 2023-06-08T04:01:24.681 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/038 2023-06-08T04:01:24.681 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:24.683 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:24.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:24.715 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-08T04:01:24.933 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:24.937 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:24.937 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:24.938 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:24.938 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:25.289 INFO:teuthology.orchestra.run.smithi043.stdout:generic/039 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:25.293 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/039 2023-06-08T04:01:25.293 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/039 2023-06-08T04:01:25.293 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:25.295 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:25.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:25.328 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-08T04:01:25.549 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:25.553 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:25.554 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:25.555 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:25.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:25.913 INFO:teuthology.orchestra.run.smithi043.stdout:generic/040 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:25.916 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/040 2023-06-08T04:01:25.917 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/040 2023-06-08T04:01:25.917 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:25.919 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:25.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:25.947 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-08T04:01:26.173 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:26.177 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:26.178 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:26.179 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:26.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:26.539 INFO:teuthology.orchestra.run.smithi043.stdout:generic/041 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:26.543 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/041 2023-06-08T04:01:26.544 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/041 2023-06-08T04:01:26.544 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:26.546 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:26.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:26.572 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-08T04:01:26.793 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:26.797 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:26.797 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:26.798 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:26.798 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:27.299 INFO:teuthology.orchestra.run.smithi043.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-08T04:01:27.312 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/042 2023-06-08T04:01:27.312 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/042 2023-06-08T04:01:27.312 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:27.314 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:27.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:27.334 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-08T04:01:27.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:27.514 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:27.557 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:27.561 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:27.562 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:27.563 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:27.563 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:28.064 INFO:teuthology.orchestra.run.smithi043.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-08T04:01:28.080 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/043 2023-06-08T04:01:28.080 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/043 2023-06-08T04:01:28.080 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:28.082 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:28.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:28.108 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-08T04:01:28.334 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:28.338 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:28.339 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:28.340 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:28.340 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:28.837 INFO:teuthology.orchestra.run.smithi043.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-08T04:01:28.853 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/044 2023-06-08T04:01:28.854 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/044 2023-06-08T04:01:28.854 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:28.856 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:28.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:28.879 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-08T04:01:29.096 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:29.100 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:29.100 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:29.101 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:29.101 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:29.601 INFO:teuthology.orchestra.run.smithi043.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-08T04:01:29.627 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/045 2023-06-08T04:01:29.627 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/045 2023-06-08T04:01:29.627 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:29.629 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:29.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:29.650 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-08T04:01:29.868 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:29.872 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:29.872 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:29.873 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:29.873 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:30.385 INFO:teuthology.orchestra.run.smithi043.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-08T04:01:30.400 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/046 2023-06-08T04:01:30.400 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/046 2023-06-08T04:01:30.400 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:30.402 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:30.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:30.430 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-08T04:01:30.647 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:30.651 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:30.651 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:30.652 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:30.652 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:31.152 INFO:teuthology.orchestra.run.smithi043.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-08T04:01:31.171 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/047 2023-06-08T04:01:31.171 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/047 2023-06-08T04:01:31.172 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:31.173 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:31.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:31.202 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-08T04:01:31.427 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:31.431 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:31.431 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:31.433 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:31.433 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:31.935 INFO:teuthology.orchestra.run.smithi043.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-08T04:01:31.954 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/048 2023-06-08T04:01:31.955 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/048 2023-06-08T04:01:31.955 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:31.957 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:31.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:31.978 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-08T04:01:32.207 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:32.211 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:32.212 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:32.213 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:32.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-08T04:01:32.736 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/049 2023-06-08T04:01:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/049 2023-06-08T04:01:32.737 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:32.739 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:32.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:32.762 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-08T04:01:32.981 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:32.985 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:32.985 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:32.986 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:32.986 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:33.492 INFO:teuthology.orchestra.run.smithi043.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-08T04:01:33.515 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/050 2023-06-08T04:01:33.515 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/050 2023-06-08T04:01:33.515 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:33.517 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:33.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:33.538 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-08T04:01:33.759 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:33.763 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:33.763 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:33.764 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:33.764 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:34.290 INFO:teuthology.orchestra.run.smithi043.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-08T04:01:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/051 2023-06-08T04:01:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/051 2023-06-08T04:01:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:34.296 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:34.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:34.317 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-08T04:01:34.539 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:34.543 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:34.543 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:34.544 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:34.544 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:35.037 INFO:teuthology.orchestra.run.smithi043.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-08T04:01:35.053 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/052 2023-06-08T04:01:35.054 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/052 2023-06-08T04:01:35.054 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:35.056 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:35.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:35.076 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-08T04:01:35.297 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:35.301 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:35.301 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:35.302 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:35.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:36.304 INFO:teuthology.orchestra.run.smithi043.stdout:generic/053 1s 2023-06-08T04:01:36.315 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/053 2023-06-08T04:01:36.315 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:36.319 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:36.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:36.332 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-08T04:01:36.549 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:36.553 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:36.554 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:36.555 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:36.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:37.078 INFO:teuthology.orchestra.run.smithi043.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-08T04:01:37.098 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/054 2023-06-08T04:01:37.098 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/054 2023-06-08T04:01:37.099 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:37.100 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:37.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:37.124 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-08T04:01:37.347 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:37.351 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:37.352 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:37.352 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:37.353 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-08T04:01:37.887 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/055 2023-06-08T04:01:37.888 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/055 2023-06-08T04:01:37.888 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:37.890 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:37.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:37.910 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-08T04:01:38.129 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:38.133 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:38.133 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:38.134 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:38.134 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:38.487 INFO:teuthology.orchestra.run.smithi043.stdout:generic/056 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:38.491 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/056 2023-06-08T04:01:38.491 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/056 2023-06-08T04:01:38.491 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:38.493 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:38.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:38.529 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-08T04:01:38.750 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:38.754 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:38.755 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:38.756 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:38.756 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:39.113 INFO:teuthology.orchestra.run.smithi043.stdout:generic/057 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:39.117 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/057 2023-06-08T04:01:39.117 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/057 2023-06-08T04:01:39.117 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:39.119 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:39.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:39.147 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-08T04:01:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:39.372 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:39.373 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:39.373 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:39.788 INFO:teuthology.orchestra.run.smithi043.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:01:39.792 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/058 2023-06-08T04:01:39.792 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/058 2023-06-08T04:01:39.792 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:39.794 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:40.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:40.138 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-08T04:01:40.375 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:40.379 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:40.379 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:40.380 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:40.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:40.720 INFO:teuthology.orchestra.run.smithi043.stdout:generic/059 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:40.724 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/059 2023-06-08T04:01:40.724 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/059 2023-06-08T04:01:40.724 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:40.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:40.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:40.747 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-08T04:01:40.969 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:40.973 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:40.973 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:40.974 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:40.974 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:41.400 INFO:teuthology.orchestra.run.smithi043.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:01:41.405 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/060 2023-06-08T04:01:41.405 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/060 2023-06-08T04:01:41.405 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:41.407 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:41.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:41.746 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-08T04:01:41.991 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:41.995 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:41.995 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:41.996 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:41.996 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:42.409 INFO:teuthology.orchestra.run.smithi043.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:01:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/061 2023-06-08T04:01:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/061 2023-06-08T04:01:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:42.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:42.787 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-08T04:01:43.006 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:43.010 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:43.011 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:43.011 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:44.908 INFO:teuthology.orchestra.run.smithi043.stdout:generic/062 1s 2023-06-08T04:01:44.920 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/062 2023-06-08T04:01:44.921 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:44.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:44.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:44.938 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-08T04:01:45.153 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:45.157 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:45.158 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:45.159 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:45.159 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:45.763 INFO:teuthology.orchestra.run.smithi043.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:01:45.767 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/063 2023-06-08T04:01:45.767 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/063 2023-06-08T04:01:45.767 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:45.769 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:46.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:46.133 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-08T04:01:46.485 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:46.490 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:46.490 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:46.491 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:46.491 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:46.831 INFO:teuthology.orchestra.run.smithi043.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T04:01:46.835 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/064 2023-06-08T04:01:46.835 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/064 2023-06-08T04:01:46.835 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:46.837 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:46.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:46.865 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-08T04:01:47.088 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:47.092 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:47.092 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:47.093 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:47.094 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:47.457 INFO:teuthology.orchestra.run.smithi043.stdout:generic/065 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:47.461 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/065 2023-06-08T04:01:47.461 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/065 2023-06-08T04:01:47.462 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:47.463 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:47.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:47.486 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-08T04:01:47.703 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:47.707 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:47.708 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:47.709 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:47.709 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:48.060 INFO:teuthology.orchestra.run.smithi043.stdout:generic/066 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:48.064 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/066 2023-06-08T04:01:48.064 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/066 2023-06-08T04:01:48.064 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:48.066 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:48.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:48.087 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-08T04:01:48.307 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:48.311 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:48.312 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:48.313 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:48.313 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:48.685 INFO:teuthology.orchestra.run.smithi043.stdout:generic/067 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:01:48.689 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/067 2023-06-08T04:01:48.689 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/067 2023-06-08T04:01:48.689 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:48.691 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:48.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:48.723 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-08T04:01:48.950 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:48.955 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:48.955 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:48.956 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:48.956 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:49.308 INFO:teuthology.orchestra.run.smithi043.stdout:generic/068 [not run] ceph does not support freezing 2023-06-08T04:01:49.312 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/068 2023-06-08T04:01:49.312 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/068 2023-06-08T04:01:49.312 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:49.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:49.336 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-08T04:01:49.558 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:49.562 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:49.562 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:49.563 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:49.563 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:56.431 INFO:teuthology.orchestra.run.smithi043.stdout:generic/069 7s 2023-06-08T04:01:56.441 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/069 2023-06-08T04:01:56.442 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:01:56.450 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:56.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:01:56.461 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-08T04:01:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:01:56.682 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:01:56.683 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:01:56.684 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:01:56.684 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:01:57.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:57.592 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:22.420 INFO:teuthology.orchestra.run.smithi043.stdout:generic/070 26s 2023-06-08T04:02:22.441 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/070 2023-06-08T04:02:22.441 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:02:22.443 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:22.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:02:22.862 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-08T04:02:23.302 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:02:23.307 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:02:23.308 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:02:23.309 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:02:23.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:23.845 INFO:teuthology.orchestra.run.smithi043.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T04:02:23.850 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/071 2023-06-08T04:02:23.850 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/071 2023-06-08T04:02:23.850 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:02:23.853 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:23.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:02:23.889 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-08T04:02:24.267 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:02:24.272 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:02:24.272 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:02:24.273 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:02:24.274 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:24.855 INFO:teuthology.orchestra.run.smithi043.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-08T04:02:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/072 2023-06-08T04:02:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/072 2023-06-08T04:02:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:02:24.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:24.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:02:24.901 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-08T04:02:25.281 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:02:25.290 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:02:25.291 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:02:25.292 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:02:25.292 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:generic/073 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:02:25.816 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/073 2023-06-08T04:02:25.817 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/073 2023-06-08T04:02:25.817 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:02:25.820 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:25.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:02:25.846 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-08T04:02:26.187 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:02:26.197 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:02:26.198 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:02:26.203 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:02:26.203 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:27.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:27.696 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:27.903 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T04:02:27.898+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205628) UID: 0 2023-06-08T04:02:27.904 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T04:02:27.898+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205628) UID: 0 2023-06-08T04:02:49.221 INFO:teuthology.orchestra.run.smithi043.stdout:generic/074 23s 2023-06-08T04:02:49.259 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/074 2023-06-08T04:02:49.259 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:02:49.262 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:02:49.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:02:49.759 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-08T04:02:50.998 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:02:51.004 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:02:51.004 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:02:51.005 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:02:51.006 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:30.406 INFO:teuthology.orchestra.run.smithi043.stdout:generic/075 39s 2023-06-08T04:03:30.452 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/075 2023-06-08T04:03:30.452 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:03:30.470 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:30.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:03:30.946 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-08T04:03:31.897 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:03:31.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:03:31.903 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:03:31.904 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:03:31.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:32.492 INFO:teuthology.orchestra.run.smithi043.stdout:generic/076 [not run] require 172.21.15.43:6789:/scratch to be local device 2023-06-08T04:03:32.518 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/076 2023-06-08T04:03:32.518 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/076 2023-06-08T04:03:32.519 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:03:32.523 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:32.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:03:32.564 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-08T04:03:33.065 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:03:33.075 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:03:33.076 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:03:33.077 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:03:33.077 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:53.137 INFO:teuthology.orchestra.run.smithi043.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:03:53.142 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/077 2023-06-08T04:03:53.142 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/077 2023-06-08T04:03:53.142 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:03:53.145 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:53.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:03:53.554 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-08T04:03:54.220 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:03:54.239 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:03:54.239 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:03:54.241 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:03:54.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:55.037 INFO:teuthology.orchestra.run.smithi043.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-08T04:03:55.041 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/078 2023-06-08T04:03:55.041 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/078 2023-06-08T04:03:55.041 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:03:55.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:55.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:03:55.420 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-08T04:03:55.989 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:03:56.000 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:03:56.001 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:03:56.002 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:03:56.002 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:56.747 INFO:teuthology.orchestra.run.smithi043.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-08T04:03:56.757 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/079 2023-06-08T04:03:56.758 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/079 2023-06-08T04:03:56.758 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:03:56.760 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:56.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:03:56.822 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-08T04:03:57.239 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:03:57.245 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:03:57.246 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:03:57.249 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:03:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:03:59.944 INFO:teuthology.orchestra.run.smithi043.stdout:generic/080 2s 2023-06-08T04:03:59.968 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/080 2023-06-08T04:03:59.968 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:03:59.974 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:00.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:00.032 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-08T04:04:00.546 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:00.564 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:00.564 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:00.565 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:00.565 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:01.594 INFO:teuthology.orchestra.run.smithi043.stdout:generic/081 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:04:01.624 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/081 2023-06-08T04:04:01.625 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/081 2023-06-08T04:04:01.625 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:01.627 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:01.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:01.683 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-08T04:04:02.175 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:02.179 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:02.180 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:02.183 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:02.183 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:02.833 INFO:teuthology.orchestra.run.smithi043.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:04:02.849 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/082 2023-06-08T04:04:02.849 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/082 2023-06-08T04:04:02.849 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:02.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:02.886 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-08T04:04:03.547 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:03.553 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:03.554 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:03.555 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:04.154 INFO:teuthology.orchestra.run.smithi043.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:04:04.161 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/083 2023-06-08T04:04:04.161 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/083 2023-06-08T04:04:04.162 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:04.165 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:04.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:04.195 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-08T04:04:04.659 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:04.665 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:04.665 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:04.666 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:04.666 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:11.183 INFO:teuthology.orchestra.run.smithi043.stdout:generic/084 7s 2023-06-08T04:04:11.320 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/084 2023-06-08T04:04:11.321 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:11.323 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:11.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:11.345 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-08T04:04:11.831 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:11.844 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:11.849 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:11.863 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:11.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:12.846 INFO:teuthology.orchestra.run.smithi043.stdout:generic/085 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:04:12.855 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/085 2023-06-08T04:04:12.855 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/085 2023-06-08T04:04:12.855 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:12.858 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:12.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:12.900 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-08T04:04:13.237 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:13.243 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:13.243 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:13.245 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:13.245 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:13.923 INFO:teuthology.orchestra.run.smithi043.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:04:13.929 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/086 2023-06-08T04:04:13.929 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/086 2023-06-08T04:04:13.930 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:13.932 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:13.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:13.975 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-08T04:04:14.436 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:14.444 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:14.445 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:14.448 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:14.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:15.274 INFO:teuthology.orchestra.run.smithi043.stdout:generic/087 1s 2023-06-08T04:04:15.281 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/087 2023-06-08T04:04:15.281 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:15.290 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:15.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:15.505 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-08T04:04:16.213 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:16.222 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:16.228 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:16.229 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:16.229 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:16.947 INFO:teuthology.orchestra.run.smithi043.stdout:generic/088 0s 2023-06-08T04:04:16.962 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/088 2023-06-08T04:04:16.962 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:04:16.967 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:04:17.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:04:17.164 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-08T04:04:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:04:18.005 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:04:18.006 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:04:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:04:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:05:49.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:05:49.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:20.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:20.555 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:50.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:50.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:20.684 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:20.686 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:50.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:50.764 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:21.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:21.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:21.050 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T04:08:21.046+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215163) UID: 0 2023-06-08T04:08:21.050 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T04:08:21.046+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215163) UID: 0 2023-06-08T04:11:24.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:24.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:54.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:54.986 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:25.061 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:25.072 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:25.154 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T04:12:25.151+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 217277) UID: 0 2023-06-08T04:12:25.154 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T04:12:25.151+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 217277) UID: 0 2023-06-08T04:12:33.290 INFO:teuthology.orchestra.run.smithi043.stdout:generic/089 495s 2023-06-08T04:12:33.295 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/089 2023-06-08T04:12:33.295 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:12:33.297 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:12:34.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:12:34.649 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-06-08T04:12:35.598 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:12:35.602 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:12:35.603 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:12:35.603 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:12:35.604 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:12:35.991 INFO:teuthology.orchestra.run.smithi043.stdout:generic/090 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:12:35.995 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/090 2023-06-08T04:12:35.995 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/090 2023-06-08T04:12:35.995 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:12:35.997 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:12:36.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:12:36.017 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-06-08T04:12:36.240 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:12:36.244 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:12:36.245 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:12:36.245 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:12:36.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:11.204 INFO:teuthology.orchestra.run.smithi043.stdout:generic/091 95s 2023-06-08T04:14:11.209 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/091 2023-06-08T04:14:11.209 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:11.211 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:11.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:11.638 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-06-08T04:14:11.872 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:11.876 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:11.877 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:11.878 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:11.878 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:12.227 INFO:teuthology.orchestra.run.smithi043.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:14:12.231 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/092 2023-06-08T04:14:12.231 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/092 2023-06-08T04:14:12.231 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:12.233 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:12.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:12.257 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-06-08T04:14:12.477 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:12.482 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:12.482 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:12.483 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:12.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:13.119 INFO:teuthology.orchestra.run.smithi043.stdout:generic/093 1s 2023-06-08T04:14:13.123 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/093 2023-06-08T04:14:13.124 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:13.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:13.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:13.364 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-06-08T04:14:13.788 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:13.792 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:13.793 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:13.794 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:13.794 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:14.173 INFO:teuthology.orchestra.run.smithi043.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T04:14:14.177 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/094 2023-06-08T04:14:14.178 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/094 2023-06-08T04:14:14.178 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:14.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:14.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:14.558 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-06-08T04:14:14.836 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:14.840 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:14.840 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:14.841 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:14.841 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:29.074 INFO:teuthology.orchestra.run.smithi043.stdout:generic/095 14s 2023-06-08T04:14:29.082 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/095 2023-06-08T04:14:29.082 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:29.084 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:29.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:29.094 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-06-08T04:14:29.320 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:29.324 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:29.324 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:29.325 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:29.325 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:29.748 INFO:teuthology.orchestra.run.smithi043.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T04:14:29.752 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/096 2023-06-08T04:14:29.752 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/096 2023-06-08T04:14:29.752 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:29.754 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:29.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:29.787 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-06-08T04:14:30.011 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:30.015 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:30.015 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:30.016 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:30.016 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:30.944 INFO:teuthology.orchestra.run.smithi043.stdout:generic/097 0s 2023-06-08T04:14:30.949 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/097 2023-06-08T04:14:30.949 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:30.951 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:30.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:30.974 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-06-08T04:14:31.195 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:31.199 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:31.200 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:31.201 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:31.201 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:35.599 INFO:teuthology.orchestra.run.smithi043.stdout:generic/098 4s 2023-06-08T04:14:35.604 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/098 2023-06-08T04:14:35.604 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:35.606 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:35.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:35.615 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-06-08T04:14:35.837 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:35.841 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:35.842 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:35.843 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:35.843 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:36.765 INFO:teuthology.orchestra.run.smithi043.stdout:generic/099 0s 2023-06-08T04:14:36.770 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/099 2023-06-08T04:14:36.770 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:36.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:37.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:37.093 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-06-08T04:14:37.435 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:37.439 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:37.439 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:37.440 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:37.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:49.106 INFO:teuthology.orchestra.run.smithi043.stdout:generic/100 12s 2023-06-08T04:14:49.111 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/100 2023-06-08T04:14:49.111 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:49.113 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:53.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:53.022 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-06-08T04:14:53.374 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:53.378 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:53.379 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:53.380 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:53.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:53.728 INFO:teuthology.orchestra.run.smithi043.stdout:generic/101 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:14:53.732 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/101 2023-06-08T04:14:53.732 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/101 2023-06-08T04:14:53.732 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:53.734 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:53.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:53.757 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-06-08T04:14:53.979 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:53.983 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:53.983 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:53.984 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:53.984 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:54.318 INFO:teuthology.orchestra.run.smithi043.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:14:54.322 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/102 2023-06-08T04:14:54.322 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/102 2023-06-08T04:14:54.322 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:54.324 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:54.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:54.349 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-06-08T04:14:54.566 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:54.570 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:54.570 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:54.571 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:54.572 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:54.933 INFO:teuthology.orchestra.run.smithi043.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:14:54.937 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/103 2023-06-08T04:14:54.937 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/103 2023-06-08T04:14:54.937 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:54.939 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:55.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:55.349 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-06-08T04:14:55.569 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:55.573 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:55.573 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:55.574 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:55.574 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:55.934 INFO:teuthology.orchestra.run.smithi043.stdout:generic/104 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:14:55.938 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/104 2023-06-08T04:14:55.938 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/104 2023-06-08T04:14:55.938 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:55.940 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:55.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:55.966 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-06-08T04:14:56.187 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:56.191 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:56.192 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:56.193 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:56.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:57.218 INFO:teuthology.orchestra.run.smithi043.stdout:generic/105 1s 2023-06-08T04:14:57.230 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/105 2023-06-08T04:14:57.230 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:57.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:57.260 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-06-08T04:14:57.479 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:57.483 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:57.483 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:57.484 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:57.849 INFO:teuthology.orchestra.run.smithi043.stdout:generic/106 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:14:57.853 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/106 2023-06-08T04:14:57.853 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/106 2023-06-08T04:14:57.853 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:57.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:57.883 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-06-08T04:14:58.113 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:58.117 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:58.117 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:58.118 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:58.118 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:58.480 INFO:teuthology.orchestra.run.smithi043.stdout:generic/107 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:14:58.484 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/107 2023-06-08T04:14:58.484 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/107 2023-06-08T04:14:58.484 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:58.486 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:58.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:58.516 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-06-08T04:14:58.735 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:58.739 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:58.740 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:58.740 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:58.741 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:59.229 INFO:teuthology.orchestra.run.smithi043.stdout:generic/108 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T04:14:59.233 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/108 2023-06-08T04:14:59.233 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/108 2023-06-08T04:14:59.233 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:14:59.235 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:14:59.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:59.268 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-06-08T04:14:59.495 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:14:59.499 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:14:59.499 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:14:59.500 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:14:59.501 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:09.702 INFO:teuthology.orchestra.run.smithi043.stdout:generic/109 10s 2023-06-08T04:15:09.739 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/109 2023-06-08T04:15:09.739 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:15:09.741 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:09.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:09.750 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-06-08T04:15:10.709 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:15:10.713 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:15:10.714 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:15:10.715 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:15:10.715 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:11.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:11.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:30.903 INFO:teuthology.orchestra.run.smithi043.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:15:30.907 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/110 2023-06-08T04:15:30.907 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/110 2023-06-08T04:15:30.907 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:15:30.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:31.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:31.324 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-06-08T04:15:32.241 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:15:32.245 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:15:32.245 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:15:32.246 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:15:32.247 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:32.614 INFO:teuthology.orchestra.run.smithi043.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:15:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/111 2023-06-08T04:15:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/111 2023-06-08T04:15:32.618 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:15:32.620 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:33.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:33.028 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-06-08T04:15:33.258 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:15:33.262 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:15:33.262 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:15:33.263 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:15:33.263 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:41.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:41.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:48.055 INFO:teuthology.orchestra.run.smithi043.stdout:generic/112 15s 2023-06-08T04:15:48.060 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/112 2023-06-08T04:15:48.060 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:15:48.062 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:15:48.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:48.457 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-06-08T04:15:48.707 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:15:48.711 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:15:48.711 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:15:48.712 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:15:48.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:04.789 INFO:teuthology.orchestra.run.smithi043.stdout:generic/113 16s 2023-06-08T04:16:04.794 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/113 2023-06-08T04:16:04.794 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:04.796 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:05.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:05.096 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-06-08T04:16:05.589 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:05.593 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:05.593 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:05.594 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:05.594 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:05.995 INFO:teuthology.orchestra.run.smithi043.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-08T04:16:05.999 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/114 2023-06-08T04:16:05.999 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/114 2023-06-08T04:16:06.000 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:06.001 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:06.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:06.023 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-06-08T04:16:06.248 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:06.252 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:06.252 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:06.253 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:06.253 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:06.608 INFO:teuthology.orchestra.run.smithi043.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:16:06.612 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/115 2023-06-08T04:16:06.613 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/115 2023-06-08T04:16:06.613 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:06.615 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:07.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:07.020 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-06-08T04:16:07.263 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:07.267 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:07.267 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:07.268 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:07.268 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:07.627 INFO:teuthology.orchestra.run.smithi043.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:16:07.631 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/116 2023-06-08T04:16:07.631 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/116 2023-06-08T04:16:07.631 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:07.633 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:08.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:08.050 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-06-08T04:16:08.277 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:08.281 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:08.282 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:08.283 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:08.283 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:11.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:16:11.716 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:16:22.557 INFO:teuthology.orchestra.run.smithi043.stdout:generic/117 14s 2023-06-08T04:16:22.562 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/117 2023-06-08T04:16:22.562 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:22.564 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:22.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:22.573 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-06-08T04:16:22.797 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:22.801 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:22.802 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:22.803 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:22.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:23.609 INFO:teuthology.orchestra.run.smithi043.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:16:23.613 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/118 2023-06-08T04:16:23.613 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/118 2023-06-08T04:16:23.613 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:23.615 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:24.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:24.020 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-06-08T04:16:24.249 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:24.253 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:24.254 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:24.254 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:24.255 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:24.618 INFO:teuthology.orchestra.run.smithi043.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:16:24.622 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/119 2023-06-08T04:16:24.622 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/119 2023-06-08T04:16:24.622 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:24.624 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:25.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:25.008 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-06-08T04:16:25.262 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:25.266 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:25.266 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:25.267 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:25.267 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:25.600 INFO:teuthology.orchestra.run.smithi043.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-08T04:16:25.604 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/120 2023-06-08T04:16:25.604 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/120 2023-06-08T04:16:25.605 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:25.606 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:25.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:25.638 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-06-08T04:16:25.858 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:25.862 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:25.862 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:25.863 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:26.236 INFO:teuthology.orchestra.run.smithi043.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T04:16:26.241 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/121 2023-06-08T04:16:26.241 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/121 2023-06-08T04:16:26.241 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:26.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:26.313 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-06-08T04:16:26.878 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:26.882 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:26.882 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:26.883 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:26.883 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:27.261 INFO:teuthology.orchestra.run.smithi043.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T04:16:27.265 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/122 2023-06-08T04:16:27.265 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/122 2023-06-08T04:16:27.266 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:27.267 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:27.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:27.668 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-06-08T04:16:27.899 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:27.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:27.903 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:27.904 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:27.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:28.423 INFO:teuthology.orchestra.run.smithi043.stdout:generic/123 0s 2023-06-08T04:16:28.428 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/123 2023-06-08T04:16:28.428 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:28.430 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:28.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:28.823 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-06-08T04:16:29.064 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:29.069 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:29.069 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:29.070 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:29.070 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:31.436 INFO:teuthology.orchestra.run.smithi043.stdout:generic/124 2s 2023-06-08T04:16:31.482 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/124 2023-06-08T04:16:31.482 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:16:31.492 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:32.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:32.065 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-06-08T04:16:32.312 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:16:32.317 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:16:32.317 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:16:32.318 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:16:32.318 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:16:41.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:16:41.877 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:11.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:11.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:33.909 INFO:teuthology.orchestra.run.smithi043.stdout:generic/125 61s 2023-06-08T04:17:33.915 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/125 2023-06-08T04:17:33.915 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:17:33.917 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:17:34.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:17:34.323 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-06-08T04:17:34.554 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:17:34.558 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:17:34.559 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:17:34.559 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:17:34.559 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:17:35.075 INFO:teuthology.orchestra.run.smithi043.stdout:generic/126 1s 2023-06-08T04:17:35.080 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/126 2023-06-08T04:17:35.080 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:17:35.082 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:17:35.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:17:35.514 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-06-08T04:17:35.765 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:17:35.769 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:17:35.769 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:17:35.770 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:17:35.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:17:42.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:42.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:18:12.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:18:12.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:18:42.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:18:42.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:19:12.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:19:12.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:19:42.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:19:42.353 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:20:12.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:20:12.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:20:42.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:20:42.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:12.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:12.699 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:43.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:43.280 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:13.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:13.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:43.669 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:43.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:23:13.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:23:13.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:23:43.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:23:43.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:24:13.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:24:13.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:24:44.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:24:44.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:25:14.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:25:14.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:25:14.535 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T04:25:14.532+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111100) UID: 0 2023-06-08T04:25:14.536 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T04:25:14.532+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111100) UID: 0 2023-06-08T04:25:14.536 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T04:25:14.532+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111100) UID: 0 2023-06-08T04:25:14.536 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T04:25:14.532+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111100) UID: 0 2023-06-08T04:26:13.332 INFO:teuthology.orchestra.run.smithi043.stdout:generic/127 518s 2023-06-08T04:26:13.337 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/127 2023-06-08T04:26:13.338 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:26:13.339 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:26:13.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:26:13.738 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-06-08T04:26:13.961 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:26:13.965 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:26:13.966 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:26:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:26:13.967 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:26:15.148 INFO:teuthology.orchestra.run.smithi043.stdout:generic/128 1s 2023-06-08T04:26:15.154 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/128 2023-06-08T04:26:15.154 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:26:15.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:26:15.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:26:15.166 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-06-08T04:26:15.386 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:26:15.390 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:26:15.390 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:26:15.391 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:26:15.391 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:28:10.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:28:10.295 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:28:10.435 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T04:28:10.431+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256427) UID: 0 2023-06-08T04:28:10.435 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T04:28:10.431+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256427) UID: 0 2023-06-08T04:28:10.436 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T04:28:10.431+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256427) UID: 0 2023-06-08T04:28:10.436 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T04:28:10.432+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256427) UID: 0 2023-06-08T04:32:40.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:32:40.466 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:10.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:10.866 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:40.958 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:40.978 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:11.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:11.191 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:41.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:41.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:41.425 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T04:34:41.422+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256596) UID: 0 2023-06-08T04:34:41.426 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T04:34:41.423+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256596) UID: 0 2023-06-08T04:34:41.426 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T04:34:41.424+0000 7f3a4f6e3700 -1 Fail to open '/proc/256596/cmdline' error = (2) No such file or directory 2023-06-08T04:34:41.427 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T04:34:41.424+0000 7f3a4f6e3700 -1 received signal: Hangup from (PID: 256596) UID: 0 2023-06-08T04:34:41.569 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T04:34:41.423+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256596) UID: 0 2023-06-08T04:39:32.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:39:32.416 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:02.764 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:02.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:02.906 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T04:40:02.903+0000 7f0e4bdb3700 -1 received signal: Hangup from (PID: 112091) UID: 0 2023-06-08T04:40:02.908 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T04:40:02.904+0000 7f0a3bebe700 -1 received signal: Hangup from (PID: 112091) UID: 0 2023-06-08T04:40:02.908 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T04:40:02.904+0000 7fa7ef89e700 -1 received signal: Hangup from (PID: 112091) UID: 0 2023-06-08T04:40:02.909 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T04:40:02.905+0000 7f6c29414700 -1 received signal: Hangup from (PID: 112091) UID: 0 2023-06-08T04:46:21.589 INFO:teuthology.orchestra.run.smithi043.stdout:generic/129 1206s 2023-06-08T04:46:21.812 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/129 2023-06-08T04:46:21.812 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:46:22.008 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:22.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:46:22.021 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-06-08T04:46:23.276 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:46:23.281 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:46:23.281 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:46:23.282 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:46:23.282 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:35.608 INFO:teuthology.orchestra.run.smithi043.stdout:generic/130 12s 2023-06-08T04:46:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/130 2023-06-08T04:46:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:46:35.619 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:35.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:46:35.628 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-06-08T04:46:35.852 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:46:35.856 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:46:35.857 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:46:35.858 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:46:35.858 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:37.425 INFO:teuthology.orchestra.run.smithi043.stdout:generic/131 1s 2023-06-08T04:46:37.433 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/131 2023-06-08T04:46:37.434 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:46:37.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:37.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:46:37.907 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-06-08T04:46:38.349 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:46:38.354 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:46:38.355 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:46:38.356 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:46:38.356 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:52.996 INFO:teuthology.orchestra.run.smithi043.stdout:generic/132 14s 2023-06-08T04:46:53.001 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/132 2023-06-08T04:46:53.001 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:46:53.003 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:46:53.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:46:53.012 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-06-08T04:46:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:46:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:46:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:46:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:46:53.242 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:47:55.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:47:55.460 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:47:55.508 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T04:47:55.504+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259385) UID: 0 2023-06-08T04:47:55.508 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T04:47:55.504+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259385) UID: 0 2023-06-08T04:47:55.509 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T04:47:55.504+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259385) UID: 0 2023-06-08T04:47:55.509 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T04:47:55.504+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259385) UID: 0 2023-06-08T04:47:55.608 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T04:47:55.604+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112768) UID: 0 2023-06-08T04:47:55.608 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T04:47:55.604+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112768) UID: 0 2023-06-08T04:47:55.609 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T04:47:55.604+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112768) UID: 0 2023-06-08T04:47:55.609 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T04:47:55.604+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112768) UID: 0 2023-06-08T04:50:54.841 INFO:teuthology.orchestra.run.smithi043.stdout:generic/133 241s 2023-06-08T04:50:54.853 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/133 2023-06-08T04:50:54.853 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:50:54.855 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:55.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:50:55.106 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-06-08T04:50:55.748 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:50:55.753 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:50:55.753 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:50:55.754 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:50:55.754 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:56.142 INFO:teuthology.orchestra.run.smithi043.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:50:56.146 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/134 2023-06-08T04:50:56.146 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/134 2023-06-08T04:50:56.146 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:50:56.148 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:56.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:50:56.346 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-06-08T04:50:56.810 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:50:56.814 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:50:56.814 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:50:56.815 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:50:56.816 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:57.984 INFO:teuthology.orchestra.run.smithi043.stdout:generic/135 0s 2023-06-08T04:50:57.989 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/135 2023-06-08T04:50:57.989 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:50:57.991 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:57.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:50:58.000 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-06-08T04:50:58.228 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:50:58.232 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:50:58.232 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:50:58.233 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:50:58.234 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:58.603 INFO:teuthology.orchestra.run.smithi043.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T04:50:58.607 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/136 2023-06-08T04:50:58.608 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/136 2023-06-08T04:50:58.608 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:50:58.610 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:58.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:50:58.966 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-06-08T04:50:59.264 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:50:59.268 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:50:59.268 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:50:59.269 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:50:59.269 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:50:59.644 INFO:teuthology.orchestra.run.smithi043.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:50:59.648 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/137 2023-06-08T04:50:59.649 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/137 2023-06-08T04:50:59.649 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:50:59.651 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:00.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:00.033 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-06-08T04:51:00.302 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:00.306 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:00.307 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:00.308 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:00.308 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:00.680 INFO:teuthology.orchestra.run.smithi043.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:00.684 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/138 2023-06-08T04:51:00.684 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/138 2023-06-08T04:51:00.684 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:00.686 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:01.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:01.042 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-06-08T04:51:01.354 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:01.358 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:01.359 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:01.359 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:01.360 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:01.735 INFO:teuthology.orchestra.run.smithi043.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:01.739 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/139 2023-06-08T04:51:01.740 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/139 2023-06-08T04:51:01.740 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:01.742 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:02.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:02.101 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-06-08T04:51:02.409 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:02.413 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:02.413 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:02.415 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:02.415 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:02.916 INFO:teuthology.orchestra.run.smithi043.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:02.920 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/140 2023-06-08T04:51:02.921 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/140 2023-06-08T04:51:02.921 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:03.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:03.333 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-06-08T04:51:03.589 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:03.593 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:03.594 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:03.595 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:04.183 INFO:teuthology.orchestra.run.smithi043.stdout:generic/141 1s 2023-06-08T04:51:04.188 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/141 2023-06-08T04:51:04.188 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:04.190 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:04.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:04.199 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-06-08T04:51:04.431 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:04.435 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:04.436 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:04.437 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:04.437 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:04.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:04.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:04.820 INFO:teuthology.orchestra.run.smithi043.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:04.824 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/142 2023-06-08T04:51:04.825 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/142 2023-06-08T04:51:04.825 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:04.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:05.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:05.031 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-06-08T04:51:05.461 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:05.465 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:05.466 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:05.467 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:05.467 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:05.833 INFO:teuthology.orchestra.run.smithi043.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:05.837 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/143 2023-06-08T04:51:05.837 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/143 2023-06-08T04:51:05.837 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:05.839 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:06.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:06.195 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-06-08T04:51:06.505 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:06.509 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:06.510 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:06.511 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:06.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:06.876 INFO:teuthology.orchestra.run.smithi043.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:06.880 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/144 2023-06-08T04:51:06.880 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/144 2023-06-08T04:51:06.880 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:06.882 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:07.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:07.330 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-06-08T04:51:07.552 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:07.556 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:07.556 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:07.557 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:07.557 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:07.953 INFO:teuthology.orchestra.run.smithi043.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:07.957 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/145 2023-06-08T04:51:07.957 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/145 2023-06-08T04:51:07.957 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:07.959 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:08.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:08.314 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-06-08T04:51:08.613 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:08.617 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:08.617 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:08.618 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:08.619 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:09.025 INFO:teuthology.orchestra.run.smithi043.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:09.029 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/146 2023-06-08T04:51:09.029 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/146 2023-06-08T04:51:09.030 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:09.031 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:09.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:09.475 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-06-08T04:51:09.705 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:09.709 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:09.710 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:09.711 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:09.711 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:10.101 INFO:teuthology.orchestra.run.smithi043.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:10.105 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/147 2023-06-08T04:51:10.105 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/147 2023-06-08T04:51:10.105 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:10.107 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:10.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:10.387 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-06-08T04:51:10.761 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:10.765 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:10.766 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:10.767 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:10.767 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:11.150 INFO:teuthology.orchestra.run.smithi043.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:11.154 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/148 2023-06-08T04:51:11.155 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/148 2023-06-08T04:51:11.155 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:11.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:11.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:11.576 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-06-08T04:51:11.816 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:11.820 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:11.821 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:11.822 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:11.822 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:12.192 INFO:teuthology.orchestra.run.smithi043.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:12.196 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/149 2023-06-08T04:51:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/149 2023-06-08T04:51:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:12.199 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:12.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:12.555 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-06-08T04:51:12.855 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:12.861 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:12.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:13.235 INFO:teuthology.orchestra.run.smithi043.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:13.239 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/150 2023-06-08T04:51:13.239 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/150 2023-06-08T04:51:13.239 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:13.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:13.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:13.668 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-06-08T04:51:13.899 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:13.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:13.903 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:13.904 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:13.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:14.270 INFO:teuthology.orchestra.run.smithi043.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/151 2023-06-08T04:51:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/151 2023-06-08T04:51:14.274 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:14.276 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:14.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:14.467 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-06-08T04:51:14.925 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:14.930 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:14.930 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:14.931 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:14.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:15.311 INFO:teuthology.orchestra.run.smithi043.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:15.315 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/152 2023-06-08T04:51:15.315 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/152 2023-06-08T04:51:15.315 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:15.317 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:15.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:15.490 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-06-08T04:51:15.973 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:15.977 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:15.978 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:15.979 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:15.979 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:16.351 INFO:teuthology.orchestra.run.smithi043.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:16.355 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/153 2023-06-08T04:51:16.355 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/153 2023-06-08T04:51:16.355 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:16.357 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:16.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:16.782 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-06-08T04:51:17.013 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:17.017 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:17.018 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:17.019 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:17.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:17.394 INFO:teuthology.orchestra.run.smithi043.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:17.398 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/154 2023-06-08T04:51:17.398 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/154 2023-06-08T04:51:17.398 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:17.400 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:17.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:17.723 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-06-08T04:51:18.062 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:18.066 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:18.067 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:18.068 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:18.068 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:18.450 INFO:teuthology.orchestra.run.smithi043.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:18.454 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/155 2023-06-08T04:51:18.455 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/155 2023-06-08T04:51:18.455 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:18.457 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:18.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:18.855 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-06-08T04:51:19.123 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:19.127 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:19.127 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:19.128 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:19.129 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:19.500 INFO:teuthology.orchestra.run.smithi043.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:19.505 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/156 2023-06-08T04:51:19.505 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/156 2023-06-08T04:51:19.505 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:19.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:19.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:19.953 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-06-08T04:51:20.184 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:20.188 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:20.188 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:20.189 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:20.190 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:20.548 INFO:teuthology.orchestra.run.smithi043.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:20.552 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/157 2023-06-08T04:51:20.553 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/157 2023-06-08T04:51:20.553 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:20.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:20.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:20.978 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-06-08T04:51:21.232 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:21.236 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:21.236 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:21.237 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:21.237 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:21.613 INFO:teuthology.orchestra.run.smithi043.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T04:51:21.618 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/158 2023-06-08T04:51:21.618 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/158 2023-06-08T04:51:21.618 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:21.620 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:22.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:22.056 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-06-08T04:51:22.296 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:22.300 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:22.301 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:22.301 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:22.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:22.679 INFO:teuthology.orchestra.run.smithi043.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-06-08T04:51:22.683 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/159 2023-06-08T04:51:22.683 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/159 2023-06-08T04:51:22.683 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:22.685 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:22.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:22.718 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-06-08T04:51:22.955 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:22.959 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:22.960 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:22.961 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:22.961 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:23.324 INFO:teuthology.orchestra.run.smithi043.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-06-08T04:51:23.328 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/160 2023-06-08T04:51:23.328 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/160 2023-06-08T04:51:23.328 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:23.330 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:23.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:23.364 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-06-08T04:51:23.608 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:23.612 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:23.613 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:23.614 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:23.614 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:24.426 INFO:teuthology.orchestra.run.smithi043.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:24.433 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/161 2023-06-08T04:51:24.433 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/161 2023-06-08T04:51:24.434 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:24.538 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:24.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:24.610 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-06-08T04:51:24.829 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:24.833 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:24.833 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:24.834 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:24.835 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:25.388 INFO:teuthology.orchestra.run.smithi043.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-08T04:51:25.531 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/162 2023-06-08T04:51:25.531 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/162 2023-06-08T04:51:25.531 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:25.541 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:25.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:25.708 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-06-08T04:51:26.047 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:26.051 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:26.051 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:26.052 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:26.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:26.598 INFO:teuthology.orchestra.run.smithi043.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-08T04:51:26.956 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/163 2023-06-08T04:51:26.957 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/163 2023-06-08T04:51:26.957 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:27.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:27.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:27.073 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-06-08T04:51:27.303 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:27.307 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:27.308 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:27.309 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:27.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:28.291 INFO:teuthology.orchestra.run.smithi043.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:28.298 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/164 2023-06-08T04:51:28.298 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/164 2023-06-08T04:51:28.298 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:28.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:28.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:28.333 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-06-08T04:51:28.557 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:28.562 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:28.562 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:28.563 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:28.563 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:29.433 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/165 2023-06-08T04:51:29.433 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/165 2023-06-08T04:51:29.433 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:29.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:29.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:29.555 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-06-08T04:51:29.778 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:29.782 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:29.784 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:29.784 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:30.583 INFO:teuthology.orchestra.run.smithi043.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:30.598 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/166 2023-06-08T04:51:30.598 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/166 2023-06-08T04:51:30.598 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:30.609 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:30.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:30.809 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-06-08T04:51:31.037 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:31.041 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:31.042 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:31.043 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:31.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:31.817 INFO:teuthology.orchestra.run.smithi043.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:32.037 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/167 2023-06-08T04:51:32.037 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/167 2023-06-08T04:51:32.038 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:32.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:32.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:32.067 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-06-08T04:51:32.290 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:32.294 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:32.295 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:32.295 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:32.296 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:33.271 INFO:teuthology.orchestra.run.smithi043.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:33.287 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/168 2023-06-08T04:51:33.287 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/168 2023-06-08T04:51:33.287 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:33.290 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:33.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:33.317 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-06-08T04:51:33.542 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:33.546 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:33.547 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:33.548 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:33.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:34.381 INFO:teuthology.orchestra.run.smithi043.stdout:generic/169 1s 2023-06-08T04:51:34.386 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/169 2023-06-08T04:51:34.386 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:34.388 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:34.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:34.397 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-06-08T04:51:34.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:34.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:34.623 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:34.627 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:34.628 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:34.629 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:34.629 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:35.581 INFO:teuthology.orchestra.run.smithi043.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:35.618 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/170 2023-06-08T04:51:35.618 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/170 2023-06-08T04:51:35.618 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:35.622 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:35.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:35.651 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-06-08T04:51:36.034 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:36.038 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:36.039 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:36.039 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:36.040 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:36.747 INFO:teuthology.orchestra.run.smithi043.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:36.959 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/171 2023-06-08T04:51:36.959 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/171 2023-06-08T04:51:36.959 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:37.029 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:37.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:37.070 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-06-08T04:51:37.294 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:37.298 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:37.299 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:37.300 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:37.300 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:38.267 INFO:teuthology.orchestra.run.smithi043.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:38.280 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/172 2023-06-08T04:51:38.281 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/172 2023-06-08T04:51:38.281 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:38.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:38.319 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-06-08T04:51:38.545 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:38.550 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:38.550 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:38.551 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:38.551 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:39.364 INFO:teuthology.orchestra.run.smithi043.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:39.511 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/173 2023-06-08T04:51:39.512 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/173 2023-06-08T04:51:39.512 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:39.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:39.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:39.619 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-06-08T04:51:39.844 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:39.848 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:39.848 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:39.849 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:39.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:40.776 INFO:teuthology.orchestra.run.smithi043.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:40.835 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/174 2023-06-08T04:51:40.836 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/174 2023-06-08T04:51:40.836 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:40.840 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:40.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:40.868 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-06-08T04:51:41.097 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:41.101 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:41.102 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:41.103 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:41.103 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:41.873 INFO:teuthology.orchestra.run.smithi043.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:41.960 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/175 2023-06-08T04:51:41.960 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/175 2023-06-08T04:51:41.960 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:42.078 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:42.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:42.119 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-06-08T04:51:42.342 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:42.347 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:42.347 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:42.348 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:43.337 INFO:teuthology.orchestra.run.smithi043.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:43.348 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/176 2023-06-08T04:51:43.348 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/176 2023-06-08T04:51:43.348 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:43.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:43.376 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-06-08T04:51:43.610 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:43.614 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:43.614 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:43.615 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:44.178 INFO:teuthology.orchestra.run.smithi043.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T04:51:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/177 2023-06-08T04:51:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/177 2023-06-08T04:51:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:44.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:44.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:44.532 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-06-08T04:51:44.827 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:44.831 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:44.832 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:44.833 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:44.833 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:45.220 INFO:teuthology.orchestra.run.smithi043.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:45.224 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/178 2023-06-08T04:51:45.224 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/178 2023-06-08T04:51:45.225 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:45.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:45.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:45.499 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-06-08T04:51:45.878 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:45.882 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:45.883 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:45.884 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:45.884 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:46.262 INFO:teuthology.orchestra.run.smithi043.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:46.266 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/179 2023-06-08T04:51:46.266 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/179 2023-06-08T04:51:46.267 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:46.268 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:46.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:46.702 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-06-08T04:51:46.945 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:46.950 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:46.950 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:46.951 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:46.951 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:47.317 INFO:teuthology.orchestra.run.smithi043.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:47.321 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/180 2023-06-08T04:51:47.322 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/180 2023-06-08T04:51:47.322 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:47.324 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:47.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:47.672 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-06-08T04:51:47.989 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:47.993 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:47.994 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:47.995 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:47.995 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:48.372 INFO:teuthology.orchestra.run.smithi043.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T04:51:48.376 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/181 2023-06-08T04:51:48.376 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/181 2023-06-08T04:51:48.376 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:48.378 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:48.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:48.804 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-06-08T04:51:49.043 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:49.048 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:49.048 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:49.049 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:49.049 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:49.421 INFO:teuthology.orchestra.run.smithi043.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T04:51:49.425 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/182 2023-06-08T04:51:49.425 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/182 2023-06-08T04:51:49.425 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:49.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:49.826 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-06-08T04:51:50.093 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:50.100 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:50.100 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:50.100 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:50.100 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:50.806 INFO:teuthology.orchestra.run.smithi043.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:50.813 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/183 2023-06-08T04:51:50.813 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/183 2023-06-08T04:51:50.813 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:50.847 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:51.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:51.103 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-06-08T04:51:51.323 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:51.327 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:51.328 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:51.328 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:51.329 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:51.724 INFO:teuthology.orchestra.run.smithi043.stdout:generic/184 0s 2023-06-08T04:51:51.729 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/184 2023-06-08T04:51:51.729 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:51.731 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:51.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:51.760 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-06-08T04:51:51.985 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:51.989 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:51.989 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:51.990 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:51.991 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/185 2023-06-08T04:51:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/185 2023-06-08T04:51:52.979 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:52.984 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:53.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:53.010 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-06-08T04:51:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:53.236 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:53.237 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:54.157 INFO:teuthology.orchestra.run.smithi043.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:54.168 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/186 2023-06-08T04:51:54.169 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/186 2023-06-08T04:51:54.169 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:54.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:54.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:54.242 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-06-08T04:51:54.463 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:54.467 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:54.467 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:54.469 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:54.469 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:55.220 INFO:teuthology.orchestra.run.smithi043.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:55.271 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/187 2023-06-08T04:51:55.272 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/187 2023-06-08T04:51:55.272 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:55.275 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:55.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:55.484 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-06-08T04:51:55.707 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:55.711 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:55.712 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:55.713 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:55.713 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:56.638 INFO:teuthology.orchestra.run.smithi043.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:56.664 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/188 2023-06-08T04:51:56.664 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/188 2023-06-08T04:51:56.665 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:56.675 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:56.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:56.718 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-06-08T04:51:56.939 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:56.943 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:56.944 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:56.945 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:56.945 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:57.888 INFO:teuthology.orchestra.run.smithi043.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:57.902 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/189 2023-06-08T04:51:57.902 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/189 2023-06-08T04:51:57.902 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:57.911 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:57.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:57.945 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-06-08T04:51:58.170 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:58.174 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:58.174 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:58.175 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:58.176 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:58.909 INFO:teuthology.orchestra.run.smithi043.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:51:58.917 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/190 2023-06-08T04:51:58.917 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/190 2023-06-08T04:51:58.917 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:51:58.922 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:51:59.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:51:59.195 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-06-08T04:51:59.419 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:51:59.423 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:51:59.424 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:51:59.425 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:51:59.425 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:00.401 INFO:teuthology.orchestra.run.smithi043.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:00.412 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/191 2023-06-08T04:52:00.412 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/191 2023-06-08T04:52:00.412 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:00.414 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:00.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:00.446 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-06-08T04:52:00.670 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:00.674 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:00.675 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:00.676 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:00.676 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:01.027 INFO:teuthology.orchestra.run.smithi043.stdout:generic/192 [not run] atime not maintained by ceph 2023-06-08T04:52:01.031 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/192 2023-06-08T04:52:01.031 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/192 2023-06-08T04:52:01.031 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:01.033 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:01.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:01.056 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-06-08T04:52:01.280 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:01.285 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:01.286 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:01.287 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:01.287 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:02.181 INFO:teuthology.orchestra.run.smithi043.stdout:generic/193 1s 2023-06-08T04:52:02.186 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/193 2023-06-08T04:52:02.186 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:02.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:02.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:02.617 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-06-08T04:52:02.850 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:02.854 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:02.855 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:02.856 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:03.804 INFO:teuthology.orchestra.run.smithi043.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:03.842 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/194 2023-06-08T04:52:03.842 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/194 2023-06-08T04:52:03.842 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:03.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:03.875 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-06-08T04:52:04.100 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:04.104 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:04.104 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:04.105 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:04.106 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:04.734 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:52:04.764 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:52:05.016 INFO:teuthology.orchestra.run.smithi043.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:05.033 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/195 2023-06-08T04:52:05.034 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/195 2023-06-08T04:52:05.034 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:05.060 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:05.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:05.119 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-06-08T04:52:05.131 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T04:52:05.127+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290785) UID: 0 2023-06-08T04:52:05.132 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T04:52:05.127+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290785) UID: 0 2023-06-08T04:52:05.132 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T04:52:05.127+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290785) UID: 0 2023-06-08T04:52:05.132 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T04:52:05.128+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290785) UID: 0 2023-06-08T04:52:05.347 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:05.351 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:05.352 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:05.352 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:05.353 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:06.211 INFO:teuthology.orchestra.run.smithi043.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:06.363 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/196 2023-06-08T04:52:06.363 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/196 2023-06-08T04:52:06.364 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:06.366 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:06.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:06.418 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-06-08T04:52:06.681 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:06.685 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:06.685 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:06.686 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:06.687 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:07.700 INFO:teuthology.orchestra.run.smithi043.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:07.706 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/197 2023-06-08T04:52:07.707 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/197 2023-06-08T04:52:07.707 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:07.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:07.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:07.794 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-06-08T04:52:08.014 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:08.019 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:08.019 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:08.020 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:08.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:08.771 INFO:teuthology.orchestra.run.smithi043.stdout:generic/198 0s 2023-06-08T04:52:08.776 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/198 2023-06-08T04:52:08.777 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:08.779 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:09.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:09.243 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-06-08T04:52:09.597 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:09.601 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:09.602 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:09.602 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:09.603 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:10.447 INFO:teuthology.orchestra.run.smithi043.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:10.559 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/199 2023-06-08T04:52:10.560 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/199 2023-06-08T04:52:10.560 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:10.612 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:10.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:10.677 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-06-08T04:52:10.898 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:10.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:10.903 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:10.904 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:10.904 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:11.732 INFO:teuthology.orchestra.run.smithi043.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:11.826 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/200 2023-06-08T04:52:11.826 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/200 2023-06-08T04:52:11.826 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:11.907 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:11.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:11.949 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-06-08T04:52:12.175 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:12.179 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:12.179 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:12.180 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:12.180 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:13.019 INFO:teuthology.orchestra.run.smithi043.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:13.059 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/201 2023-06-08T04:52:13.059 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/201 2023-06-08T04:52:13.059 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:13.078 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:13.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:13.211 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-06-08T04:52:13.459 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:13.463 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:13.464 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:13.464 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:13.465 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:14.381 INFO:teuthology.orchestra.run.smithi043.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:14.443 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/202 2023-06-08T04:52:14.443 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/202 2023-06-08T04:52:14.444 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:14.451 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:14.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:14.500 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-06-08T04:52:14.727 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:14.731 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:14.731 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:14.732 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:14.733 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:15.690 INFO:teuthology.orchestra.run.smithi043.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:15.755 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/203 2023-06-08T04:52:15.755 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/203 2023-06-08T04:52:15.756 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:15.759 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:15.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:15.784 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-06-08T04:52:16.027 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:16.031 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:16.032 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:16.033 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:16.033 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:19.279 INFO:teuthology.orchestra.run.smithi043.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:52:19.284 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/204 2023-06-08T04:52:19.284 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/204 2023-06-08T04:52:19.284 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:19.285 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:19.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:19.313 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-06-08T04:52:19.546 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:19.550 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:19.550 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:19.551 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:19.551 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:20.205 INFO:teuthology.orchestra.run.smithi043.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:20.494 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/205 2023-06-08T04:52:20.495 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/205 2023-06-08T04:52:20.495 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:20.568 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:20.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:20.641 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-06-08T04:52:20.875 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:20.880 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:20.880 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:20.881 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:20.881 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:21.811 INFO:teuthology.orchestra.run.smithi043.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:52:21.841 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/206 2023-06-08T04:52:21.841 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/206 2023-06-08T04:52:21.841 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:21.846 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:21.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:21.948 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-06-08T04:52:22.179 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:22.183 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:22.184 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:22.185 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:22.185 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:32.987 INFO:teuthology.orchestra.run.smithi043.stdout:generic/207 10s 2023-06-08T04:52:32.992 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/207 2023-06-08T04:52:32.992 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:52:32.994 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:52:33.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:52:33.281 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-06-08T04:52:33.697 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:52:33.701 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:52:33.702 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:52:33.702 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:52:33.703 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:55:16.148 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:55:16.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:55:16.204 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T04:55:16.201+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113488) UID: 0 2023-06-08T04:55:16.205 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T04:55:16.201+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113488) UID: 0 2023-06-08T04:55:16.205 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T04:55:16.201+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113488) UID: 0 2023-06-08T04:55:16.205 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T04:55:16.201+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113488) UID: 0 2023-06-08T04:55:16.227 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T04:55:16.225+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297903) UID: 0 2023-06-08T04:55:16.228 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T04:55:16.225+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297903) UID: 0 2023-06-08T04:55:16.228 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T04:55:16.225+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297903) UID: 0 2023-06-08T04:55:16.229 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T04:55:16.225+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297903) UID: 0 2023-06-08T04:55:54.555 INFO:teuthology.orchestra.run.smithi043.stdout:generic/208 201s 2023-06-08T04:55:54.812 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/208 2023-06-08T04:55:54.812 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:55:54.814 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:55:55.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:55:55.241 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-06-08T04:55:55.589 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:55:55.593 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:55:55.593 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:55:55.594 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:55:55.594 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:27.116 INFO:teuthology.orchestra.run.smithi043.stdout:generic/209 32s 2023-06-08T04:56:27.121 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/209 2023-06-08T04:56:27.121 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:27.124 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:27.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:27.560 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-06-08T04:56:27.823 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:27.827 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:27.829 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:27.829 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:28.301 INFO:teuthology.orchestra.run.smithi043.stdout:generic/210 0s 2023-06-08T04:56:28.308 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/210 2023-06-08T04:56:28.308 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:28.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:28.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:28.720 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-06-08T04:56:28.979 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:28.983 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:28.983 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:28.984 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:28.985 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:29.807 INFO:teuthology.orchestra.run.smithi043.stdout:generic/211 0s 2023-06-08T04:56:29.857 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/211 2023-06-08T04:56:29.857 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:29.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:29.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:29.891 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-06-08T04:56:30.118 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:30.123 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:30.123 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:30.124 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:30.124 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:30.749 INFO:teuthology.orchestra.run.smithi043.stdout:generic/212 0s 2023-06-08T04:56:30.754 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/212 2023-06-08T04:56:30.754 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:30.756 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:30.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:30.790 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-06-08T04:56:31.012 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:31.015 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:31.016 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:31.017 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:31.017 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:31.376 INFO:teuthology.orchestra.run.smithi043.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:56:31.380 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/213 2023-06-08T04:56:31.380 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/213 2023-06-08T04:56:31.380 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:31.382 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:31.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:31.409 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-06-08T04:56:31.641 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:31.645 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:31.646 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:31.647 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:31.647 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:32.000 INFO:teuthology.orchestra.run.smithi043.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:56:32.004 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/214 2023-06-08T04:56:32.005 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/214 2023-06-08T04:56:32.005 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:32.007 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:32.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:32.036 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-06-08T04:56:32.257 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:32.262 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:32.262 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:32.263 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:32.263 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:34.680 INFO:teuthology.orchestra.run.smithi043.stdout:generic/215 2s 2023-06-08T04:56:34.685 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/215 2023-06-08T04:56:34.685 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:34.687 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:34.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:34.730 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-06-08T04:56:34.951 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:34.956 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:34.956 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:34.957 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:34.957 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:35.934 INFO:teuthology.orchestra.run.smithi043.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:35.990 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/216 2023-06-08T04:56:35.990 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/216 2023-06-08T04:56:35.990 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:36.015 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:36.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:36.044 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-06-08T04:56:36.278 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:36.282 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:36.283 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:36.284 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:36.284 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:36.942 INFO:teuthology.orchestra.run.smithi043.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:37.131 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/217 2023-06-08T04:56:37.131 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/217 2023-06-08T04:56:37.131 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:37.135 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:37.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:37.340 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-06-08T04:56:37.566 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:37.570 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:37.570 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:37.571 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:37.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:38.536 INFO:teuthology.orchestra.run.smithi043.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:38.585 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/218 2023-06-08T04:56:38.585 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/218 2023-06-08T04:56:38.585 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:38.587 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:38.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:38.623 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-06-08T04:56:38.860 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:38.865 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:38.865 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:38.866 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:39.220 INFO:teuthology.orchestra.run.smithi043.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:39.223 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/219 2023-06-08T04:56:39.224 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/219 2023-06-08T04:56:39.224 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:39.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:39.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:39.250 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-06-08T04:56:39.476 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:39.480 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:39.481 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:39.482 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:39.482 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:40.199 INFO:teuthology.orchestra.run.smithi043.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:40.431 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/220 2023-06-08T04:56:40.431 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/220 2023-06-08T04:56:40.431 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:40.498 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:40.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:40.533 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-06-08T04:56:40.759 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:40.763 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:40.763 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:40.764 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:40.764 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:42.166 INFO:teuthology.orchestra.run.smithi043.stdout:generic/221 2s 2023-06-08T04:56:42.171 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/221 2023-06-08T04:56:42.172 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:42.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:42.206 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-06-08T04:56:42.427 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:42.431 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:42.432 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:42.433 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:43.382 INFO:teuthology.orchestra.run.smithi043.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:43.393 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/222 2023-06-08T04:56:43.393 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/222 2023-06-08T04:56:43.393 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:43.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:43.433 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-06-08T04:56:43.675 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:43.680 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:43.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:44.056 INFO:teuthology.orchestra.run.smithi043.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:56:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/223 2023-06-08T04:56:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/223 2023-06-08T04:56:44.061 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:44.062 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:44.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:44.100 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-06-08T04:56:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:44.329 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:44.329 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:44.330 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:44.330 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:44.701 INFO:teuthology.orchestra.run.smithi043.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:56:44.705 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/224 2023-06-08T04:56:44.705 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/224 2023-06-08T04:56:44.705 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:44.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:44.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:44.731 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-06-08T04:56:44.965 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:44.969 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:44.969 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:44.970 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:44.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:45.387 INFO:teuthology.orchestra.run.smithi043.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T04:56:45.391 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/225 2023-06-08T04:56:45.391 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/225 2023-06-08T04:56:45.391 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:45.393 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:45.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:45.782 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-06-08T04:56:46.092 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:46.096 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:46.097 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:46.098 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:46.490 INFO:teuthology.orchestra.run.smithi043.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:56:46.494 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/226 2023-06-08T04:56:46.494 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/226 2023-06-08T04:56:46.494 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:46.496 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:46.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:46.526 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-06-08T04:56:46.757 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:46.761 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:46.761 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:46.762 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:46.762 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:47.734 INFO:teuthology.orchestra.run.smithi043.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:47.773 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/227 2023-06-08T04:56:47.773 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/227 2023-06-08T04:56:47.773 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:47.776 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:47.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:47.804 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-06-08T04:56:48.038 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:48.042 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:48.043 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:48.044 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:48.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:48.435 INFO:teuthology.orchestra.run.smithi043.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:56:48.439 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/228 2023-06-08T04:56:48.439 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/228 2023-06-08T04:56:48.439 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:48.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:48.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:48.471 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-06-08T04:56:48.693 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:48.697 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:48.698 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:48.698 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:48.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:49.714 INFO:teuthology.orchestra.run.smithi043.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:49.724 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/229 2023-06-08T04:56:49.724 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/229 2023-06-08T04:56:49.725 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:49.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:49.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:49.760 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-06-08T04:56:49.985 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:49.989 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:49.990 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:49.991 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:49.991 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:50.341 INFO:teuthology.orchestra.run.smithi043.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:50.345 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/230 2023-06-08T04:56:50.346 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/230 2023-06-08T04:56:50.346 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:50.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:50.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:50.383 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-06-08T04:56:50.624 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:50.628 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:50.628 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:50.629 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:50.629 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:50.969 INFO:teuthology.orchestra.run.smithi043.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:50.973 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/231 2023-06-08T04:56:50.973 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/231 2023-06-08T04:56:50.973 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:50.975 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:51.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:51.000 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-06-08T04:56:51.222 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:51.227 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:51.227 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:51.228 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:51.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:51.570 INFO:teuthology.orchestra.run.smithi043.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:51.574 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/232 2023-06-08T04:56:51.574 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/232 2023-06-08T04:56:51.574 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:51.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:51.602 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-06-08T04:56:51.824 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:51.828 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:51.828 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:51.829 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:51.829 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:52.190 INFO:teuthology.orchestra.run.smithi043.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:52.194 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/233 2023-06-08T04:56:52.194 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/233 2023-06-08T04:56:52.194 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:52.196 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:52.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:52.230 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-06-08T04:56:52.453 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:52.459 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:52.806 INFO:teuthology.orchestra.run.smithi043.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/234 2023-06-08T04:56:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/234 2023-06-08T04:56:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:52.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:52.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:52.842 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-06-08T04:56:53.064 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:53.068 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:53.068 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:53.069 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:53.069 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:53.422 INFO:teuthology.orchestra.run.smithi043.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:56:53.426 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/235 2023-06-08T04:56:53.426 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/235 2023-06-08T04:56:53.426 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:53.428 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:53.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:53.454 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-06-08T04:56:53.678 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:53.682 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:53.683 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:53.683 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:55.098 INFO:teuthology.orchestra.run.smithi043.stdout:generic/236 2s 2023-06-08T04:56:55.103 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/236 2023-06-08T04:56:55.103 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:55.105 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:55.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:55.418 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-06-08T04:56:55.795 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:55.799 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:55.799 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:55.800 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:55.800 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:56.303 INFO:teuthology.orchestra.run.smithi043.stdout:generic/237 0s 2023-06-08T04:56:56.308 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/237 2023-06-08T04:56:56.309 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:56.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:56.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:56.545 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-06-08T04:56:57.004 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:57.008 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:57.008 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:57.009 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:57.917 INFO:teuthology.orchestra.run.smithi043.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T04:56:58.020 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/238 2023-06-08T04:56:58.020 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/238 2023-06-08T04:56:58.021 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:56:58.023 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:56:58.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:56:58.057 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-06-08T04:56:58.282 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:56:58.286 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:56:58.287 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:56:58.288 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:56:58.288 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:59:07.542 INFO:teuthology.orchestra.run.smithi043.stdout:generic/239 129s 2023-06-08T04:59:07.557 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/239 2023-06-08T04:59:07.557 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:59:07.559 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:59:07.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:59:07.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-06-08T04:59:08.230 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:59:08.235 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:59:08.235 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:59:08.236 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:59:08.236 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:59:08.963 INFO:teuthology.orchestra.run.smithi043.stdout:generic/240 0s 2023-06-08T04:59:08.967 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/240 2023-06-08T04:59:08.968 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T04:59:08.970 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:59:09.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:59:09.306 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-06-08T04:59:09.626 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T04:59:09.631 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T04:59:09.631 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T04:59:09.632 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T04:59:09.632 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T04:59:18.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:18.702 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:48.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:48.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:48.908 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T04:59:48.905+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 314616) UID: 0 2023-06-08T04:59:48.909 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T04:59:48.905+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 314616) UID: 0 2023-06-08T05:00:23.038 INFO:teuthology.orchestra.run.smithi043.stdout:generic/241 73s 2023-06-08T05:00:23.043 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/241 2023-06-08T05:00:23.043 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:23.045 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:25.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:25.036 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-06-08T05:00:25.443 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:25.516 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:25.517 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:25.518 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:25.519 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:27.001 INFO:teuthology.orchestra.run.smithi043.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:27.060 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/242 2023-06-08T05:00:27.060 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/242 2023-06-08T05:00:27.060 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:27.064 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:27.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:27.180 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-06-08T05:00:27.405 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:27.409 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:27.410 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:27.411 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:27.411 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:28.291 INFO:teuthology.orchestra.run.smithi043.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:28.373 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/243 2023-06-08T05:00:28.374 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/243 2023-06-08T05:00:28.374 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:28.377 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:28.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:28.417 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-06-08T05:00:28.660 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:28.665 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:28.665 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:28.666 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:28.667 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:29.222 INFO:teuthology.orchestra.run.smithi043.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:00:29.226 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/244 2023-06-08T05:00:29.226 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/244 2023-06-08T05:00:29.226 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:29.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:29.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:29.256 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-06-08T05:00:29.484 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:29.488 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:29.489 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:29.490 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:29.490 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:30.088 INFO:teuthology.orchestra.run.smithi043.stdout:generic/245 0s 2023-06-08T05:00:30.165 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/245 2023-06-08T05:00:30.165 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:30.167 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:30.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:30.601 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-06-08T05:00:30.844 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:30.848 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:30.849 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:30.850 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:30.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:31.697 INFO:teuthology.orchestra.run.smithi043.stdout:generic/246 0s 2023-06-08T05:00:31.774 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/246 2023-06-08T05:00:31.774 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:31.776 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:31.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:31.846 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-06-08T05:00:32.465 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:32.469 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:32.469 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:32.470 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:32.470 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:39.994 INFO:teuthology.orchestra.run.smithi043.stdout:generic/247 7s 2023-06-08T05:00:39.999 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/247 2023-06-08T05:00:39.999 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:40.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:40.010 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-06-08T05:00:40.233 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:40.237 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:40.238 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:40.239 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:40.631 INFO:teuthology.orchestra.run.smithi043.stdout:generic/248 0s 2023-06-08T05:00:40.636 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/248 2023-06-08T05:00:40.636 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:40.638 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:40.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:40.673 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-06-08T05:00:40.899 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:40.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:40.904 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:40.905 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:40.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:41.494 INFO:teuthology.orchestra.run.smithi043.stdout:generic/249 0s 2023-06-08T05:00:41.498 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/249 2023-06-08T05:00:41.499 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:41.500 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:41.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:41.789 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-06-08T05:00:42.203 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:42.207 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:42.208 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:42.209 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:42.692 INFO:teuthology.orchestra.run.smithi043.stdout:generic/250 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:00:42.696 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/250 2023-06-08T05:00:42.697 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/250 2023-06-08T05:00:42.697 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:42.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:42.725 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-06-08T05:00:42.952 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:42.956 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:42.956 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:42.957 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:43.514 INFO:teuthology.orchestra.run.smithi043.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:43.533 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/251 2023-06-08T05:00:43.534 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/251 2023-06-08T05:00:43.534 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:43.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:43.568 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-06-08T05:00:43.793 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:43.797 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:43.797 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:43.798 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:43.799 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:44.162 INFO:teuthology.orchestra.run.smithi043.stdout:generic/252 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:00:44.166 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/252 2023-06-08T05:00:44.166 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/252 2023-06-08T05:00:44.167 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:44.168 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:44.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:44.189 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-06-08T05:00:44.413 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:44.418 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:44.418 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:44.419 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:44.419 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:45.393 INFO:teuthology.orchestra.run.smithi043.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:45.412 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/253 2023-06-08T05:00:45.412 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/253 2023-06-08T05:00:45.412 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:45.421 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:45.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:45.445 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-06-08T05:00:45.672 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:45.676 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:45.677 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:45.678 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:45.678 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:46.658 INFO:teuthology.orchestra.run.smithi043.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:46.695 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/254 2023-06-08T05:00:46.695 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/254 2023-06-08T05:00:46.695 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:46.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:46.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:46.727 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-06-08T05:00:46.973 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:46.977 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:46.977 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:46.978 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:46.978 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:47.440 INFO:teuthology.orchestra.run.smithi043.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:00:47.444 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/255 2023-06-08T05:00:47.444 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/255 2023-06-08T05:00:47.444 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:47.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:47.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:47.706 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-06-08T05:00:48.168 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:48.172 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:48.172 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:48.173 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:48.173 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:49.047 INFO:teuthology.orchestra.run.smithi043.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:00:49.051 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/256 2023-06-08T05:00:49.051 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/256 2023-06-08T05:00:49.051 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:49.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:49.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:49.085 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-06-08T05:00:49.343 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:49.347 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:49.348 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:49.349 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:49.349 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:50.238 INFO:teuthology.orchestra.run.smithi043.stdout:generic/257 1s 2023-06-08T05:00:50.243 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/257 2023-06-08T05:00:50.243 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:50.245 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:50.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:50.422 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-06-08T05:00:50.989 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:50.993 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:50.994 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:50.995 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:50.995 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:51.400 INFO:teuthology.orchestra.run.smithi043.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-06-08T05:00:51.437 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/258 2023-06-08T05:00:51.437 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/258 2023-06-08T05:00:51.437 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:51.451 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:51.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:51.515 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-06-08T05:00:51.734 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:51.738 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:51.738 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:51.740 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:51.740 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:52.560 INFO:teuthology.orchestra.run.smithi043.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:52.568 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/259 2023-06-08T05:00:52.568 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/259 2023-06-08T05:00:52.568 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:52.664 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:52.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:52.750 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-06-08T05:00:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:52.979 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:52.980 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:52.980 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:53.494 INFO:teuthology.orchestra.run.smithi043.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:53.514 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/260 2023-06-08T05:00:53.514 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/260 2023-06-08T05:00:53.514 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:53.516 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:53.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:53.546 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-06-08T05:00:53.772 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:53.776 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:53.776 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:53.777 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:53.778 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:54.398 INFO:teuthology.orchestra.run.smithi043.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:54.600 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/261 2023-06-08T05:00:54.600 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/261 2023-06-08T05:00:54.601 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:54.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:54.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:54.783 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-06-08T05:00:55.013 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:55.017 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:55.018 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:55.019 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:55.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:55.699 INFO:teuthology.orchestra.run.smithi043.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:00:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/262 2023-06-08T05:00:55.706 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/262 2023-06-08T05:00:55.706 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:00:55.709 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:00:55.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:00:55.932 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-06-08T05:00:56.252 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:00:56.257 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:00:56.257 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:00:56.258 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:00:56.258 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:38.969 INFO:teuthology.orchestra.run.smithi043.stdout:generic/263 42s 2023-06-08T05:01:38.974 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/263 2023-06-08T05:01:38.974 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:38.976 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:39.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:39.270 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-06-08T05:01:39.679 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:39.683 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:39.684 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:39.685 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:39.685 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:40.542 INFO:teuthology.orchestra.run.smithi043.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:40.626 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/264 2023-06-08T05:01:40.626 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/264 2023-06-08T05:01:40.626 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:40.658 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:40.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:40.711 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-06-08T05:01:40.953 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:40.957 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:40.957 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:40.958 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:40.959 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:41.981 INFO:teuthology.orchestra.run.smithi043.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:41.987 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/265 2023-06-08T05:01:41.988 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/265 2023-06-08T05:01:41.988 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:42.008 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:42.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:42.034 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-06-08T05:01:42.266 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:42.270 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:42.270 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:42.271 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:43.173 INFO:teuthology.orchestra.run.smithi043.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:43.180 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/266 2023-06-08T05:01:43.181 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/266 2023-06-08T05:01:43.181 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:43.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:43.320 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-06-08T05:01:43.564 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:43.568 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:43.569 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:43.570 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:44.880 INFO:teuthology.orchestra.run.smithi043.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:44.892 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/267 2023-06-08T05:01:44.892 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/267 2023-06-08T05:01:44.892 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:44.898 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:44.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:44.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-06-08T05:01:45.173 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:45.177 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:45.178 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:45.179 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:45.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:46.134 INFO:teuthology.orchestra.run.smithi043.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:46.198 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/268 2023-06-08T05:01:46.198 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/268 2023-06-08T05:01:46.198 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:46.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:46.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:46.230 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-06-08T05:01:46.467 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:46.471 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:46.472 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:46.473 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:46.473 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:46.873 INFO:teuthology.orchestra.run.smithi043.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:01:46.877 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/269 2023-06-08T05:01:46.878 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/269 2023-06-08T05:01:46.878 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:46.880 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:46.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:46.902 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-06-08T05:01:47.124 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:47.128 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:47.129 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:47.130 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:47.130 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:47.492 INFO:teuthology.orchestra.run.smithi043.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:01:47.496 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/270 2023-06-08T05:01:47.496 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/270 2023-06-08T05:01:47.496 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:47.498 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:47.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:47.536 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-06-08T05:01:47.769 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:47.773 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:47.774 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:47.775 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:47.775 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:48.658 INFO:teuthology.orchestra.run.smithi043.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:48.665 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/271 2023-06-08T05:01:48.665 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/271 2023-06-08T05:01:48.666 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:48.669 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:48.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:48.827 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-06-08T05:01:49.065 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:49.070 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:49.070 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:49.071 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:49.071 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:50.068 INFO:teuthology.orchestra.run.smithi043.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:50.083 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/272 2023-06-08T05:01:50.083 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/272 2023-06-08T05:01:50.084 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:50.100 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:50.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:50.135 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-06-08T05:01:50.357 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:50.361 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:50.362 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:50.363 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:50.363 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:50.728 INFO:teuthology.orchestra.run.smithi043.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:01:50.732 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/273 2023-06-08T05:01:50.732 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/273 2023-06-08T05:01:50.732 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:50.734 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:50.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:50.754 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-06-08T05:01:50.986 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:50.990 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:50.990 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:50.991 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:50.992 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:51.351 INFO:teuthology.orchestra.run.smithi043.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T05:01:51.355 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/274 2023-06-08T05:01:51.355 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/274 2023-06-08T05:01:51.356 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:51.358 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:51.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:51.385 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-06-08T05:01:51.619 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:51.623 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:51.623 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:51.624 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:51.624 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:51.993 INFO:teuthology.orchestra.run.smithi043.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:01:51.997 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/275 2023-06-08T05:01:51.997 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/275 2023-06-08T05:01:51.997 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:51.999 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:52.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:52.021 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-06-08T05:01:52.246 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:52.250 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:52.250 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:52.251 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:52.251 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:53.068 INFO:teuthology.orchestra.run.smithi043.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:53.181 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/276 2023-06-08T05:01:53.181 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/276 2023-06-08T05:01:53.181 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:53.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:53.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:53.304 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-06-08T05:01:53.530 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:53.534 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:53.534 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:53.535 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:53.535 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:53.922 INFO:teuthology.orchestra.run.smithi043.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-06-08T05:01:53.926 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/277 2023-06-08T05:01:53.927 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/277 2023-06-08T05:01:53.927 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:53.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:53.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:53.959 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-06-08T05:01:54.190 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:54.194 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:54.194 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:54.195 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:54.195 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:55.101 INFO:teuthology.orchestra.run.smithi043.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:55.108 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/278 2023-06-08T05:01:55.108 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/278 2023-06-08T05:01:55.108 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:55.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:55.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:55.214 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-06-08T05:01:55.448 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:55.452 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:55.453 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:55.454 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:55.454 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:56.286 INFO:teuthology.orchestra.run.smithi043.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:56.420 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/279 2023-06-08T05:01:56.420 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/279 2023-06-08T05:01:56.421 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:56.424 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:56.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:56.494 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-06-08T05:01:56.721 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:56.726 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:56.726 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:56.727 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:56.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:57.175 INFO:teuthology.orchestra.run.smithi043.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:01:57.179 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/280 2023-06-08T05:01:57.179 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/280 2023-06-08T05:01:57.179 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:57.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:57.218 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-06-08T05:01:57.443 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:57.447 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:57.447 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:57.448 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:57.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:58.391 INFO:teuthology.orchestra.run.smithi043.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:01:58.424 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/281 2023-06-08T05:01:58.424 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/281 2023-06-08T05:01:58.425 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:01:58.427 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:01:58.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:01:58.461 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-06-08T05:01:59.135 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:01:59.139 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:01:59.140 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:01:59.141 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:01:59.141 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:00.270 INFO:teuthology.orchestra.run.smithi043.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:00.278 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/282 2023-06-08T05:02:00.278 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/282 2023-06-08T05:02:00.278 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:00.283 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:00.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:00.367 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-06-08T05:02:00.592 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:00.596 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:00.597 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:00.598 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:00.598 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:01.484 INFO:teuthology.orchestra.run.smithi043.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:01.596 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/283 2023-06-08T05:02:01.597 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/283 2023-06-08T05:02:01.597 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:01.603 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:01.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:01.649 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-06-08T05:02:01.873 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:01.877 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:01.877 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:01.878 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:01.879 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:02.594 INFO:teuthology.orchestra.run.smithi043.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:02.618 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/284 2023-06-08T05:02:02.618 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/284 2023-06-08T05:02:02.618 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:02.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:02.880 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-06-08T05:02:03.144 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:03.148 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:03.148 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:03.149 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:04.852 INFO:teuthology.orchestra.run.smithi043.stdout:generic/285 1s 2023-06-08T05:02:04.896 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/285 2023-06-08T05:02:04.896 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:04.898 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:05.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:05.293 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-06-08T05:02:05.969 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:05.980 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:05.980 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:05.981 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:05.981 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:06.619 INFO:teuthology.orchestra.run.smithi043.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:02:06.626 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/286 2023-06-08T05:02:06.626 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/286 2023-06-08T05:02:06.626 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:06.630 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:06.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:06.683 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-06-08T05:02:07.232 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:07.244 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:07.245 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:07.246 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:07.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:08.663 INFO:teuthology.orchestra.run.smithi043.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:08.672 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/287 2023-06-08T05:02:08.672 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/287 2023-06-08T05:02:08.686 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:08.747 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:08.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:08.801 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-06-08T05:02:09.330 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:09.352 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:09.352 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:09.356 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:10.319 INFO:teuthology.orchestra.run.smithi043.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:10.348 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/288 2023-06-08T05:02:10.348 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/288 2023-06-08T05:02:10.348 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:10.350 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:10.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:10.396 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-06-08T05:02:10.899 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:10.928 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:10.928 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:10.930 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:10.930 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:11.995 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/289 2023-06-08T05:02:11.995 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/289 2023-06-08T05:02:11.996 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:12.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:12.086 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-06-08T05:02:12.328 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:12.333 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:12.333 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:12.334 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:12.334 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:13.266 INFO:teuthology.orchestra.run.smithi043.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:13.317 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/290 2023-06-08T05:02:13.318 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/290 2023-06-08T05:02:13.318 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:13.335 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:13.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:13.396 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-06-08T05:02:13.632 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:13.636 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:13.637 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:13.638 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:13.638 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:14.553 INFO:teuthology.orchestra.run.smithi043.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:14.576 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/291 2023-06-08T05:02:14.576 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/291 2023-06-08T05:02:14.576 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:14.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:14.682 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-06-08T05:02:14.922 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:14.926 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:14.926 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:14.927 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:14.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:15.947 INFO:teuthology.orchestra.run.smithi043.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:15.961 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/292 2023-06-08T05:02:15.961 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/292 2023-06-08T05:02:15.961 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:15.965 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:15.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:15.995 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-06-08T05:02:16.222 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:16.226 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:16.227 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:16.228 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:16.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:17.115 INFO:teuthology.orchestra.run.smithi043.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:17.250 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/293 2023-06-08T05:02:17.250 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/293 2023-06-08T05:02:17.250 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:17.253 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:17.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:17.286 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-06-08T05:02:17.517 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:17.522 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:17.522 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:17.523 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:17.523 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:18.918 INFO:teuthology.orchestra.run.smithi043.stdout:generic/294 1s 2023-06-08T05:02:18.992 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/294 2023-06-08T05:02:18.992 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:19.106 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:19.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:19.114 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-06-08T05:02:19.355 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:19.360 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:19.360 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:19.361 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:19.361 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:21.134 INFO:teuthology.orchestra.run.smithi043.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:21.160 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/295 2023-06-08T05:02:21.160 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/295 2023-06-08T05:02:21.160 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:21.206 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:21.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:21.279 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-06-08T05:02:21.505 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:21.510 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:21.510 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:21.511 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:21.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:22.161 INFO:teuthology.orchestra.run.smithi043.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:22.400 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/296 2023-06-08T05:02:22.400 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/296 2023-06-08T05:02:22.400 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:22.500 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:22.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:22.578 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-06-08T05:02:22.803 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:22.808 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:22.809 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:23.758 INFO:teuthology.orchestra.run.smithi043.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:23.785 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/297 2023-06-08T05:02:23.785 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/297 2023-06-08T05:02:23.785 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:23.823 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:23.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:23.861 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-06-08T05:02:24.086 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:24.090 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:24.091 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:24.092 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:24.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:24.919 INFO:teuthology.orchestra.run.smithi043.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:24.961 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/298 2023-06-08T05:02:24.961 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/298 2023-06-08T05:02:24.961 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:24.989 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:25.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:25.069 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-06-08T05:02:25.331 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:25.335 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:25.335 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:25.336 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:25.336 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:25.766 INFO:teuthology.orchestra.run.smithi043.stdout:generic/299 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:02:25.770 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/299 2023-06-08T05:02:25.770 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/299 2023-06-08T05:02:25.770 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:25.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:25.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:25.808 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-06-08T05:02:26.032 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:26.036 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:26.037 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:26.038 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:26.038 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:26.476 INFO:teuthology.orchestra.run.smithi043.stdout:generic/300 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:02:26.480 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/300 2023-06-08T05:02:26.481 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/300 2023-06-08T05:02:26.481 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:26.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:26.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:26.515 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-06-08T05:02:26.735 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:26.739 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:26.740 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:26.741 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:26.741 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:27.358 INFO:teuthology.orchestra.run.smithi043.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:27.365 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/301 2023-06-08T05:02:27.365 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/301 2023-06-08T05:02:27.365 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:27.650 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:27.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:27.757 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-06-08T05:02:27.985 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:27.989 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:27.989 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:27.990 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:27.990 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:28.972 INFO:teuthology.orchestra.run.smithi043.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:28.990 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/302 2023-06-08T05:02:28.990 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/302 2023-06-08T05:02:28.990 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:29.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:29.022 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-06-08T05:02:29.246 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:29.250 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:29.250 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:29.251 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:29.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:29.650 INFO:teuthology.orchestra.run.smithi043.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T05:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/303 2023-06-08T05:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/303 2023-06-08T05:02:29.655 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:29.657 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:30.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:30.122 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-06-08T05:02:30.356 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:30.360 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:30.361 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:30.362 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:30.362 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:30.756 INFO:teuthology.orchestra.run.smithi043.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T05:02:30.760 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/304 2023-06-08T05:02:30.760 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/304 2023-06-08T05:02:30.760 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:30.762 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:31.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:31.199 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-06-08T05:02:31.453 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:31.457 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:31.458 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:31.459 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:31.459 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:32.396 INFO:teuthology.orchestra.run.smithi043.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:02:32.429 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/305 2023-06-08T05:02:32.429 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/305 2023-06-08T05:02:32.429 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:32.463 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:32.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:32.531 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-06-08T05:02:32.818 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:32.822 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:32.823 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:32.824 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:32.824 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:33.968 INFO:teuthology.orchestra.run.smithi043.stdout:generic/306 0s 2023-06-08T05:02:33.990 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/306 2023-06-08T05:02:33.990 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:33.992 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:34.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:34.394 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-06-08T05:02:34.674 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:34.678 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:34.678 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:34.679 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:34.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:36.551 INFO:teuthology.orchestra.run.smithi043.stdout:generic/307 2s 2023-06-08T05:02:36.556 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/307 2023-06-08T05:02:36.556 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:36.558 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:36.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:36.567 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-06-08T05:02:36.800 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:36.804 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:36.805 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:36.806 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:36.806 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:37.217 INFO:teuthology.orchestra.run.smithi043.stdout:generic/308 0s 2023-06-08T05:02:37.223 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/308 2023-06-08T05:02:37.223 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:37.225 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:37.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:37.254 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-06-08T05:02:37.508 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:37.512 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:37.513 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:37.514 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:37.514 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:38.923 INFO:teuthology.orchestra.run.smithi043.stdout:generic/309 1s 2023-06-08T05:02:38.928 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/309 2023-06-08T05:02:38.928 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:02:38.930 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:02:39.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:02:39.323 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-06-08T05:02:39.608 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:02:39.612 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:02:39.613 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:02:39.614 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:02:39.614 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:03:25.813 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:25.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:55.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:55.965 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:56.219 INFO:teuthology.orchestra.run.smithi043.stdout:generic/310 77s 2023-06-08T05:03:56.225 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/310 2023-06-08T05:03:56.225 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:03:56.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:03:56.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:03:56.508 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-06-08T05:03:57.067 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:03:57.071 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:03:57.071 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:03:57.072 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:03:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:03:57.484 INFO:teuthology.orchestra.run.smithi043.stdout:generic/311 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:03:57.488 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/311 2023-06-08T05:03:57.488 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/311 2023-06-08T05:03:57.488 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:03:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:03:57.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:03:57.512 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-06-08T05:03:57.739 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:03:57.744 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:03:57.744 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:03:57.745 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:03:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:03:58.089 INFO:teuthology.orchestra.run.smithi043.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:03:58.093 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/312 2023-06-08T05:03:58.093 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/312 2023-06-08T05:03:58.093 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:03:58.095 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:03:58.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:03:58.119 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-06-08T05:03:58.341 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:03:58.345 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:03:58.345 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:03:58.346 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:03:58.346 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:02.769 INFO:teuthology.orchestra.run.smithi043.stdout:generic/313 4s 2023-06-08T05:04:02.775 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/313 2023-06-08T05:04:02.775 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:02.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:02.811 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-06-08T05:04:03.039 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:03.043 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:03.044 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:03.045 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:generic/314 0s 2023-06-08T05:04:03.671 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/314 2023-06-08T05:04:03.672 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:03.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:03.706 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-06-08T05:04:03.931 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:03.936 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:04.280 INFO:teuthology.orchestra.run.smithi043.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T05:04:04.284 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/315 2023-06-08T05:04:04.285 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/315 2023-06-08T05:04:04.285 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:04.287 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:04.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:04.321 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-06-08T05:04:04.541 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:04.546 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:04.546 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:04.547 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:04.547 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:05.023 INFO:teuthology.orchestra.run.smithi043.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T05:04:05.027 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/316 2023-06-08T05:04:05.027 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/316 2023-06-08T05:04:05.028 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:05.029 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:05.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:05.194 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-06-08T05:04:05.668 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:05.673 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:05.673 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:05.674 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:05.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:09.859 INFO:teuthology.orchestra.run.smithi043.stdout:generic/317 4s 2023-06-08T05:04:09.864 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/317 2023-06-08T05:04:09.865 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:09.867 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:09.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:09.876 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-06-08T05:04:10.102 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:10.106 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:10.107 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:10.108 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:10.108 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:10.953 INFO:teuthology.orchestra.run.smithi043.stdout:generic/318 0s 2023-06-08T05:04:10.958 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/318 2023-06-08T05:04:10.958 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:10.960 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:10.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:10.969 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-06-08T05:04:11.191 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:11.195 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:11.196 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:11.197 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:11.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:11.809 INFO:teuthology.orchestra.run.smithi043.stdout:generic/319 0s 2023-06-08T05:04:11.814 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/319 2023-06-08T05:04:11.814 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:11.816 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:11.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:11.825 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-06-08T05:04:12.046 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:12.050 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:12.050 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:12.051 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:12.051 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:12.409 INFO:teuthology.orchestra.run.smithi043.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:04:12.413 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/320 2023-06-08T05:04:12.413 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/320 2023-06-08T05:04:12.413 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:12.415 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:12.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:12.441 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-06-08T05:04:12.662 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:12.666 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:12.666 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:12.667 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:12.668 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:13.018 INFO:teuthology.orchestra.run.smithi043.stdout:generic/321 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:04:13.023 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/321 2023-06-08T05:04:13.023 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/321 2023-06-08T05:04:13.023 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:13.025 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:13.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:13.047 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-06-08T05:04:13.268 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:13.272 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:13.273 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:13.274 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:13.274 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:13.631 INFO:teuthology.orchestra.run.smithi043.stdout:generic/322 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:04:13.635 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/322 2023-06-08T05:04:13.636 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/322 2023-06-08T05:04:13.636 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:04:13.638 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:13.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:04:13.669 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-06-08T05:04:13.893 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:04:13.897 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:04:13.898 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:04:13.899 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:04:13.899 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:04:26.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:26.038 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:56.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:56.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:26.368 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:26.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:56.485 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:56.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:14.891 INFO:teuthology.orchestra.run.smithi043.stdout:generic/323 120s 2023-06-08T05:06:14.921 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/323 2023-06-08T05:06:14.922 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:14.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:15.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:15.313 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-06-08T05:06:15.565 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:15.569 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:15.569 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:15.570 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:15.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:16.141 INFO:teuthology.orchestra.run.smithi043.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-06-08T05:06:16.145 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/324 2023-06-08T05:06:16.145 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/324 2023-06-08T05:06:16.145 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:16.147 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:16.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:16.170 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-06-08T05:06:16.399 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:16.403 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:16.403 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:16.404 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:16.405 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:16.973 INFO:teuthology.orchestra.run.smithi043.stdout:generic/325 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:06:16.979 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/325 2023-06-08T05:06:16.980 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/325 2023-06-08T05:06:16.980 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:16.980 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:17.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:17.014 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-06-08T05:06:17.235 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:17.239 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:17.240 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:17.241 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:17.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:18.139 INFO:teuthology.orchestra.run.smithi043.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:18.149 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/326 2023-06-08T05:06:18.149 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/326 2023-06-08T05:06:18.149 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:18.153 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:18.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:18.306 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-06-08T05:06:18.530 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:18.534 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:18.535 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:18.536 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:18.536 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:19.513 INFO:teuthology.orchestra.run.smithi043.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:19.535 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/327 2023-06-08T05:06:19.535 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/327 2023-06-08T05:06:19.535 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:19.545 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:19.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:19.573 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-06-08T05:06:19.802 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:19.806 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:19.806 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:19.808 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:19.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:20.742 INFO:teuthology.orchestra.run.smithi043.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:20.751 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/328 2023-06-08T05:06:20.752 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/328 2023-06-08T05:06:20.752 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:20.754 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:20.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:20.785 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-06-08T05:06:21.007 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:21.011 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:21.012 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:21.012 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:21.012 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:21.977 INFO:teuthology.orchestra.run.smithi043.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:21.984 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/329 2023-06-08T05:06:21.985 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/329 2023-06-08T05:06:21.985 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:21.989 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:22.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:22.027 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-06-08T05:06:22.246 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:22.250 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:22.250 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:22.251 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:22.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:23.126 INFO:teuthology.orchestra.run.smithi043.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:23.134 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/330 2023-06-08T05:06:23.134 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/330 2023-06-08T05:06:23.135 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:23.151 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:23.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:23.209 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-06-08T05:06:23.443 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:23.447 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:23.447 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:23.448 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:23.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:24.405 INFO:teuthology.orchestra.run.smithi043.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:24.415 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/331 2023-06-08T05:06:24.415 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/331 2023-06-08T05:06:24.416 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:24.418 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:24.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:24.448 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-06-08T05:06:24.671 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:24.676 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:24.676 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:24.677 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:24.677 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:25.605 INFO:teuthology.orchestra.run.smithi043.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:25.621 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/332 2023-06-08T05:06:25.622 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/332 2023-06-08T05:06:25.622 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:25.627 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:25.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:25.658 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-06-08T05:06:25.876 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:25.880 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:25.881 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:25.881 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:25.882 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:26.667 INFO:teuthology.orchestra.run.smithi043.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:26.812 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/333 2023-06-08T05:06:26.813 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/333 2023-06-08T05:06:26.813 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:26.819 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:26.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:26.852 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-06-08T05:06:26.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:26.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:27.013 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T05:06:27.010+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367193) UID: 0 2023-06-08T05:06:27.013 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T05:06:27.010+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367193) UID: 0 2023-06-08T05:06:27.014 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T05:06:27.010+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367193) UID: 0 2023-06-08T05:06:27.014 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T05:06:27.011+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367193) UID: 0 2023-06-08T05:06:27.103 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:27.108 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:27.108 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:27.109 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:27.110 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:27.805 INFO:teuthology.orchestra.run.smithi043.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:06:27.811 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/334 2023-06-08T05:06:27.812 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/334 2023-06-08T05:06:27.812 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:27.815 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:28.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:28.130 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-06-08T05:06:28.373 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:28.377 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:28.378 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:28.379 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:28.379 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:28.737 INFO:teuthology.orchestra.run.smithi043.stdout:generic/335 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:06:28.741 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/335 2023-06-08T05:06:28.742 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/335 2023-06-08T05:06:28.742 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:28.744 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:28.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:28.769 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-06-08T05:06:28.989 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:28.993 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:28.993 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:28.994 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:28.994 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:29.364 INFO:teuthology.orchestra.run.smithi043.stdout:generic/336 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:06:29.368 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/336 2023-06-08T05:06:29.369 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/336 2023-06-08T05:06:29.369 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:29.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:29.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:29.406 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-06-08T05:06:29.631 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:29.635 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:29.635 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:29.636 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:29.636 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:30.275 INFO:teuthology.orchestra.run.smithi043.stdout:generic/337 1s 2023-06-08T05:06:30.280 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/337 2023-06-08T05:06:30.280 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:30.282 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:30.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:30.290 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-06-08T05:06:30.522 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:30.526 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:30.526 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:30.527 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:30.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:30.892 INFO:teuthology.orchestra.run.smithi043.stdout:generic/338 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:06:30.896 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/338 2023-06-08T05:06:30.897 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/338 2023-06-08T05:06:30.897 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:06:30.899 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:06:30.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:06:30.923 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-06-08T05:06:31.144 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:06:31.148 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:06:31.148 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:06:31.149 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:06:31.149 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:28.754 INFO:teuthology.orchestra.run.smithi043.stdout:generic/339 57s 2023-06-08T05:07:28.759 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/339 2023-06-08T05:07:28.759 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:28.761 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:28.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:28.770 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-06-08T05:07:29.015 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:29.019 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:29.020 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:29.020 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:29.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:32.582 INFO:teuthology.orchestra.run.smithi043.stdout:generic/340 3s 2023-06-08T05:07:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/340 2023-06-08T05:07:32.681 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:32.701 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:32.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:32.745 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-06-08T05:07:33.348 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:33.352 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:33.353 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:33.354 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:33.354 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:34.526 INFO:teuthology.orchestra.run.smithi043.stdout:generic/341 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:07:34.530 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/341 2023-06-08T05:07:34.531 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/341 2023-06-08T05:07:34.531 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:34.533 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:34.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:34.558 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-06-08T05:07:34.782 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:34.786 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:34.787 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:34.788 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:34.788 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:35.364 INFO:teuthology.orchestra.run.smithi043.stdout:generic/342 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:07:35.368 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/342 2023-06-08T05:07:35.369 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/342 2023-06-08T05:07:35.369 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:35.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:35.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:35.395 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-06-08T05:07:35.622 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:35.626 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:35.627 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:35.628 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:35.628 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:36.600 INFO:teuthology.orchestra.run.smithi043.stdout:generic/343 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:07:36.604 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/343 2023-06-08T05:07:36.604 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/343 2023-06-08T05:07:36.604 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:36.606 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:36.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:36.637 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-06-08T05:07:36.864 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:36.868 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:36.869 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:36.870 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:36.870 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:42.502 INFO:teuthology.orchestra.run.smithi043.stdout:generic/344 5s 2023-06-08T05:07:42.531 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/344 2023-06-08T05:07:42.532 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:42.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:42.578 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-06-08T05:07:43.276 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:43.288 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:43.288 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:43.289 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:48.924 INFO:teuthology.orchestra.run.smithi043.stdout:generic/345 5s 2023-06-08T05:07:48.961 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/345 2023-06-08T05:07:48.961 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:48.968 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:48.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:48.978 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-06-08T05:07:49.218 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:49.222 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:49.223 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:49.223 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:49.224 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:53.209 INFO:teuthology.orchestra.run.smithi043.stdout:generic/346 4s 2023-06-08T05:07:53.223 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/346 2023-06-08T05:07:53.223 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:53.271 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:53.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:53.290 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-06-08T05:07:53.872 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:53.877 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:53.878 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:53.879 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:53.879 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:54.379 INFO:teuthology.orchestra.run.smithi043.stdout:generic/347 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:07:54.383 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/347 2023-06-08T05:07:54.383 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/347 2023-06-08T05:07:54.383 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:54.385 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:54.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:54.411 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-06-08T05:07:54.642 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:54.646 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:54.647 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:54.647 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:54.648 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:55.044 INFO:teuthology.orchestra.run.smithi043.stdout:generic/348 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:07:55.048 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/348 2023-06-08T05:07:55.048 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/348 2023-06-08T05:07:55.048 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:55.050 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:55.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:55.085 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-06-08T05:07:55.311 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:55.316 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:55.316 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:55.317 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:55.317 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:55.813 INFO:teuthology.orchestra.run.smithi043.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T05:07:55.817 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/349 2023-06-08T05:07:55.817 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/349 2023-06-08T05:07:55.817 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:55.819 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:55.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:55.850 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-06-08T05:07:56.074 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:56.079 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:56.079 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:56.080 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:56.080 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout:generic/350 1s 2023-06-08T05:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/350 2023-06-08T05:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:57.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:57.505 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-06-08T05:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:58.194 INFO:teuthology.orchestra.run.smithi043.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:07:58.198 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/351 2023-06-08T05:07:58.198 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/351 2023-06-08T05:07:58.198 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:58.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:58.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:58.231 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-06-08T05:07:58.471 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:58.476 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:58.476 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:58.477 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:58.477 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:59.579 INFO:teuthology.orchestra.run.smithi043.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:07:59.616 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/352 2023-06-08T05:07:59.616 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/352 2023-06-08T05:07:59.617 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:07:59.639 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:07:59.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:07:59.675 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-06-08T05:07:59.899 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:07:59.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:07:59.903 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:07:59.904 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:07:59.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:00.900 INFO:teuthology.orchestra.run.smithi043.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:08:00.921 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/353 2023-06-08T05:08:00.922 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/353 2023-06-08T05:08:00.922 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:00.923 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:00.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:00.966 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-06-08T05:08:01.192 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:01.196 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:01.196 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:01.197 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:01.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:06.622 INFO:teuthology.orchestra.run.smithi043.stdout:generic/354 5s 2023-06-08T05:08:06.631 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/354 2023-06-08T05:08:06.631 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:06.634 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:06.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:06.648 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-06-08T05:08:07.270 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:07.278 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:07.278 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:07.278 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:07.279 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:08.288 INFO:teuthology.orchestra.run.smithi043.stdout:generic/355 1s 2023-06-08T05:08:08.293 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/355 2023-06-08T05:08:08.293 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:08.295 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:08.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:08.676 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-06-08T05:08:09.015 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:09.019 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:09.020 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:09.021 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:09.021 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:09.662 INFO:teuthology.orchestra.run.smithi043.stdout:generic/356 [not run] swapfiles are not supported 2023-06-08T05:08:09.666 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/356 2023-06-08T05:08:09.666 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/356 2023-06-08T05:08:09.666 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:09.668 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:09.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:09.698 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-06-08T05:08:09.933 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:09.937 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:09.938 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:09.939 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:09.939 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:10.564 INFO:teuthology.orchestra.run.smithi043.stdout:generic/357 [not run] swapfiles are not supported 2023-06-08T05:08:10.568 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/357 2023-06-08T05:08:10.568 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/357 2023-06-08T05:08:10.568 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:10.570 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:10.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:10.599 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-06-08T05:08:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:10.827 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:10.827 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:10.828 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:10.828 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:11.841 INFO:teuthology.orchestra.run.smithi043.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:08:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/358 2023-06-08T05:08:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/358 2023-06-08T05:08:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:11.849 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:11.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:11.880 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-06-08T05:08:12.120 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:12.124 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:12.124 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:12.125 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:12.125 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:08:13.107 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/359 2023-06-08T05:08:13.107 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/359 2023-06-08T05:08:13.108 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:13.111 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:13.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:13.141 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-06-08T05:08:13.377 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:13.381 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:13.381 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:13.382 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:13.383 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:13.800 INFO:teuthology.orchestra.run.smithi043.stdout:generic/360 0s 2023-06-08T05:08:13.805 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/360 2023-06-08T05:08:13.805 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:13.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:13.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:13.837 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-06-08T05:08:14.071 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:14.075 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:14.076 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:14.077 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:14.077 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:14.507 INFO:teuthology.orchestra.run.smithi043.stdout:generic/361 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:08:14.511 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/361 2023-06-08T05:08:14.511 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/361 2023-06-08T05:08:14.511 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:14.513 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:14.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:14.539 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-06-08T05:08:14.774 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:14.779 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:14.779 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:14.780 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:14.780 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:15.156 INFO:teuthology.orchestra.run.smithi043.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:15.160 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/362 2023-06-08T05:08:15.160 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/362 2023-06-08T05:08:15.160 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:15.162 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:15.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:15.181 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-06-08T05:08:15.434 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:15.438 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:15.439 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:15.440 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:15.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:16.325 INFO:teuthology.orchestra.run.smithi043.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:16.329 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/363 2023-06-08T05:08:16.329 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/363 2023-06-08T05:08:16.329 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:16.331 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:16.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:16.359 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-06-08T05:08:16.594 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:16.598 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:16.598 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:16.599 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:16.600 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:17.049 INFO:teuthology.orchestra.run.smithi043.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:17.053 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/364 2023-06-08T05:08:17.053 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/364 2023-06-08T05:08:17.053 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:17.055 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:17.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:17.187 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-06-08T05:08:17.413 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:17.418 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:17.418 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:17.419 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:17.419 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:17.899 INFO:teuthology.orchestra.run.smithi043.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:17.903 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/365 2023-06-08T05:08:17.903 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/365 2023-06-08T05:08:17.903 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:17.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:18.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:18.040 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-06-08T05:08:18.263 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:18.267 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:18.268 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:18.269 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:18.269 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:18.625 INFO:teuthology.orchestra.run.smithi043.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:18.629 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/366 2023-06-08T05:08:18.629 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/366 2023-06-08T05:08:18.629 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:18.631 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:18.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:18.661 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-06-08T05:08:18.887 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:18.892 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:18.892 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:18.893 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:18.893 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:19.242 INFO:teuthology.orchestra.run.smithi043.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:19.246 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/367 2023-06-08T05:08:19.246 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/367 2023-06-08T05:08:19.246 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:19.248 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:19.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:19.273 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-06-08T05:08:19.497 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:19.501 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:19.502 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:19.503 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:19.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:19.844 INFO:teuthology.orchestra.run.smithi043.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:19.848 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/368 2023-06-08T05:08:19.848 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/368 2023-06-08T05:08:19.848 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:19.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:19.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:19.877 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-06-08T05:08:20.106 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:20.111 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:20.111 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:20.112 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:20.112 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:20.481 INFO:teuthology.orchestra.run.smithi043.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:20.485 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/369 2023-06-08T05:08:20.486 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/369 2023-06-08T05:08:20.486 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:20.488 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:20.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:20.519 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-06-08T05:08:20.752 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:20.756 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:20.756 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:20.757 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:20.757 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:21.122 INFO:teuthology.orchestra.run.smithi043.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-08T05:08:21.126 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/370 2023-06-08T05:08:21.127 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/370 2023-06-08T05:08:21.127 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:21.129 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:21.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:21.155 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-06-08T05:08:21.378 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:21.382 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:21.383 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:21.384 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:21.384 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:21.748 INFO:teuthology.orchestra.run.smithi043.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:08:21.752 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/371 2023-06-08T05:08:21.753 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/371 2023-06-08T05:08:21.753 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:21.754 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:21.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:21.782 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-06-08T05:08:22.005 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:22.009 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:22.010 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:22.011 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:22.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:22.952 INFO:teuthology.orchestra.run.smithi043.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:08:22.965 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/372 2023-06-08T05:08:22.966 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/372 2023-06-08T05:08:22.966 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:22.969 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:23.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:23.005 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-06-08T05:08:23.229 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:23.233 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:23.234 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:23.235 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:23.235 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:24.208 INFO:teuthology.orchestra.run.smithi043.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:08:24.216 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/373 2023-06-08T05:08:24.216 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/373 2023-06-08T05:08:24.216 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:24.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:24.259 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-06-08T05:08:24.482 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:24.486 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:24.487 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:24.488 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:24.488 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:25.052 INFO:teuthology.orchestra.run.smithi043.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-08T05:08:25.452 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/374 2023-06-08T05:08:25.452 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/374 2023-06-08T05:08:25.452 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:25.455 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:25.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:25.504 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-06-08T05:08:25.729 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:25.733 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:25.734 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:25.735 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:25.735 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:26.177 INFO:teuthology.orchestra.run.smithi043.stdout:generic/375 1s 2023-06-08T05:08:26.182 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/375 2023-06-08T05:08:26.182 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:26.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:26.489 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-06-08T05:08:26.830 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:26.834 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:26.835 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:26.836 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:26.836 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:27.190 INFO:teuthology.orchestra.run.smithi043.stdout:generic/376 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:08:27.194 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/376 2023-06-08T05:08:27.194 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/376 2023-06-08T05:08:27.195 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:27.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:27.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:27.224 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-06-08T05:08:27.446 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:27.450 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:27.451 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:27.452 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:27.452 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:28.133 INFO:teuthology.orchestra.run.smithi043.stdout:generic/377 1s 2023-06-08T05:08:28.137 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/377 2023-06-08T05:08:28.138 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:28.140 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:28.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:28.148 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-06-08T05:08:28.382 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:28.386 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:28.386 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:28.387 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:28.388 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:28.892 INFO:teuthology.orchestra.run.smithi043.stdout:generic/378 0s 2023-06-08T05:08:28.897 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/378 2023-06-08T05:08:28.897 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:28.899 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:29.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:29.176 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-06-08T05:08:29.558 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:29.562 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:29.562 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:29.563 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:29.564 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:29.937 INFO:teuthology.orchestra.run.smithi043.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:29.941 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/379 2023-06-08T05:08:29.941 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/379 2023-06-08T05:08:29.941 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:29.943 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:29.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:29.965 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-06-08T05:08:30.191 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:30.195 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:30.196 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:30.197 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:30.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:30.556 INFO:teuthology.orchestra.run.smithi043.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:30.560 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/380 2023-06-08T05:08:30.561 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/380 2023-06-08T05:08:30.561 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:30.563 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:30.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:30.589 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-06-08T05:08:30.812 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:30.816 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:30.816 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:30.817 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:30.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:31.154 INFO:teuthology.orchestra.run.smithi043.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:31.158 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/381 2023-06-08T05:08:31.158 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/381 2023-06-08T05:08:31.158 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:31.160 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:31.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:31.191 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-06-08T05:08:31.420 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:31.424 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:31.424 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:31.425 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:31.425 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:31.773 INFO:teuthology.orchestra.run.smithi043.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:31.777 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/382 2023-06-08T05:08:31.777 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/382 2023-06-08T05:08:31.778 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:31.779 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:31.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:31.808 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-06-08T05:08:32.033 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:32.037 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:32.038 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:32.039 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:32.039 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:32.384 INFO:teuthology.orchestra.run.smithi043.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:32.388 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/383 2023-06-08T05:08:32.388 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/383 2023-06-08T05:08:32.388 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:32.390 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:32.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:32.424 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-06-08T05:08:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:32.656 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:32.658 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:32.999 INFO:teuthology.orchestra.run.smithi043.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:33.003 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/384 2023-06-08T05:08:33.003 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/384 2023-06-08T05:08:33.003 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:33.005 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:33.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:33.034 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-06-08T05:08:33.267 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:33.271 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:33.272 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:33.273 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:33.273 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:33.630 INFO:teuthology.orchestra.run.smithi043.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:33.634 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/385 2023-06-08T05:08:33.635 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/385 2023-06-08T05:08:33.635 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:33.636 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:33.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:33.665 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-06-08T05:08:33.900 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:33.904 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:33.905 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:33.906 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:33.906 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:34.240 INFO:teuthology.orchestra.run.smithi043.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:34.244 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/386 2023-06-08T05:08:34.244 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/386 2023-06-08T05:08:34.245 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:34.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:34.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:34.272 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-06-08T05:08:34.502 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:34.506 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:34.507 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:34.508 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:34.508 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:35.436 INFO:teuthology.orchestra.run.smithi043.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:08:35.445 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/387 2023-06-08T05:08:35.445 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/387 2023-06-08T05:08:35.445 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:35.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:35.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:35.520 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-06-08T05:08:35.742 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:35.747 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:35.747 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:35.748 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:35.748 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:36.127 INFO:teuthology.orchestra.run.smithi043.stdout:generic/388 [not run] require 172.21.15.43:6789:/scratch to be local device 2023-06-08T05:08:36.131 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/388 2023-06-08T05:08:36.132 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/388 2023-06-08T05:08:36.132 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:36.134 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:36.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:36.161 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-06-08T05:08:36.381 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:36.385 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:36.385 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:36.386 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:36.387 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:36.741 INFO:teuthology.orchestra.run.smithi043.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-06-08T05:08:36.745 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/389 2023-06-08T05:08:36.745 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/389 2023-06-08T05:08:36.746 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:36.747 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:36.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:36.775 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-06-08T05:08:36.998 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:37.003 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:37.004 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:37.364 INFO:teuthology.orchestra.run.smithi043.stdout:generic/390 [not run] ceph does not support freezing 2023-06-08T05:08:37.368 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/390 2023-06-08T05:08:37.368 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/390 2023-06-08T05:08:37.368 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:37.370 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:37.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:37.398 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-06-08T05:08:37.627 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:37.631 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:37.631 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:37.632 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:37.632 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:37.997 INFO:teuthology.orchestra.run.smithi043.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:08:38.001 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/391 2023-06-08T05:08:38.001 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/391 2023-06-08T05:08:38.001 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:38.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:38.041 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-06-08T05:08:38.271 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:38.276 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:38.276 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:38.277 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:38.277 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:38.815 INFO:teuthology.orchestra.run.smithi043.stdout:generic/392 [not run] ceph does not support shutdown 2023-06-08T05:08:38.831 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/392 2023-06-08T05:08:38.831 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/392 2023-06-08T05:08:38.831 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:38.833 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:38.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:38.854 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-06-08T05:08:39.081 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:39.085 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:39.086 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:39.087 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:39.087 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:40.264 INFO:teuthology.orchestra.run.smithi043.stdout:generic/393 1s 2023-06-08T05:08:40.269 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/393 2023-06-08T05:08:40.269 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:40.271 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:40.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:40.280 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-06-08T05:08:40.504 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:40.508 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:40.508 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:40.510 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:40.510 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:40.913 INFO:teuthology.orchestra.run.smithi043.stdout:generic/394 0s 2023-06-08T05:08:40.917 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/394 2023-06-08T05:08:40.918 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:40.920 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:41.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:41.339 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-06-08T05:08:41.715 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:41.722 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:41.722 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:41.724 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:41.724 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:42.669 INFO:teuthology.orchestra.run.smithi043.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-06-08T05:08:42.697 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/395 2023-06-08T05:08:42.698 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/395 2023-06-08T05:08:42.698 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:42.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:42.751 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-06-08T05:08:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:43.652 INFO:teuthology.orchestra.run.smithi043.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-06-08T05:08:43.680 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/396 2023-06-08T05:08:43.680 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/396 2023-06-08T05:08:43.680 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:43.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:43.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:43.721 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-06-08T05:08:43.958 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:43.962 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:43.963 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:43.964 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:43.964 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:44.553 INFO:teuthology.orchestra.run.smithi043.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-06-08T05:08:44.581 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/397 2023-06-08T05:08:44.581 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/397 2023-06-08T05:08:44.581 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:44.583 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:44.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:44.611 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-06-08T05:08:44.837 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:44.841 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:44.842 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:44.843 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:44.843 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:45.447 INFO:teuthology.orchestra.run.smithi043.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-06-08T05:08:45.469 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/398 2023-06-08T05:08:45.469 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/398 2023-06-08T05:08:45.469 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:45.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:45.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:45.493 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-06-08T05:08:45.721 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:45.725 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:45.725 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:45.726 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:46.296 INFO:teuthology.orchestra.run.smithi043.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-06-08T05:08:46.321 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/399 2023-06-08T05:08:46.321 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/399 2023-06-08T05:08:46.321 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:46.323 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:46.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:46.348 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-06-08T05:08:46.584 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:46.588 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:46.589 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:46.590 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:46.590 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:46.942 INFO:teuthology.orchestra.run.smithi043.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T05:08:46.945 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/400 2023-06-08T05:08:46.946 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/400 2023-06-08T05:08:46.946 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:46.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:46.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:46.984 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-06-08T05:08:47.208 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:47.212 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:47.213 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:47.214 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:47.214 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:48.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:08:48.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:08:48.903 INFO:teuthology.orchestra.run.smithi043.stdout:generic/401 1s 2023-06-08T05:08:48.909 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/401 2023-06-08T05:08:48.910 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:48.912 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:48.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:48.923 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-06-08T05:08:49.212 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:49.217 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:49.217 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:49.218 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:49.218 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:49.783 INFO:teuthology.orchestra.run.smithi043.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-06-08T05:08:49.801 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/402 2023-06-08T05:08:49.801 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/402 2023-06-08T05:08:49.801 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:49.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:49.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:49.840 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-06-08T05:08:50.062 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:50.066 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:50.066 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:50.067 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:50.068 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:50.839 INFO:teuthology.orchestra.run.smithi043.stdout:generic/403 0s 2023-06-08T05:08:50.844 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/403 2023-06-08T05:08:50.844 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:50.846 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:50.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:50.855 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-06-08T05:08:51.076 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:51.080 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:51.080 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:51.081 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:51.081 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:51.455 INFO:teuthology.orchestra.run.smithi043.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:08:51.459 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/404 2023-06-08T05:08:51.459 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/404 2023-06-08T05:08:51.459 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:51.461 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:51.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:51.499 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-06-08T05:08:51.721 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:51.725 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:51.725 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:51.726 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:51.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:52.102 INFO:teuthology.orchestra.run.smithi043.stdout:generic/405 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:08:52.106 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/405 2023-06-08T05:08:52.107 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/405 2023-06-08T05:08:52.107 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:52.109 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:52.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:52.138 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-06-08T05:08:52.359 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:52.363 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:52.363 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:52.364 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:52.365 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:54.159 INFO:teuthology.orchestra.run.smithi043.stdout:generic/406 2s 2023-06-08T05:08:54.164 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/406 2023-06-08T05:08:54.164 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:54.166 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:54.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:54.175 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-06-08T05:08:54.403 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:54.407 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:54.407 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:54.408 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:54.408 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:54.803 INFO:teuthology.orchestra.run.smithi043.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T05:08:54.807 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/407 2023-06-08T05:08:54.807 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/407 2023-06-08T05:08:54.808 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:54.810 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:55.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:55.089 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-06-08T05:08:55.532 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:55.536 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:55.537 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:55.538 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:55.538 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:55.927 INFO:teuthology.orchestra.run.smithi043.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T05:08:55.931 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/408 2023-06-08T05:08:55.931 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/408 2023-06-08T05:08:55.932 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:55.934 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:56.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:56.281 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-06-08T05:08:56.585 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:56.589 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:56.590 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:56.591 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:56.945 INFO:teuthology.orchestra.run.smithi043.stdout:generic/409 [not run] require 172.21.15.43:6789:/scratch to be local device 2023-06-08T05:08:56.949 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/409 2023-06-08T05:08:56.950 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/409 2023-06-08T05:08:56.950 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:56.951 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:56.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:56.976 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-06-08T05:08:57.216 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:57.220 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:57.221 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:57.222 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:57.578 INFO:teuthology.orchestra.run.smithi043.stdout:generic/410 [not run] require 172.21.15.43:6789:/scratch to be local device 2023-06-08T05:08:57.582 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/410 2023-06-08T05:08:57.582 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/410 2023-06-08T05:08:57.582 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:57.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:57.605 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-06-08T05:08:57.832 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:57.836 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:57.837 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:57.838 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:58.194 INFO:teuthology.orchestra.run.smithi043.stdout:generic/411 [not run] require 172.21.15.43:6789:/scratch to be local device 2023-06-08T05:08:58.198 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/411 2023-06-08T05:08:58.198 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/411 2023-06-08T05:08:58.198 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:58.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:58.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:58.231 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-06-08T05:08:58.458 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:58.462 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:58.462 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:58.463 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:58.464 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:59.258 INFO:teuthology.orchestra.run.smithi043.stdout:generic/412 1s 2023-06-08T05:08:59.263 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/412 2023-06-08T05:08:59.263 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:08:59.265 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:08:59.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:08:59.273 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-06-08T05:08:59.505 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:08:59.510 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:08:59.510 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:08:59.511 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:08:59.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:00.008 INFO:teuthology.orchestra.run.smithi043.stdout:generic/413 [not run] mount 172.21.15.43:6789:/scratch with dax failed 2023-06-08T05:09:00.012 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/413 2023-06-08T05:09:00.012 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/413 2023-06-08T05:09:00.013 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:00.014 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:00.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:00.041 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-06-08T05:09:00.262 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:00.266 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:00.267 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:00.268 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:00.268 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:00.987 INFO:teuthology.orchestra.run.smithi043.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:09:01.227 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/414 2023-06-08T05:09:01.227 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/414 2023-06-08T05:09:01.227 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:01.236 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:01.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:01.273 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-06-08T05:09:01.506 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:01.510 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:01.511 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:01.512 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:01.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:02.208 INFO:teuthology.orchestra.run.smithi043.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:09:02.352 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/415 2023-06-08T05:09:02.352 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/415 2023-06-08T05:09:02.353 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:02.464 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:02.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:02.515 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-06-08T05:09:02.747 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:02.752 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:02.752 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:02.753 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:03.112 INFO:teuthology.orchestra.run.smithi043.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:09:03.116 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/416 2023-06-08T05:09:03.116 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/416 2023-06-08T05:09:03.116 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:03.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:03.142 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-06-08T05:09:03.369 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:03.373 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:03.374 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:03.375 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:03.908 INFO:teuthology.orchestra.run.smithi043.stdout:generic/417 [not run] ceph does not support shutdown 2023-06-08T05:09:03.927 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/417 2023-06-08T05:09:03.927 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/417 2023-06-08T05:09:03.927 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:03.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:03.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:03.955 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-06-08T05:09:04.178 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:04.182 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:04.183 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:04.184 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:04.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:04.559 INFO:teuthology.orchestra.run.smithi043.stdout:generic/418 [not run] require 172.21.15.43:6789:/test to be valid block disk 2023-06-08T05:09:04.563 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/418 2023-06-08T05:09:04.563 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/418 2023-06-08T05:09:04.563 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:04.565 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:04.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:04.600 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-06-08T05:09:04.821 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:04.825 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:04.826 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:04.827 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:04.827 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:05.413 INFO:teuthology.orchestra.run.smithi043.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-06-08T05:09:05.437 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/419 2023-06-08T05:09:05.437 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/419 2023-06-08T05:09:05.437 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:05.439 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:05.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:05.463 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-06-08T05:09:05.698 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:05.703 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:05.703 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:05.704 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:05.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:06.216 INFO:teuthology.orchestra.run.smithi043.stdout:generic/420 1s 2023-06-08T05:09:06.220 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/420 2023-06-08T05:09:06.221 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:06.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:06.612 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-06-08T05:09:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:06.908 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:06.908 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:06.909 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:06.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:07.479 INFO:teuthology.orchestra.run.smithi043.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-06-08T05:09:07.496 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/421 2023-06-08T05:09:07.496 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/421 2023-06-08T05:09:07.496 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:07.498 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:07.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:07.525 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-06-08T05:09:07.750 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:07.754 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:07.754 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:07.755 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:07.755 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:08.120 INFO:teuthology.orchestra.run.smithi043.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T05:09:08.124 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/422 2023-06-08T05:09:08.124 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/422 2023-06-08T05:09:08.124 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:08.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:08.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:08.157 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-06-08T05:09:08.379 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:08.383 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:08.384 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:08.385 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:08.385 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:08.845 INFO:teuthology.orchestra.run.smithi043.stdout:generic/423 0s 2023-06-08T05:09:08.850 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/423 2023-06-08T05:09:08.850 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:08.852 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:09.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:09.230 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-06-08T05:09:09.510 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:09.514 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:09.514 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:09.515 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:09.515 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:09.880 INFO:teuthology.orchestra.run.smithi043.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-06-08T05:09:09.884 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/424 2023-06-08T05:09:09.884 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/424 2023-06-08T05:09:09.885 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:09.886 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:09.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:09.920 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-06-08T05:09:10.150 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:10.154 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:10.155 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:10.156 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:10.156 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:10.558 INFO:teuthology.orchestra.run.smithi043.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-06-08T05:09:10.562 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/425 2023-06-08T05:09:10.562 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/425 2023-06-08T05:09:10.562 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:10.564 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:10.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:10.909 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-06-08T05:09:11.203 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:11.207 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:11.207 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:11.208 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:11.209 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:18.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:18.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:48.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:49.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:57.244 INFO:teuthology.orchestra.run.smithi043.stdout:generic/426 46s 2023-06-08T05:09:57.321 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/426 2023-06-08T05:09:57.321 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:57.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:57.799 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-06-08T05:09:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:58.838 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:58.838 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:58.839 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:58.839 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:59.365 INFO:teuthology.orchestra.run.smithi043.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:09:59.369 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/427 2023-06-08T05:09:59.369 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/427 2023-06-08T05:09:59.369 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:09:59.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:09:59.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:09:59.407 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-06-08T05:09:59.634 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:09:59.639 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:09:59.639 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:09:59.640 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:09:59.640 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:00.037 INFO:teuthology.orchestra.run.smithi043.stdout:generic/428 1s 2023-06-08T05:10:00.042 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/428 2023-06-08T05:10:00.043 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:00.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:00.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:00.083 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-06-08T05:10:00.313 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:00.317 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:00.318 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:00.319 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:00.319 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:00.912 INFO:teuthology.orchestra.run.smithi043.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-06-08T05:10:00.934 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/429 2023-06-08T05:10:00.935 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/429 2023-06-08T05:10:00.935 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:00.937 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:00.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:00.969 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-06-08T05:10:01.195 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:01.199 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:01.199 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:01.200 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:01.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:01.657 INFO:teuthology.orchestra.run.smithi043.stdout:generic/430 0s 2023-06-08T05:10:01.662 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/430 2023-06-08T05:10:01.662 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:01.664 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:02.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:02.088 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-06-08T05:10:02.325 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:02.330 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:02.330 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:02.331 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:02.331 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:02.751 INFO:teuthology.orchestra.run.smithi043.stdout:generic/431 0s 2023-06-08T05:10:02.756 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/431 2023-06-08T05:10:02.756 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:03.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:03.104 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-06-08T05:10:03.435 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:03.439 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:03.440 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:03.441 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:03.891 INFO:teuthology.orchestra.run.smithi043.stdout:generic/432 0s 2023-06-08T05:10:03.896 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/432 2023-06-08T05:10:03.896 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:04.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:04.335 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-06-08T05:10:04.561 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:04.565 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:04.566 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:04.567 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:04.567 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:04.973 INFO:teuthology.orchestra.run.smithi043.stdout:generic/433 0s 2023-06-08T05:10:04.978 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/433 2023-06-08T05:10:04.978 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:04.980 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:05.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:05.413 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-06-08T05:10:05.640 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:05.644 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:05.644 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:05.645 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:05.645 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:06.082 INFO:teuthology.orchestra.run.smithi043.stdout:generic/434 1s 2023-06-08T05:10:06.087 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/434 2023-06-08T05:10:06.087 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:06.089 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:06.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:06.431 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-06-08T05:10:06.751 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:06.755 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:06.755 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:06.756 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:06.756 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:07.326 INFO:teuthology.orchestra.run.smithi043.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-06-08T05:10:07.351 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/435 2023-06-08T05:10:07.351 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/435 2023-06-08T05:10:07.351 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:07.353 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:07.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:07.377 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-06-08T05:10:07.611 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:07.615 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:07.616 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:07.617 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:07.617 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:08.352 INFO:teuthology.orchestra.run.smithi043.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:10:08.355 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/436 2023-06-08T05:10:08.356 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/436 2023-06-08T05:10:08.356 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:08.358 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:08.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:08.665 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-06-08T05:10:08.998 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:09.003 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:09.003 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:09.004 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:09.004 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:10.004 INFO:teuthology.orchestra.run.smithi043.stdout:generic/437 0s 2023-06-08T05:10:10.009 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/437 2023-06-08T05:10:10.009 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:10:10.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:10.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:10:10.050 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-06-08T05:10:10.274 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:10:10.278 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:10:10.279 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:10:10.280 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:10:10.280 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:10:19.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:19.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:49.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:49.909 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:19.980 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:19.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:21.105 INFO:teuthology.orchestra.run.smithi043.stdout:generic/438 71s 2023-06-08T05:11:21.110 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/438 2023-06-08T05:11:21.110 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:21.112 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:21.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:21.136 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-06-08T05:11:21.358 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:21.363 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:21.363 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:21.364 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:22.532 INFO:teuthology.orchestra.run.smithi043.stdout:generic/439 1s 2023-06-08T05:11:22.537 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/439 2023-06-08T05:11:22.538 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:22.539 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:22.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:22.566 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-06-08T05:11:22.794 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:22.799 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:22.799 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:22.800 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:22.800 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:23.347 INFO:teuthology.orchestra.run.smithi043.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-06-08T05:11:23.378 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/440 2023-06-08T05:11:23.379 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/440 2023-06-08T05:11:23.379 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:23.381 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:23.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:23.405 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-06-08T05:11:23.633 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:23.637 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:23.638 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:23.639 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:23.639 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:24.083 INFO:teuthology.orchestra.run.smithi043.stdout:generic/441 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:11:24.087 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/441 2023-06-08T05:11:24.087 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/441 2023-06-08T05:11:24.087 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:24.089 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:24.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:24.111 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-06-08T05:11:24.330 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:24.334 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:24.335 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:24.335 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:24.687 INFO:teuthology.orchestra.run.smithi043.stdout:generic/442 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:11:24.691 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/442 2023-06-08T05:11:24.691 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/442 2023-06-08T05:11:24.691 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:24.693 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:24.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:24.719 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-06-08T05:11:24.941 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:24.945 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:24.946 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:24.947 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:24.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:25.314 INFO:teuthology.orchestra.run.smithi043.stdout:generic/443 0s 2023-06-08T05:11:25.319 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/443 2023-06-08T05:11:25.319 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:25.321 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:25.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:25.351 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-06-08T05:11:25.576 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:25.581 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:25.581 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:25.582 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:25.582 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:26.010 INFO:teuthology.orchestra.run.smithi043.stdout:generic/444 1s 2023-06-08T05:11:26.015 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/444 2023-06-08T05:11:26.015 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:26.017 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:26.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:26.051 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-06-08T05:11:26.277 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:26.281 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:26.281 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:26.282 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:26.283 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:26.914 INFO:teuthology.orchestra.run.smithi043.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:11:26.918 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/445 2023-06-08T05:11:26.918 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/445 2023-06-08T05:11:26.919 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:26.920 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:27.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:27.212 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-06-08T05:11:27.536 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:27.540 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:27.541 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:27.542 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:27.542 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:47.404 INFO:teuthology.orchestra.run.smithi043.stdout:generic/446 20s 2023-06-08T05:11:47.544 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/446 2023-06-08T05:11:47.544 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:47.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:47.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:47.562 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-06-08T05:11:47.783 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:47.788 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:47.788 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:47.789 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:47.789 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:48.700 INFO:teuthology.orchestra.run.smithi043.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:11:48.742 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/447 2023-06-08T05:11:48.742 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/447 2023-06-08T05:11:48.743 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:48.750 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:48.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:48.775 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-06-08T05:11:48.995 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:48.999 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:49.000 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:49.001 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:49.001 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:49.993 INFO:teuthology.orchestra.run.smithi043.stdout:generic/448 0s 2023-06-08T05:11:49.998 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/448 2023-06-08T05:11:49.998 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:50.000 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:50.117 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:50.310 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:50.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:50.408 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-06-08T05:11:50.645 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:50.650 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:50.650 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:50.651 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:50.651 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:51.040 INFO:teuthology.orchestra.run.smithi043.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T05:11:51.044 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/449 2023-06-08T05:11:51.044 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/449 2023-06-08T05:11:51.044 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:51.046 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:51.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:51.431 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-06-08T05:11:51.684 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:51.688 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:51.689 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:51.690 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:51.690 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:52.413 INFO:teuthology.orchestra.run.smithi043.stdout:generic/450 1s 2023-06-08T05:11:52.417 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/450 2023-06-08T05:11:52.418 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:11:52.419 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:11:52.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:11:52.777 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-06-08T05:11:53.058 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:11:53.062 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:11:53.063 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:11:53.063 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:11:53.064 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:20.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:20.493 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:23.529 INFO:teuthology.orchestra.run.smithi043.stdout:generic/451 30s 2023-06-08T05:12:23.534 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/451 2023-06-08T05:12:23.534 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:23.536 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:23.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:23.932 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-06-08T05:12:24.168 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:24.172 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:24.173 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:24.174 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:24.174 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:24.774 INFO:teuthology.orchestra.run.smithi043.stdout:generic/452 0s 2023-06-08T05:12:24.779 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/452 2023-06-08T05:12:24.779 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:24.781 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:24.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:24.790 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-06-08T05:12:25.014 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:25.019 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:25.019 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:25.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:25.354 INFO:teuthology.orchestra.run.smithi043.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-06-08T05:12:25.358 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/453 2023-06-08T05:12:25.359 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/453 2023-06-08T05:12:25.359 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:25.361 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:25.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:25.380 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-06-08T05:12:25.604 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:25.608 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:25.608 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:25.609 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:25.609 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:25.962 INFO:teuthology.orchestra.run.smithi043.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-06-08T05:12:25.966 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/454 2023-06-08T05:12:25.966 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/454 2023-06-08T05:12:25.966 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:25.968 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:25.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:25.999 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-06-08T05:12:26.221 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:26.226 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:26.226 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:26.227 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:26.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:26.657 INFO:teuthology.orchestra.run.smithi043.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-08T05:12:26.661 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/455 2023-06-08T05:12:26.661 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/455 2023-06-08T05:12:26.661 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:26.663 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:26.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:26.688 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-06-08T05:12:26.908 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:26.912 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:26.912 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:26.913 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:26.913 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:27.263 INFO:teuthology.orchestra.run.smithi043.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T05:12:27.267 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/456 2023-06-08T05:12:27.267 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/456 2023-06-08T05:12:27.267 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:27.269 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:27.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:27.299 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-06-08T05:12:27.521 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:27.525 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:27.525 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:27.526 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:27.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:28.484 INFO:teuthology.orchestra.run.smithi043.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:12:28.499 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/457 2023-06-08T05:12:28.500 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/457 2023-06-08T05:12:28.500 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:28.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:28.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:28.526 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-06-08T05:12:28.742 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:28.747 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:28.747 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:28.748 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:28.748 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:29.670 INFO:teuthology.orchestra.run.smithi043.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T05:12:29.704 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/458 2023-06-08T05:12:29.705 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/458 2023-06-08T05:12:29.705 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:29.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:29.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:29.734 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-06-08T05:12:29.970 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:29.974 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:29.975 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:29.976 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:29.976 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:30.514 INFO:teuthology.orchestra.run.smithi043.stdout:generic/459 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:12:30.518 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/459 2023-06-08T05:12:30.519 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/459 2023-06-08T05:12:30.519 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:30.521 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:30.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:30.540 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-06-08T05:12:30.759 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:30.764 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:30.764 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:30.765 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:30.765 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:32.677 INFO:teuthology.orchestra.run.smithi043.stdout:generic/460 2s 2023-06-08T05:12:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/460 2023-06-08T05:12:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:32.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:32.693 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-06-08T05:12:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:32.916 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:32.916 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:32.917 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:33.442 INFO:teuthology.orchestra.run.smithi043.stdout:generic/461 [not run] ceph does not support shutdown 2023-06-08T05:12:33.446 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/461 2023-06-08T05:12:33.447 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/461 2023-06-08T05:12:33.447 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:33.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:33.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:33.473 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-06-08T05:12:33.691 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:33.695 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:33.695 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:33.696 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:33.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:34.367 INFO:teuthology.orchestra.run.smithi043.stdout:generic/462 [not run] mount 172.21.15.43:6789:/scratch with dax failed 2023-06-08T05:12:34.371 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/462 2023-06-08T05:12:34.371 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/462 2023-06-08T05:12:34.371 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:34.373 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:34.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:34.404 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-06-08T05:12:34.621 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:34.625 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:34.626 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:34.627 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:34.627 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:35.018 INFO:teuthology.orchestra.run.smithi043.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-06-08T05:12:35.022 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/463 2023-06-08T05:12:35.022 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/463 2023-06-08T05:12:35.022 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:12:35.024 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:35.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:12:35.289 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-06-08T05:12:35.663 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:12:35.667 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:12:35.668 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:12:35.669 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:12:35.669 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:12:50.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:50.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:20.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:20.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:32.993 INFO:teuthology.orchestra.run.smithi043.stdout:generic/464 57s 2023-06-08T05:13:32.998 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/464 2023-06-08T05:13:32.999 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:13:33.000 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:13:33.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:13:33.009 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-06-08T05:13:33.235 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:13:33.239 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:13:33.240 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:13:33.241 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:13:33.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:13:37.737 INFO:teuthology.orchestra.run.smithi043.stdout:generic/465 4s 2023-06-08T05:13:37.748 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/465 2023-06-08T05:13:37.749 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:13:37.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:13:37.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:13:37.762 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-06-08T05:13:37.991 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:13:37.995 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:13:37.996 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:13:37.997 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:13:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:13:38.331 INFO:teuthology.orchestra.run.smithi043.stdout:generic/466 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:13:38.335 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/466 2023-06-08T05:13:38.335 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/466 2023-06-08T05:13:38.335 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:13:38.337 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:13:38.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:13:38.401 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-06-08T05:13:38.626 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:13:38.630 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:13:38.631 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:13:38.632 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:13:38.632 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:13:51.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:51.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:21.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:21.841 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:38.124 INFO:teuthology.orchestra.run.smithi043.stdout:generic/467 60s 2023-06-08T05:14:38.226 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/467 2023-06-08T05:14:38.227 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:38.253 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:38.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:38.671 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-06-08T05:14:39.714 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:39.719 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:39.719 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:39.720 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:39.720 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:40.343 INFO:teuthology.orchestra.run.smithi043.stdout:generic/468 [not run] ceph does not support shutdown 2023-06-08T05:14:40.363 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/468 2023-06-08T05:14:40.363 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/468 2023-06-08T05:14:40.363 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:40.365 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:40.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:40.394 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-06-08T05:14:40.613 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:40.618 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:40.618 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:40.619 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:40.619 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:40.965 INFO:teuthology.orchestra.run.smithi043.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T05:14:40.970 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/469 2023-06-08T05:14:40.970 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/469 2023-06-08T05:14:40.970 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:40.972 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:40.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:40.996 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-06-08T05:14:41.220 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:41.224 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:41.225 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:41.226 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:41.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:41.648 INFO:teuthology.orchestra.run.smithi043.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-08T05:14:41.652 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/470 2023-06-08T05:14:41.652 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/470 2023-06-08T05:14:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:41.654 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:41.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:41.680 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-06-08T05:14:41.904 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:41.909 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:41.909 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:41.910 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:41.910 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:42.342 INFO:teuthology.orchestra.run.smithi043.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-06-08T05:14:42.345 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/471 2023-06-08T05:14:42.346 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/471 2023-06-08T05:14:42.346 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:42.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:42.759 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-06-08T05:14:42.996 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:42.997 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:42.998 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:42.998 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:43.633 INFO:teuthology.orchestra.run.smithi043.stdout:generic/472 [not run] swapfiles are not supported 2023-06-08T05:14:43.637 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/472 2023-06-08T05:14:43.637 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/472 2023-06-08T05:14:43.637 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:43.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:43.665 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-06-08T05:14:43.888 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:43.893 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:43.893 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:43.894 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:43.894 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T05:14:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/473 2023-06-08T05:14:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/473 2023-06-08T05:14:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:44.281 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:44.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:44.307 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-06-08T05:14:44.535 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:44.540 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:44.540 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:44.541 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:44.541 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:45.051 INFO:teuthology.orchestra.run.smithi043.stdout:generic/474 [not run] ceph does not support shutdown 2023-06-08T05:14:45.070 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/474 2023-06-08T05:14:45.070 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/474 2023-06-08T05:14:45.070 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:45.072 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:45.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:45.096 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-06-08T05:14:45.321 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:45.325 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:45.325 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:45.326 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:45.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:45.703 INFO:teuthology.orchestra.run.smithi043.stdout:generic/475 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T05:14:45.707 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/475 2023-06-08T05:14:45.707 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/475 2023-06-08T05:14:45.707 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T05:14:45.709 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:45.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T05:14:45.730 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-06-08T05:14:45.956 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T05:14:45.960 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T05:14:45.961 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T05:14:45.962 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T05:14:45.962 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T05:14:52.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:52.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:24.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:24.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:54.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:54.553 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:25.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:25.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:55.559 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:55.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:25.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:25.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:56.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:56.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:27.126 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:27.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:57.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:57.433 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:57.709 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T05:18:57.707+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618098) UID: 0 2023-06-08T05:18:57.712 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T05:18:57.711+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618098) UID: 0 2023-06-08T05:22:43.114 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T05:22:43.110+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618194) UID: 0 2023-06-08T05:22:43.114 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T05:22:43.111+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618194) UID: 0 2023-06-08T05:22:43.115 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T05:22:43.110+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618194) UID: 0 2023-06-08T05:22:43.115 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T05:22:43.111+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618194) UID: 0 2023-06-08T05:27:23.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:27:23.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:27:23.844 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T05:27:23.841+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115797) UID: 0 2023-06-08T05:27:23.844 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T05:27:23.841+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115797) UID: 0 2023-06-08T05:27:23.845 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T05:27:23.842+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115797) UID: 0 2023-06-08T05:27:23.845 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T05:27:23.842+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115797) UID: 0 2023-06-08T05:34:31.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:34:31.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:34:31.739 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T05:34:31.735+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115899) UID: 0 2023-06-08T05:34:31.739 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T05:34:31.735+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115899) UID: 0 2023-06-08T05:34:31.740 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T05:34:31.735+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115899) UID: 0 2023-06-08T05:34:31.740 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T05:34:31.736+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115899) UID: 0 2023-06-08T05:34:31.949 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T05:34:31.946+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618364) UID: 0 2023-06-08T05:34:31.950 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T05:34:31.946+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618364) UID: 0 2023-06-08T05:38:20.997 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T05:38:20.994+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618395) UID: 0 2023-06-08T05:38:21.000 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T05:38:20.989+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618395) UID: 0 2023-06-08T05:38:21.004 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T05:38:20.996+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618395) UID: 0 2023-06-08T05:38:21.025 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T05:38:20.994+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618395) UID: 0 2023-06-08T05:43:12.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:43:12.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:43:12.713 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T05:43:12.706+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116019) UID: 0 2023-06-08T05:43:12.714 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T05:43:12.711+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116019) UID: 0 2023-06-08T05:43:12.715 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T05:43:12.711+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116019) UID: 0 2023-06-08T05:43:12.715 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T05:43:12.706+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116019) UID: 0 2023-06-08T05:43:13.228 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T05:43:13.224+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618473) UID: 0 2023-06-08T05:43:13.229 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T05:43:13.224+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618473) UID: 0 2023-06-08T05:43:13.229 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T05:43:13.224+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618473) UID: 0 2023-06-08T05:43:13.240 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T05:43:13.224+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618473) UID: 0 2023-06-08T05:51:40.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:51:40.316 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:51:41.351 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T05:51:41.349+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618612) UID: 0 2023-06-08T05:51:41.352 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T05:51:41.349+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618612) UID: 0 2023-06-08T05:56:15.814 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T05:56:15.810+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618657) UID: 0 2023-06-08T05:56:15.816 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T05:56:15.811+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618657) UID: 0 2023-06-08T05:56:15.816 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T05:56:15.811+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618657) UID: 0 2023-06-08T05:56:15.818 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T05:56:15.810+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618657) UID: 0 2023-06-08T06:01:03.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:03.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:35.429 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:35.459 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:35.645 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T06:01:35.642+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116293) UID: 0 2023-06-08T06:01:35.647 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T06:01:35.642+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116293) UID: 0 2023-06-08T06:01:35.661 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T06:01:35.649+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116293) UID: 0 2023-06-08T06:01:35.667 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:01:35.649+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116293) UID: 0 2023-06-08T06:05:06.273 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:05:06.276 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:05:06.359 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T06:05:06.355+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-06-08T06:05:06.359 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T06:05:06.355+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-06-08T06:05:06.364 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T06:05:06.361+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-06-08T06:05:06.385 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T06:05:06.382+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618848) UID: 0 2023-06-08T06:05:06.386 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T06:05:06.383+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618848) UID: 0 2023-06-08T06:05:06.427 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:05:06.361+0000 7fa7ef89e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-06-08T06:09:17.123 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:09:17.119+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618890) UID: 0 2023-06-08T06:09:17.124 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:09:17.121+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618890) UID: 0 2023-06-08T06:09:17.125 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:09:17.119+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618890) UID: 0 2023-06-08T06:09:17.127 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:09:17.121+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 618890) UID: 0 2023-06-08T06:14:21.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:21.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:53.123 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:53.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:23.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:23.492 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:53.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:53.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:24.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:24.190 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:54.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:54.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:24.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:24.846 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:55.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:55.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:55.927 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T06:17:55.923+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 619152) UID: 0 2023-06-08T06:17:55.932 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T06:17:55.924+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 619152) UID: 0 2023-06-08T06:19:18.163 INFO:teuthology.orchestra.run.smithi043.stdout:generic/476 3871s 2023-06-08T06:19:18.345 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/476 2023-06-08T06:19:18.346 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:19:18.353 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:19:18.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:19:18.391 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-06-08T06:19:31.729 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:19:31.735 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:19:31.736 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:19:31.737 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:19:31.737 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:21:39.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:21:39.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:09.753 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:09.756 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:40.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:40.166 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:23:10.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:23:10.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:23:40.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:23:40.891 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:11.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:11.226 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:11.317 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T06:24:11.313+0000 7faeecb4e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 619631) UID: 0 2023-06-08T06:24:11.317 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T06:24:11.313+0000 7fbd52849700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 619631) UID: 0 2023-06-08T06:26:57.331 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:26:57.328+0000 7f81ab7dd700 -1 Fail to open '/proc/619660/cmdline' error = (2) No such file or directory 2023-06-08T06:26:57.332 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:26:57.328+0000 7f81ab7dd700 -1 received signal: Hangup from (PID: 619660) UID: 0 2023-06-08T06:26:57.332 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:26:57.328+0000 7f17775b1700 -1 Fail to open '/proc/619660/cmdline' error = (2) No such file or directory 2023-06-08T06:26:57.332 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:26:57.328+0000 7f17775b1700 -1 received signal: Hangup from (PID: 619660) UID: 0 2023-06-08T06:26:57.332 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:26:57.329+0000 7f2ad0054700 -1 Fail to open '/proc/619660/cmdline' error = (2) No such file or directory 2023-06-08T06:26:57.333 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:26:57.329+0000 7f2ad0054700 -1 received signal: Hangup from (PID: 619660) UID: 0 2023-06-08T06:26:57.335 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:26:57.328+0000 7f3a4f6e3700 -1 Fail to open '/proc/619660/cmdline' error = (2) No such file or directory 2023-06-08T06:26:57.335 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:26:57.328+0000 7f3a4f6e3700 -1 received signal: Hangup from (PID: 619660) UID: 0 2023-06-08T06:28:15.243 INFO:teuthology.orchestra.run.smithi043.stdout:generic/477 35s 2023-06-08T06:28:15.419 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/477 2023-06-08T06:28:15.420 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:15.484 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:15.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:15.743 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-06-08T06:28:19.105 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:19.118 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:19.119 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:19.120 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:19.120 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:44.694 INFO:teuthology.orchestra.run.smithi043.stdout:generic/478 25s 2023-06-08T06:28:44.723 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/478 2023-06-08T06:28:44.723 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:44.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:44.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:44.793 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-06-08T06:28:45.331 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:45.346 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:45.347 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:45.348 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:45.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:46.650 INFO:teuthology.orchestra.run.smithi043.stdout:generic/479 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:28:46.658 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/479 2023-06-08T06:28:46.658 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/479 2023-06-08T06:28:46.659 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:46.667 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:46.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:46.729 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-06-08T06:28:47.193 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:47.202 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:47.203 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:47.204 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:47.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:47.998 INFO:teuthology.orchestra.run.smithi043.stdout:generic/480 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:28:48.008 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/480 2023-06-08T06:28:48.009 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/480 2023-06-08T06:28:48.009 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:48.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:48.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:48.068 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-06-08T06:28:48.537 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:48.560 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:48.560 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:48.561 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:48.562 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:49.289 INFO:teuthology.orchestra.run.smithi043.stdout:generic/481 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:28:49.298 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/481 2023-06-08T06:28:49.299 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/481 2023-06-08T06:28:49.299 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:49.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:49.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:49.337 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-06-08T06:28:49.879 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:49.884 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:49.885 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:49.886 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:49.886 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:50.699 INFO:teuthology.orchestra.run.smithi043.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-08T06:28:50.712 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/482 2023-06-08T06:28:50.713 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/482 2023-06-08T06:28:50.713 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:50.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:50.766 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-06-08T06:28:51.219 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:51.226 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:51.226 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:51.227 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:51.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:51.862 INFO:teuthology.orchestra.run.smithi043.stdout:generic/483 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:28:51.867 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/483 2023-06-08T06:28:51.867 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/483 2023-06-08T06:28:51.867 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:51.870 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:51.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:51.920 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-06-08T06:28:52.436 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:52.442 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:52.442 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:52.446 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:52.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:53.057 INFO:teuthology.orchestra.run.smithi043.stdout:generic/484 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:28:53.064 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/484 2023-06-08T06:28:53.064 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/484 2023-06-08T06:28:53.064 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:53.066 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:53.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:53.125 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-06-08T06:28:53.705 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:53.717 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:53.717 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:53.719 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:53.719 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:54.382 INFO:teuthology.orchestra.run.smithi043.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T06:28:54.389 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/485 2023-06-08T06:28:54.389 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/485 2023-06-08T06:28:54.390 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:54.393 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:54.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:54.460 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-06-08T06:28:54.959 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:54.971 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:54.972 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:54.973 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:54.973 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:56.164 INFO:teuthology.orchestra.run.smithi043.stdout:generic/486 1s 2023-06-08T06:28:56.177 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/486 2023-06-08T06:28:56.177 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:56.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:56.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:56.219 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-06-08T06:28:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:56.724 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:56.725 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:56.727 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:56.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:57.458 INFO:teuthology.orchestra.run.smithi043.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-06-08T06:28:57.467 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/487 2023-06-08T06:28:57.468 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/487 2023-06-08T06:28:57.468 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:57.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:57.517 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-06-08T06:28:58.027 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:58.032 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:58.032 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:58.034 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:58.667 INFO:teuthology.orchestra.run.smithi043.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T06:28:58.677 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/488 2023-06-08T06:28:58.677 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/488 2023-06-08T06:28:58.678 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:58.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:58.720 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-06-08T06:28:59.192 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:28:59.222 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:28:59.222 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:28:59.225 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:28:59.225 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:59.899 INFO:teuthology.orchestra.run.smithi043.stdout:generic/489 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:28:59.915 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/489 2023-06-08T06:28:59.915 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/489 2023-06-08T06:28:59.915 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:28:59.919 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:28:59.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:28:59.976 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-06-08T06:29:00.504 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:00.510 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:00.514 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:00.516 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:00.517 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:03.201 INFO:teuthology.orchestra.run.smithi043.stdout:generic/490 3s 2023-06-08T06:29:03.207 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/490 2023-06-08T06:29:03.208 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:03.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:03.723 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-06-08T06:29:04.269 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:04.293 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:04.294 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:04.296 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:04.296 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:05.002 INFO:teuthology.orchestra.run.smithi043.stdout:generic/491 [not run] ceph does not support freezing 2023-06-08T06:29:05.008 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/491 2023-06-08T06:29:05.008 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/491 2023-06-08T06:29:05.008 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:05.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:05.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:05.081 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-06-08T06:29:05.587 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:05.600 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:05.600 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:05.604 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:05.605 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:06.222 INFO:teuthology.orchestra.run.smithi043.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-06-08T06:29:06.236 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/492 2023-06-08T06:29:06.236 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/492 2023-06-08T06:29:06.236 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:06.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:06.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:06.289 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-06-08T06:29:06.830 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:06.856 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:06.856 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:06.857 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:06.857 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:08.099 INFO:teuthology.orchestra.run.smithi043.stdout:generic/493 [not run] swapfiles are not supported 2023-06-08T06:29:08.112 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/493 2023-06-08T06:29:08.113 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/493 2023-06-08T06:29:08.113 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:08.119 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:08.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:08.159 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-06-08T06:29:08.666 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:08.691 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:08.692 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:08.694 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:08.694 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:09.668 INFO:teuthology.orchestra.run.smithi043.stdout:generic/494 [not run] swapfiles are not supported 2023-06-08T06:29:09.672 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/494 2023-06-08T06:29:09.673 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/494 2023-06-08T06:29:09.673 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:09.675 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:09.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:09.716 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-06-08T06:29:10.278 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:10.282 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:10.283 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:10.284 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:10.284 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:11.405 INFO:teuthology.orchestra.run.smithi043.stdout:generic/495 [not run] swapfiles are not supported 2023-06-08T06:29:11.411 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/495 2023-06-08T06:29:11.411 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/495 2023-06-08T06:29:11.411 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:11.421 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:11.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:11.470 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-06-08T06:29:12.020 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:12.032 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:12.032 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:12.035 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:13.158 INFO:teuthology.orchestra.run.smithi043.stdout:generic/496 [not run] swapfiles are not supported 2023-06-08T06:29:13.167 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/496 2023-06-08T06:29:13.167 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/496 2023-06-08T06:29:13.167 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:13.170 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:13.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:13.210 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-06-08T06:29:13.721 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:13.726 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:13.727 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:13.728 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:13.728 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:14.807 INFO:teuthology.orchestra.run.smithi043.stdout:generic/497 [not run] swapfiles are not supported 2023-06-08T06:29:14.818 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/497 2023-06-08T06:29:14.818 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/497 2023-06-08T06:29:14.818 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:14.820 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:14.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:14.857 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-06-08T06:29:15.406 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:15.416 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:15.417 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:15.418 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:15.418 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:16.102 INFO:teuthology.orchestra.run.smithi043.stdout:generic/498 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:29:16.118 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/498 2023-06-08T06:29:16.119 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/498 2023-06-08T06:29:16.119 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:16.121 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:16.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:16.177 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-06-08T06:29:16.686 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:16.696 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:16.697 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:16.699 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:16.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:17.334 INFO:teuthology.orchestra.run.smithi043.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T06:29:17.339 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/499 2023-06-08T06:29:17.340 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/499 2023-06-08T06:29:17.340 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:17.344 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:17.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:17.406 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-06-08T06:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:18.036 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:18.039 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:18.040 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:18.774 INFO:teuthology.orchestra.run.smithi043.stdout:generic/500 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:29:18.779 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/500 2023-06-08T06:29:18.779 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/500 2023-06-08T06:29:18.779 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:18.784 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:18.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:18.822 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-06-08T06:29:19.273 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:19.277 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:19.278 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:19.279 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:19.279 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:20.690 INFO:teuthology.orchestra.run.smithi043.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T06:29:20.793 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/501 2023-06-08T06:29:20.794 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/501 2023-06-08T06:29:20.794 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:20.810 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:20.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:20.861 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-06-08T06:29:21.359 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:21.363 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:21.364 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:21.365 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:22.078 INFO:teuthology.orchestra.run.smithi043.stdout:generic/502 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:29:22.083 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/502 2023-06-08T06:29:22.083 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/502 2023-06-08T06:29:22.083 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:22.094 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:22.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:22.162 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-06-08T06:29:22.943 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:22.952 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:22.953 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:22.955 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:22.956 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:23.746 INFO:teuthology.orchestra.run.smithi043.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T06:29:23.757 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/503 2023-06-08T06:29:23.757 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/503 2023-06-08T06:29:23.757 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:23.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:23.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:23.827 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-06-08T06:29:24.280 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:24.288 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:24.294 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:24.296 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:24.296 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:25.382 INFO:teuthology.orchestra.run.smithi043.stdout:generic/504 1s 2023-06-08T06:29:25.409 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/504 2023-06-08T06:29:25.409 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:25.411 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:25.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:25.457 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-06-08T06:29:25.998 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:26.008 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:26.009 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:26.015 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:26.015 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:26.938 INFO:teuthology.orchestra.run.smithi043.stdout:generic/505 [not run] ceph does not support shutdown 2023-06-08T06:29:26.957 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/505 2023-06-08T06:29:26.957 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/505 2023-06-08T06:29:26.958 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:26.960 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:27.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:27.016 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-06-08T06:29:27.525 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:27.536 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:27.543 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:27.545 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:27.545 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:28.196 INFO:teuthology.orchestra.run.smithi043.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T06:29:28.210 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/506 2023-06-08T06:29:28.210 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/506 2023-06-08T06:29:28.210 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:28.216 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:28.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:28.250 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-06-08T06:29:28.751 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:28.762 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:28.762 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:28.763 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:28.764 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:29.435 INFO:teuthology.orchestra.run.smithi043.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-06-08T06:29:29.445 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/507 2023-06-08T06:29:29.445 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/507 2023-06-08T06:29:29.445 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:29.448 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:29.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:29.541 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-06-08T06:29:30.100 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:30.106 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:30.106 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:30.107 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:30.107 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:30.722 INFO:teuthology.orchestra.run.smithi043.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-06-08T06:29:30.727 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/508 2023-06-08T06:29:30.727 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/508 2023-06-08T06:29:30.727 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:30.733 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:30.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:30.791 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-06-08T06:29:31.267 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:31.289 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:31.290 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:31.291 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:31.291 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:31.902 INFO:teuthology.orchestra.run.smithi043.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-06-08T06:29:31.919 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/509 2023-06-08T06:29:31.919 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/509 2023-06-08T06:29:31.919 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:31.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:31.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:31.965 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-06-08T06:29:32.392 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:32.398 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:32.399 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:32.400 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:32.400 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:33.013 INFO:teuthology.orchestra.run.smithi043.stdout:generic/510 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:29:33.022 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/510 2023-06-08T06:29:33.022 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/510 2023-06-08T06:29:33.023 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:33.030 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:33.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:33.076 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-06-08T06:29:33.593 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:33.606 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:33.612 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:33.612 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:33.613 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:34.282 INFO:teuthology.orchestra.run.smithi043.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T06:29:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/511 2023-06-08T06:29:34.295 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/511 2023-06-08T06:29:34.295 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:34.300 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:34.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:34.362 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-06-08T06:29:34.864 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:34.888 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:34.888 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:34.889 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:35.608 INFO:teuthology.orchestra.run.smithi043.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T06:29:35.614 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/512 2023-06-08T06:29:35.614 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/512 2023-06-08T06:29:35.614 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:35.621 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:35.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:35.664 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-06-08T06:29:36.165 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:36.195 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:36.196 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:36.197 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:36.198 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:37.645 INFO:teuthology.orchestra.run.smithi043.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T06:29:37.666 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/513 2023-06-08T06:29:37.667 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/513 2023-06-08T06:29:37.667 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:37.676 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:37.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:37.713 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-06-08T06:29:38.172 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:38.203 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:38.203 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:38.204 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:38.205 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T06:29:39.497 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/514 2023-06-08T06:29:39.497 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/514 2023-06-08T06:29:39.497 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:39.505 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:39.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:39.659 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-06-08T06:29:40.314 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:40.333 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:40.333 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:40.334 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:40.334 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:41.630 INFO:teuthology.orchestra.run.smithi043.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T06:29:41.781 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/515 2023-06-08T06:29:41.781 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/515 2023-06-08T06:29:41.781 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:41.820 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:41.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:41.859 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-06-08T06:29:42.488 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:42.503 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:42.504 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:42.505 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:43.268 INFO:teuthology.orchestra.run.smithi043.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-08T06:29:43.278 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/516 2023-06-08T06:29:43.278 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/516 2023-06-08T06:29:43.279 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:43.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:43.653 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-06-08T06:29:44.329 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:44.344 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:44.344 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:44.346 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:44.346 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:45.319 INFO:teuthology.orchestra.run.smithi043.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-08T06:29:45.750 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/517 2023-06-08T06:29:45.750 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/517 2023-06-08T06:29:45.750 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:45.801 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:45.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:45.898 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-06-08T06:29:46.429 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:46.442 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:46.443 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:46.444 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:46.444 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:47.669 INFO:teuthology.orchestra.run.smithi043.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-08T06:29:47.926 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/518 2023-06-08T06:29:47.926 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/518 2023-06-08T06:29:47.927 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:47.968 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:48.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:48.020 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-06-08T06:29:48.603 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:48.609 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:48.610 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:48.612 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:48.612 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:49.391 INFO:teuthology.orchestra.run.smithi043.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-06-08T06:29:49.401 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/519 2023-06-08T06:29:49.401 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/519 2023-06-08T06:29:49.401 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:49.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:49.992 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-06-08T06:29:50.510 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:50.518 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:50.519 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:50.520 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:50.520 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:51.144 INFO:teuthology.orchestra.run.smithi043.stdout:generic/520 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2023-06-08T06:29:51.173 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/520 2023-06-08T06:29:51.173 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/520 2023-06-08T06:29:51.174 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2023-06-08T06:29:51.176 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:29:51.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T06:29:51.207 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.CQ6jNRznugxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-06-08T06:29:51.794 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2023-06-08T06:29:51.800 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-08T06:29:51.801 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2023-06-08T06:29:51.802 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBrT4FkVCe2EhAAeQEMKB/o30V6MVtk8hEDag== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.5VE9MAOWDRscratch 2023-06-08T06:29:51.802 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:30:44.718 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:30:44.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:30:44.837 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:30:44.834+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641715) UID: 0 2023-06-08T06:30:44.837 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:30:44.834+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641715) UID: 0 2023-06-08T06:30:44.838 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:30:44.834+0000 7f17775b1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641715) UID: 0 2023-06-08T06:30:44.839 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:30:44.834+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641715) UID: 0 2023-06-08T06:30:44.866 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T06:30:44.864+0000 7f0a3bebe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116965) UID: 0 2023-06-08T06:30:44.866 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T06:30:44.864+0000 7f0e4bdb3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116965) UID: 0 2023-06-08T06:30:44.867 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T06:30:44.864+0000 7f6c29414700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116965) UID: 0 2023-06-08T06:30:44.867 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:30:44.864+0000 7fa7ef89e700 -1 Fail to open '/proc/116965/cmdline' error = (2) No such file or directory 2023-06-08T06:30:44.867 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:30:44.864+0000 7fa7ef89e700 -1 received signal: Hangup from (PID: 116965) UID: 0 2023-06-08T06:34:00.922 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:34:00.918+0000 7f176d187700 -1 bdev(0x560fcaa12380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-08T06:34:01.027 INFO:tasks.ceph.osd.0.smithi043.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f176d187700 time 2023-06-08T06:34:00.945217+0000 2023-06-08T06:34:01.027 INFO:tasks.ceph.osd.0.smithi043.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-08T06:34:01.027 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.027 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560fc6102d03] 2023-06-08T06:34:01.028 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.028 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.028 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.028 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: clone() 2023-06-08T06:34:01.029 INFO:tasks.ceph.osd.0.smithi043.stderr:*** Caught signal (Aborted) ** 2023-06-08T06:34:01.029 INFO:tasks.ceph.osd.0.smithi043.stderr: in thread 7f176d187700 thread_name:bstore_aio 2023-06-08T06:34:01.029 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:34:01.024+0000 7f176d187700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f176d187700 time 2023-06-08T06:34:00.945217+0000 2023-06-08T06:34:01.029 INFO:tasks.ceph.osd.0.smithi043.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560fc6102d03] 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.030 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: clone() 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f177fcb8ce0] 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: gsignal() 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: abort() 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560fc6102dc3] 2023-06-08T06:34:01.031 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr: 8: clone() 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-06-08T06:34:01.026+0000 7f176d187700 -1 *** Caught signal (Aborted) ** 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr: in thread 7f176d187700 thread_name:bstore_aio 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.032 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f177fcb8ce0] 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: gsignal() 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: abort() 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560fc6102dc3] 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.033 INFO:tasks.ceph.osd.0.smithi043.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.034 INFO:tasks.ceph.osd.0.smithi043.stderr: 8: clone() 2023-06-08T06:34:01.034 INFO:tasks.ceph.osd.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-08T06:34:01.034 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.043 INFO:tasks.ceph.osd.0.smithi043.stderr: -746> 2023-06-08T06:34:00.918+0000 7f176d187700 -1 bdev(0x560fcaa12380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-08T06:34:01.044 INFO:tasks.ceph.osd.0.smithi043.stderr: -15> 2023-06-08T06:34:01.024+0000 7f176d187700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f176d187700 time 2023-06-08T06:34:00.945217+0000 2023-06-08T06:34:01.044 INFO:tasks.ceph.osd.0.smithi043.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-08T06:34:01.044 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.044 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.044 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560fc6102d03] 2023-06-08T06:34:01.045 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.045 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.045 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.045 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: clone() 2023-06-08T06:34:01.045 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.045 INFO:tasks.ceph.osd.0.smithi043.stderr: 0> 2023-06-08T06:34:01.026+0000 7f176d187700 -1 *** Caught signal (Aborted) ** 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: in thread 7f176d187700 thread_name:bstore_aio 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f177fcb8ce0] 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: gsignal() 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: abort() 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560fc6102dc3] 2023-06-08T06:34:01.046 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.047 INFO:tasks.ceph.osd.0.smithi043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.047 INFO:tasks.ceph.osd.0.smithi043.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.047 INFO:tasks.ceph.osd.0.smithi043.stderr: 8: clone() 2023-06-08T06:34:01.047 INFO:tasks.ceph.osd.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-08T06:34:01.047 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.072 INFO:tasks.ceph.osd.0.smithi043.stderr: -747> 2023-06-08T06:34:00.918+0000 7f176d187700 -1 bdev(0x560fcaa12380 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-08T06:34:01.073 INFO:tasks.ceph.osd.0.smithi043.stderr: -16> 2023-06-08T06:34:01.024+0000 7f176d187700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f176d187700 time 2023-06-08T06:34:00.945217+0000 2023-06-08T06:34:01.073 INFO:tasks.ceph.osd.0.smithi043.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-08T06:34:01.074 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.074 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.074 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560fc6102d03] 2023-06-08T06:34:01.074 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.074 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.074 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: clone() 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: -1> 2023-06-08T06:34:01.026+0000 7f176d187700 -1 *** Caught signal (Aborted) ** 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: in thread 7f176d187700 thread_name:bstore_aio 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f177fcb8ce0] 2023-06-08T06:34:01.075 INFO:tasks.ceph.osd.0.smithi043.stderr: 2: gsignal() 2023-06-08T06:34:01.076 INFO:tasks.ceph.osd.0.smithi043.stderr: 3: abort() 2023-06-08T06:34:01.076 INFO:tasks.ceph.osd.0.smithi043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560fc6102dc3] 2023-06-08T06:34:01.076 INFO:tasks.ceph.osd.0.smithi043.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x560fc6d158d8] 2023-06-08T06:34:01.076 INFO:tasks.ceph.osd.0.smithi043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560fc6d17f71] 2023-06-08T06:34:01.076 INFO:tasks.ceph.osd.0.smithi043.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f177fcae1cf] 2023-06-08T06:34:01.076 INFO:tasks.ceph.osd.0.smithi043.stderr: 8: clone() 2023-06-08T06:34:01.077 INFO:tasks.ceph.osd.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-08T06:34:01.077 INFO:tasks.ceph.osd.0.smithi043.stderr: 2023-06-08T06:34:01.237 INFO:tasks.ceph.osd.0.smithi043.stderr:daemon-helper: command failed with exit status 5 2023-06-08T06:34:08.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-06-08T06:34:15.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2023-06-08T06:34:21.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2023-06-08T06:34:28.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-06-08T06:34:35.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~26s 2023-06-08T06:34:41.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-06-08T06:34:48.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-06-08T06:34:55.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2023-06-08T06:35:01.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2023-06-08T06:35:08.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2023-06-08T06:35:14.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2023-06-08T06:35:21.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~73s 2023-06-08T06:35:28.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~79s 2023-06-08T06:35:34.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~86s 2023-06-08T06:35:41.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2023-06-08T06:35:47.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2023-06-08T06:35:54.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2023-06-08T06:36:01.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~112s 2023-06-08T06:36:07.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~119s 2023-06-08T06:36:14.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~126s 2023-06-08T06:36:20.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2023-06-08T06:36:27.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~139s 2023-06-08T06:36:34.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-06-08T06:36:40.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~152s 2023-06-08T06:36:46.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:36:46.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:36:46.189 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:36:46.187+0000 7f3a4f6e3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641790) UID: 0 2023-06-08T06:36:46.190 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:36:46.187+0000 7f81ab7dd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641790) UID: 0 2023-06-08T06:36:46.190 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:36:46.187+0000 7f2ad0054700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641790) UID: 0 2023-06-08T06:36:47.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~159s 2023-06-08T06:36:53.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-06-08T06:37:00.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~172s 2023-06-08T06:37:07.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~178s 2023-06-08T06:37:13.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-06-08T06:37:20.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~192s 2023-06-08T06:37:27.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~198s 2023-06-08T06:37:33.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-06-08T06:37:40.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~211s 2023-06-08T06:37:46.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~218s 2023-06-08T06:37:53.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-06-08T06:38:00.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~231s 2023-06-08T06:38:06.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~238s 2023-06-08T06:38:13.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-06-08T06:38:19.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~251s 2023-06-08T06:38:26.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~258s 2023-06-08T06:38:33.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~264s 2023-06-08T06:38:39.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~271s 2023-06-08T06:38:46.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~278s 2023-06-08T06:38:52.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~284s 2023-06-08T06:38:59.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~291s 2023-06-08T06:39:06.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~297s 2023-06-08T06:39:12.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~304s 2023-06-08T06:39:12.729 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-08T06:39:12.729 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T06:39:12.729 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T06:39:12.778 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T06:39:12.778 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T06:39:12.839 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T06:39:14.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.192+0000 7f44879aa700 1 Processor -- start 2023-06-08T06:39:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.193+0000 7f44879aa700 1 -- start start 2023-06-08T06:39:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f44879aa700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44800cd200 0x7f44800ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f44879aa700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800cd850 con 0x7f44801606a0 2023-06-08T06:39:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f44879aa700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800c8ba0 con 0x7f44800ccd00 2023-06-08T06:39:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f44879aa700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44800cf040 con 0x7f44800cd200 2023-06-08T06:39:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f4485f47700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44800cd200 0x7f44800ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f4485f47700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44800cd200 0x7f44800ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:52206/0 (socket says 172.21.15.43:52206) 2023-06-08T06:39:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.194+0000 7f4485f47700 1 -- 172.21.15.43:0/255044143 learned_addr learned my addr 172.21.15.43:0/255044143 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4485f47700 1 -- 172.21.15.43:0/255044143 >> v1:172.21.15.135:6789/0 conn(0x7f44800ccd00 legacy=0x7f44800ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4485f47700 1 -- 172.21.15.43:0/255044143 >> v1:172.21.15.43:6789/0 conn(0x7f44801606a0 legacy=0x7f44800cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T06:39:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4485f47700 1 -- 172.21.15.43:0/255044143 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800cdaa0 con 0x7f44800cd200 2023-06-08T06:39:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4485f47700 1 --2- 172.21.15.43:0/255044143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800ceb00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098f0 tx=0x7f447c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c23f3f7483ced08 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4477fff700 1 -- 172.21.15.43:0/255044143 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c004230 con 0x7f44800cd200 2023-06-08T06:39:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4477fff700 1 -- 172.21.15.43:0/255044143 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c004390 con 0x7f44800cd200 2023-06-08T06:39:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.195+0000 7f4477fff700 1 -- 172.21.15.43:0/255044143 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0036a0 con 0x7f44800cd200 2023-06-08T06:39:14.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.196+0000 7f44879aa700 1 -- 172.21.15.43:0/255044143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 msgr2=0x7f44800ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:14.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.196+0000 7f44879aa700 1 --2- 172.21.15.43:0/255044143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800ceb00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098f0 tx=0x7f447c009c00 comp rx=0 tx=0).stop 2023-06-08T06:39:14.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.199+0000 7f44879aa700 1 -- 172.21.15.43:0/255044143 shutdown_connections 2023-06-08T06:39:14.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.199+0000 7f44879aa700 1 --2- 172.21.15.43:0/255044143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800ceb00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.199+0000 7f44879aa700 1 -- 172.21.15.43:0/255044143 >> 172.21.15.43:0/255044143 conn(0x7f448006aa40 msgr2=0x7f44800b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:14.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.203+0000 7f44879aa700 1 -- 172.21.15.43:0/255044143 shutdown_connections 2023-06-08T06:39:14.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.204+0000 7f44879aa700 1 -- 172.21.15.43:0/255044143 wait complete. 2023-06-08T06:39:14.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.205+0000 7f44879aa700 1 Processor -- start 2023-06-08T06:39:14.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.206+0000 7f44879aa700 1 -- start start 2023-06-08T06:39:14.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f44879aa700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44800ccd00 0x7f448015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f44879aa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f44879aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801606a0 0x7f44800c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f44879aa700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448015cf20 con 0x7f44801606a0 2023-06-08T06:39:14.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f44879aa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448015ca30 con 0x7f44800cd200 2023-06-08T06:39:14.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f44879aa700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800c43d0 con 0x7f44800ccd00 2023-06-08T06:39:14.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:52210/0 (socket says 172.21.15.43:52210) 2023-06-08T06:39:14.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 -- 172.21.15.43:0/621520223 learned_addr learned my addr 172.21.15.43:0/621520223 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:14.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 -- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44800ccd00 msgr2=0x7f448015c4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T06:39:14.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44800ccd00 0x7f448015c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 -- 172.21.15.43:0/621520223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801606a0 msgr2=0x7f44800c4860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T06:39:14.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801606a0 0x7f44800c4860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.207+0000 7f4484f45700 1 -- 172.21.15.43:0/621520223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c009550 con 0x7f44800cd200 2023-06-08T06:39:14.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.208+0000 7f4484f45700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800c7fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f447000c490 tx=0x7f447000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:14.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.208+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700052d0 con 0x7f44800cd200 2023-06-08T06:39:14.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.208+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470005430 con 0x7f44800cd200 2023-06-08T06:39:14.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.208+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800c37c0 con 0x7f44800cd200 2023-06-08T06:39:14.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.208+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44800c3d80 con 0x7f44800cd200 2023-06-08T06:39:14.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.209+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470006aa0 con 0x7f44800cd200 2023-06-08T06:39:14.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.210+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4470003680 con 0x7f44800cd200 2023-06-08T06:39:14.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.211+0000 7f4475ffb700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f446c06ae60 0x7f446c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.211+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f44700889d0 con 0x7f44800cd200 2023-06-08T06:39:14.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.211+0000 7f4485746700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f446c06ae60 0x7f446c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.212+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44600052f0 con 0x7f44800cd200 2023-06-08T06:39:14.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.212+0000 7f4485746700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f446c06ae60 0x7f446c06d310 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f44800c2280 tx=0x7f4478009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:14.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.220+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4470053880 con 0x7f44800cd200 2023-06-08T06:39:14.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.532+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4460005870 con 0x7f44800cd200 2023-06-08T06:39:14.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.540+0000 7f4475ffb700 1 -- 172.21.15.43:0/621520223 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f4470056ea0 con 0x7f44800cd200 2023-06-08T06:39:14.544 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-06-08T06:39:14.545 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":44,"fsid":"5ca92cbd-c0c8-4573-b70a-f139aab8d7d6","created":"2023-06-08T03:48:27.940314+0000","modified":"2023-06-08T06:34:02.496212+0000","last_up_change":"2023-06-08T06:34:01.455834+0000","last_in_change":"2023-06-08T03:48:30.443323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T03:48:39.280343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T03:48:39.618414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-08T03:50:01.893006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-08T03:50:03.263523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f68c8e5-fc12-4bd9-9101-7aacbeba17a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6817","nonce":2337618237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6819","nonce":2337618237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6827","nonce":2337618237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6821","nonce":2337618237},{"type":"v1","addr":"172.21.15.43:6823","nonce":2337618237}]},"public_addr":"172.21.15.43:6817/2337618237","cluster_addr":"172.21.15.43:6819/2337618237","heartbeat_back_addr":"172.21.15.43:6827/2337618237","heartbeat_front_addr":"172.21.15.43:6823/2337618237","state":["exists"]},{"osd":1,"uuid":"983fd425-38b1-42fd-92a9-8bd5825a2470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6801","nonce":3633177327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6803","nonce":3633177327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6807","nonce":3633177327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3633177327},{"type":"v1","addr":"172.21.15.43:6805","nonce":3633177327}]},"public_addr":"172.21.15.43:6801/3633177327","cluster_addr":"172.21.15.43:6803/3633177327","heartbeat_back_addr":"172.21.15.43:6807/3633177327","heartbeat_front_addr":"172.21.15.43:6805/3633177327","state":["exists","up"]},{"osd":2,"uuid":"b9e12cdf-8822-4c74-b9a1-84534b4e3de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6809","nonce":3406724052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6811","nonce":3406724052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6815","nonce":3406724052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3406724052},{"type":"v1","addr":"172.21.15.43:6813","nonce":3406724052}]},"public_addr":"172.21.15.43:6809/3406724052","cluster_addr":"172.21.15.43:6811/3406724052","heartbeat_back_addr":"172.21.15.43:6815/3406724052","heartbeat_front_addr":"172.21.15.43:6813/3406724052","state":["exists","up"]},{"osd":3,"uuid":"327aacbb-559b-48be-a085-e226135fca5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6822","nonce":1131528055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6826","nonce":1131528055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6831","nonce":1131528055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1131528055},{"type":"v1","addr":"172.21.15.43:6829","nonce":1131528055}]},"public_addr":"172.21.15.43:6822/1131528055","cluster_addr":"172.21.15.43:6826/1131528055","heartbeat_back_addr":"172.21.15.43:6831/1131528055","heartbeat_front_addr":"172.21.15.43:6829/1131528055","state":["exists","up"]},{"osd":4,"uuid":"c6393406-01f1-41ac-9b24-c5976e6222f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6801","nonce":613956937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6803","nonce":613956937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6807","nonce":613956937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":613956937},{"type":"v1","addr":"172.21.15.135:6805","nonce":613956937}]},"public_addr":"172.21.15.135:6801/613956937","cluster_addr":"172.21.15.135:6803/613956937","heartbeat_back_addr":"172.21.15.135:6807/613956937","heartbeat_front_addr":"172.21.15.135:6805/613956937","state":["exists","up"]},{"osd":5,"uuid":"4bc55935-612a-4552-869e-86c3b79ed7ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6809","nonce":1494712462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6811","nonce":1494712462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6815","nonce":1494712462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1494712462},{"type":"v1","addr":"172.21.15.135:6813","nonce":1494712462}]},"public_addr":"172.21.15.135:6809/1494712462","cluster_addr":"172.21.15.135:6811/1494712462","heartbeat_back_addr":"172.21.15.135:6815/1494712462","heartbeat_front_addr":"172.21.15.135:6813/1494712462","state":["exists","up"]},{"osd":6,"uuid":"b2edbaa1-7cab-4272-8c70-6226536fbdb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6817","nonce":3533930797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6819","nonce":3533930797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6823","nonce":3533930797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3533930797},{"type":"v1","addr":"172.21.15.135:6821","nonce":3533930797}]},"public_addr":"172.21.15.135:6817/3533930797","cluster_addr":"172.21.15.135:6819/3533930797","heartbeat_back_addr":"172.21.15.135:6823/3533930797","heartbeat_front_addr":"172.21.15.135:6821/3533930797","state":["exists","up"]},{"osd":7,"uuid":"4dceacb1-95cd-4129-b311-c10613533047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6825","nonce":3149048166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6827","nonce":3149048166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6831","nonce":3149048166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3149048166},{"type":"v1","addr":"172.21.15.135:6829","nonce":3149048166}]},"public_addr":"172.21.15.135:6825/3149048166","cluster_addr":"172.21.15.135:6827/3149048166","heartbeat_back_addr":"172.21.15.135:6831/3149048166","heartbeat_front_addr":"172.21.15.135:6829/3149048166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.628356+0000","dead_epoch":43},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.649620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.619042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.594994+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.675473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.595017+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.378460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T03:48:35.674177+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T06:39:14.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f446c06ae60 msgr2=0x7f446c06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:14.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f446c06ae60 0x7f446c06d310 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f44800c2280 tx=0x7f4478009250 comp rx=0 tx=0).stop 2023-06-08T06:39:14.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 msgr2=0x7f44800c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:14.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800c7fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f447000c490 tx=0x7f447000c850 comp rx=0 tx=0).stop 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 shutdown_connections 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f446c06ae60 0x7f446c06d310 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801606a0 0x7f44800c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44800ccd00 0x7f448015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 --2- 172.21.15.43:0/621520223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44800cd200 0x7f44800c7fe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 >> 172.21.15.43:0/621520223 conn(0x7f448006aa40 msgr2=0x7f44800ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:14.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 shutdown_connections 2023-06-08T06:39:14.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.544+0000 7f44879aa700 1 -- 172.21.15.43:0/621520223 wait complete. 2023-06-08T06:39:14.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T03:48:39.280343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T03:48:39.618414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T03:50:01.893006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T03:50:03.263523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T06:39:14.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T06:39:14.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.801+0000 7f6780802700 1 Processor -- start 2023-06-08T06:39:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.801+0000 7f6780802700 1 -- start start 2023-06-08T06:39:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f6780802700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 0x7f677c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f6780802700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c158600 0x7f677c070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f6780802700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c071120 con 0x7f677c069db0 2023-06-08T06:39:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f6780802700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c06a300 con 0x7f677c070810 2023-06-08T06:39:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f6780802700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c06a5e0 con 0x7f677c158600 2023-06-08T06:39:14.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f677ad9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 0x7f677c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f677ad9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 0x7f677c06c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42366/0 (socket says 172.21.15.43:42366) 2023-06-08T06:39:14.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f677ad9d700 1 -- 172.21.15.43:0/3509635637 learned_addr learned my addr 172.21.15.43:0/3509635637 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:14.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.802+0000 7f677a59c700 1 --2- 172.21.15.43:0/3509635637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c158600 0x7f677c070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f677a59c700 1 -- 172.21.15.43:0/3509635637 >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 msgr2=0x7f677c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T06:39:14.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f677a59c700 1 --2- 172.21.15.43:0/3509635637 >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 0x7f677c06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f677a59c700 1 -- 172.21.15.43:0/3509635637 >> v1:172.21.15.135:6789/0 conn(0x7f677c069db0 legacy=0x7f677c0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:14.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f677a59c700 1 -- 172.21.15.43:0/3509635637 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c06a8c0 con 0x7f677c158600 2023-06-08T06:39:14.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f677ad9d700 1 --2- 172.21.15.43:0/3509635637 >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 0x7f677c06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f677a59c700 1 --2- 172.21.15.43:0/3509635637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c158600 0x7f677c070be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6770009840 tx=0x7f6770009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3206752543d0c3f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f6779d9b700 1 -- 172.21.15.43:0/3509635637 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770010800 con 0x7f677c158600 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f6779d9b700 1 -- 172.21.15.43:0/3509635637 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770010960 con 0x7f677c158600 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.803+0000 7f6779d9b700 1 -- 172.21.15.43:0/3509635637 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770010cf0 con 0x7f677c158600 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.804+0000 7f6780802700 1 -- 172.21.15.43:0/3509635637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c158600 msgr2=0x7f677c070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.804+0000 7f6780802700 1 --2- 172.21.15.43:0/3509635637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c158600 0x7f677c070be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6770009840 tx=0x7f6770009b50 comp rx=0 tx=0).stop 2023-06-08T06:39:14.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.805+0000 7f6780802700 1 -- 172.21.15.43:0/3509635637 shutdown_connections 2023-06-08T06:39:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.805+0000 7f6780802700 1 --2- 172.21.15.43:0/3509635637 >> v2:172.21.15.43:3300/0 conn(0x7f677c070810 0x7f677c06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.805+0000 7f6780802700 1 --2- 172.21.15.43:0/3509635637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c158600 0x7f677c070be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.805+0000 7f6780802700 1 -- 172.21.15.43:0/3509635637 >> 172.21.15.43:0/3509635637 conn(0x7f677c0ced00 msgr2=0x7f677c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.807+0000 7f6780802700 1 -- 172.21.15.43:0/3509635637 shutdown_connections 2023-06-08T06:39:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.807+0000 7f6780802700 1 -- 172.21.15.43:0/3509635637 wait complete. 2023-06-08T06:39:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.809+0000 7f6780802700 1 Processor -- start 2023-06-08T06:39:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.809+0000 7f6780802700 1 -- start start 2023-06-08T06:39:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.810+0000 7f6780802700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 0x7f677c142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.810+0000 7f6780802700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c070810 0x7f677c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.810+0000 7f6780802700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c158600 0x7f677c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.810+0000 7f6780802700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1e29e0 con 0x7f677c070810 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.810+0000 7f6780802700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1e1da0 con 0x7f677c158600 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.810+0000 7f6780802700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1e2040 con 0x7f677c069db0 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 0x7f677c142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 0x7f677c142980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:35828/0 (socket says 172.21.15.43:35828) 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 -- 172.21.15.43:0/33800783 learned_addr learned my addr 172.21.15.43:0/33800783 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 -- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c158600 msgr2=0x7f677c0ca520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T06:39:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c158600 0x7f677c0ca520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 -- 172.21.15.43:0/33800783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c070810 msgr2=0x7f677c0c9fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c070810 0x7f677c0c9fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 -- 172.21.15.43:0/33800783 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c009550 con 0x7f677c069db0 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.811+0000 7f677ad9d700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 0x7f677c142980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f676c00ebe0 tx=0x7f676c009e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.812+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00c8b0 con 0x7f677c069db0 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.812+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67700094a0 con 0x7f677c069db0 2023-06-08T06:39:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.812+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00ca10 con 0x7f677c069db0 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.812+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00cda0 con 0x7f677c069db0 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.812+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c1e2600 con 0x7f677c069db0 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.813+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c1e2b20 con 0x7f677c069db0 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.814+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f676c013470 con 0x7f677c069db0 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.814+0000 7f67637fe700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f676808ccf0 0x7f676808f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.814+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f676c089860 con 0x7f677c069db0 2023-06-08T06:39:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.816+0000 7f677a59c700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f676808ccf0 0x7f676808f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:14.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.816+0000 7f677a59c700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f676808ccf0 0x7f676808f1a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f677c1589d0 tx=0x7f6770008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:14.823+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f677c1e2b20 con 0x7f677c069db0 2023-06-08T06:39:15.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.152+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f677c04e8e0 con 0x7f677c069db0 2023-06-08T06:39:15.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.157+0000 7f67637fe700 1 -- 172.21.15.43:0/33800783 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f676c058230 con 0x7f677c069db0 2023-06-08T06:39:15.160 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-06-08T06:39:15.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f676808ccf0 msgr2=0x7f676808f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f676808ccf0 0x7f676808f1a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f677c1589d0 tx=0x7f6770008030 comp rx=0 tx=0).stop 2023-06-08T06:39:15.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 msgr2=0x7f677c142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 0x7f677c142980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f676c00ebe0 tx=0x7f676c009e70 comp rx=0 tx=0).stop 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 shutdown_connections 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f676808ccf0 0x7f676808f1a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c158600 0x7f677c0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f677c069db0 0x7f677c142980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 --2- 172.21.15.43:0/33800783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c070810 0x7f677c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.159+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 >> 172.21.15.43:0/33800783 conn(0x7f677c0ced00 msgr2=0x7f677c14a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:15.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.160+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 shutdown_connections 2023-06-08T06:39:15.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.160+0000 7f6780802700 1 -- 172.21.15.43:0/33800783 wait complete. 2023-06-08T06:39:15.178 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T06:39:15.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.366+0000 7fef93e76700 1 Processor -- start 2023-06-08T06:39:15.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.366+0000 7fef93e76700 1 -- start start 2023-06-08T06:39:15.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.367+0000 7fef93e76700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fef8c06b380 0x7fef8c070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:15.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.367+0000 7fef93e76700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:15.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.367+0000 7fef93e76700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c0cb5f0 con 0x7fef8c1588a0 2023-06-08T06:39:15.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.367+0000 7fef93e76700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c06b7f0 con 0x7fef8c06b380 2023-06-08T06:39:15.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.367+0000 7fef93e76700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0712c0 con 0x7fef8c070e40 2023-06-08T06:39:15.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:15.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c15c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:35836/0 (socket says 172.21.15.43:35836) 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 -- 172.21.15.43:0/2564795489 learned_addr learned my addr 172.21.15.43:0/2564795489 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 -- 172.21.15.43:0/2564795489 >> v2:172.21.15.43:3300/0 conn(0x7fef8c06b380 msgr2=0x7fef8c070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 --2- 172.21.15.43:0/2564795489 >> v2:172.21.15.43:3300/0 conn(0x7fef8c06b380 0x7fef8c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 -- 172.21.15.43:0/2564795489 >> v1:172.21.15.43:6789/0 conn(0x7fef8c1588a0 legacy=0x7fef8c06c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 -- 172.21.15.43:0/2564795489 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c06dbd0 con 0x7fef8c070e40 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef92413700 1 --2- 172.21.15.43:0/2564795489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c15c820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef84009e50 tx=0x7fef8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28f57faa774bd419 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:15.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef90c10700 1 -- 172.21.15.43:0/2564795489 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8400e070 con 0x7fef8c070e40 2023-06-08T06:39:15.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.368+0000 7fef90c10700 1 -- 172.21.15.43:0/2564795489 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84003a20 con 0x7fef8c070e40 2023-06-08T06:39:15.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.369+0000 7fef90c10700 1 -- 172.21.15.43:0/2564795489 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84003dd0 con 0x7fef8c070e40 2023-06-08T06:39:15.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.369+0000 7fef93e76700 1 -- 172.21.15.43:0/2564795489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 msgr2=0x7fef8c15c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.369+0000 7fef93e76700 1 --2- 172.21.15.43:0/2564795489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c15c820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef84009e50 tx=0x7fef8400b330 comp rx=0 tx=0).stop 2023-06-08T06:39:15.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.369+0000 7fef93e76700 1 -- 172.21.15.43:0/2564795489 shutdown_connections 2023-06-08T06:39:15.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.369+0000 7fef93e76700 1 --2- 172.21.15.43:0/2564795489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c15c820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.370+0000 7fef93e76700 1 --2- 172.21.15.43:0/2564795489 >> v2:172.21.15.43:3300/0 conn(0x7fef8c06b380 0x7fef8c070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.370+0000 7fef93e76700 1 -- 172.21.15.43:0/2564795489 >> 172.21.15.43:0/2564795489 conn(0x7fef8c0cee30 msgr2=0x7fef8c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:15.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.377+0000 7fef93e76700 1 -- 172.21.15.43:0/2564795489 shutdown_connections 2023-06-08T06:39:15.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.378+0000 7fef93e76700 1 -- 172.21.15.43:0/2564795489 wait complete. 2023-06-08T06:39:15.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.379+0000 7fef93e76700 1 Processor -- start 2023-06-08T06:39:15.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.379+0000 7fef93e76700 1 -- start start 2023-06-08T06:39:15.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.380+0000 7fef93e76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c06b380 0x7fef8c1e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:15.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.380+0000 7fef93e76700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.380+0000 7fef93e76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 0x7fef8c0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.380+0000 7fef93e76700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c159770 con 0x7fef8c1588a0 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.380+0000 7fef93e76700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c7ea0 con 0x7fef8c06b380 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.380+0000 7fef93e76700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c84a0 con 0x7fef8c070e40 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 0x7fef8c0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 0x7fef8c0c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42386/0 (socket says 172.21.15.43:42386) 2023-06-08T06:39:15.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 -- 172.21.15.43:0/3785904007 learned_addr learned my addr 172.21.15.43:0/3785904007 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef91c12700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c06b380 0x7fef8c1e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 -- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 msgr2=0x7fef8c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 -- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c06b380 msgr2=0x7fef8c1e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c06b380 0x7fef8c1e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 -- 172.21.15.43:0/3785904007 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef84009b30 con 0x7fef8c1588a0 2023-06-08T06:39:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef92413700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 0x7fef8c0c7960 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7fef8c06b930 tx=0x7fef84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.381+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef840092e0 con 0x7fef8c1588a0 2023-06-08T06:39:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.382+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c1e1b10 con 0x7fef8c1588a0 2023-06-08T06:39:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.382+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c1e20d0 con 0x7fef8c1588a0 2023-06-08T06:39:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.382+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84004240 con 0x7fef8c1588a0 2023-06-08T06:39:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.382+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84004610 con 0x7fef8c1588a0 2023-06-08T06:39:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.383+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740052f0 con 0x7fef8c1588a0 2023-06-08T06:39:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.383+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef84019070 con 0x7fef8c1588a0 2023-06-08T06:39:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.384+0000 7fef827fc700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fef7006ace0 0x7fef7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:15.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.384+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fef8408a510 con 0x7fef8c1588a0 2023-06-08T06:39:15.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.385+0000 7fef91c12700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fef7006ace0 0x7fef7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:15.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.385+0000 7fef91c12700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fef7006ace0 0x7fef7006d190 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef88009960 tx=0x7fef880090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:15.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.393+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef84058f60 con 0x7fef8c1588a0 2023-06-08T06:39:15.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.790+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef74005b20 con 0x7fef8c1588a0 2023-06-08T06:39:15.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.791+0000 7fef827fc700 1 -- 172.21.15.43:0/3785904007 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef84012430 con 0x7fef8c1588a0 2023-06-08T06:39:15.794 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-06-08T06:39:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fef7006ace0 msgr2=0x7fef7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fef7006ace0 0x7fef7006d190 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef88009960 tx=0x7fef880090e0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 msgr2=0x7fef8c0c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 0x7fef8c0c7960 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7fef8c06b930 tx=0x7fef84004ad0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 shutdown_connections 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7fef7006ace0 0x7fef7006d190 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef88009960 tx=0x7fef880090e0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef8c1588a0 0x7fef8c0c7960 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c06b380 0x7fef8c1e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 --2- 172.21.15.43:0/3785904007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c070e40 0x7fef8c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.800+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 >> 172.21.15.43:0/3785904007 conn(0x7fef8c0cee30 msgr2=0x7fef8c0c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.804+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 shutdown_connections 2023-06-08T06:39:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:15.804+0000 7fef93e76700 1 -- 172.21.15.43:0/3785904007 wait complete. 2023-06-08T06:39:15.825 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T06:39:16.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.062+0000 7f1c48ccc700 1 Processor -- start 2023-06-08T06:39:16.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.063+0000 7f1c48ccc700 1 -- start start 2023-06-08T06:39:16.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.064+0000 7f1c48ccc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 0x7f1c4415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.064+0000 7f1c48ccc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c440b07d0 0x7f1c4406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.064+0000 7f1c48ccc700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c44071bc0 con 0x7f1c441606e0 2023-06-08T06:39:16.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.064+0000 7f1c48ccc700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c440c8eb0 con 0x7f1c440b07d0 2023-06-08T06:39:16.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.064+0000 7f1c48ccc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4415c7f0 con 0x7f1c440717f0 2023-06-08T06:39:16.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.064+0000 7f1c4259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 0x7f1c4415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 0x7f1c4415d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.43:35848/0 (socket says 172.21.15.43:35848) 2023-06-08T06:39:16.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 -- 172.21.15.43:0/3740395579 learned_addr learned my addr 172.21.15.43:0/3740395579 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 -- 172.21.15.43:0/3740395579 >> v2:172.21.15.135:3300/0 conn(0x7f1c440b07d0 msgr2=0x7f1c4406ffe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 --2- 172.21.15.43:0/3740395579 >> v2:172.21.15.135:3300/0 conn(0x7f1c440b07d0 0x7f1c4406ffe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 -- 172.21.15.43:0/3740395579 >> v1:172.21.15.135:6789/0 conn(0x7f1c441606e0 legacy=0x7f1c440b00c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 -- 172.21.15.43:0/3740395579 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4415cad0 con 0x7f1c440717f0 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.065+0000 7f1c4259c700 1 --2- 172.21.15.43:0/3740395579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 0x7f1c4415d2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c340098f0 tx=0x7f1c34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1997fcbf2c4569c3 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.070+0000 7f1c4159a700 1 -- 172.21.15.43:0/3740395579 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34004230 con 0x7f1c440717f0 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.071+0000 7f1c4159a700 1 -- 172.21.15.43:0/3740395579 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34004390 con 0x7f1c440717f0 2023-06-08T06:39:16.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.071+0000 7f1c4159a700 1 -- 172.21.15.43:0/3740395579 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c340036a0 con 0x7f1c440717f0 2023-06-08T06:39:16.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 -- 172.21.15.43:0/3740395579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 msgr2=0x7f1c4415d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/3740395579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 0x7f1c4415d2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c340098f0 tx=0x7f1c34009c00 comp rx=0 tx=0).stop 2023-06-08T06:39:16.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 -- 172.21.15.43:0/3740395579 shutdown_connections 2023-06-08T06:39:16.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/3740395579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c440717f0 0x7f1c4415d2d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/3740395579 >> v2:172.21.15.135:3300/0 conn(0x7f1c440b07d0 0x7f1c4406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 -- 172.21.15.43:0/3740395579 >> 172.21.15.43:0/3740395579 conn(0x7f1c4406c160 msgr2=0x7f1c4406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:16.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 -- 172.21.15.43:0/3740395579 shutdown_connections 2023-06-08T06:39:16.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.072+0000 7f1c48ccc700 1 -- 172.21.15.43:0/3740395579 wait complete. 2023-06-08T06:39:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.074+0000 7f1c48ccc700 1 Processor -- start 2023-06-08T06:39:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.074+0000 7f1c48ccc700 1 -- start start 2023-06-08T06:39:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c48ccc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c440717f0 0x7f1c440c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c48ccc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 0x7f1c441f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c48ccc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c441606e0 0x7f1c440cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c48ccc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441f1a30 con 0x7f1c440b07d0 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c48ccc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c440c4e60 con 0x7f1c440717f0 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c48ccc700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441f1cf0 con 0x7f1c441606e0 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c41d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 0x7f1c441f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c41d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 0x7f1c441f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42398/0 (socket says 172.21.15.43:42398) 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c41d9b700 1 -- 172.21.15.43:0/1207595097 learned_addr learned my addr 172.21.15.43:0/1207595097 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.075+0000 7f1c4259c700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c440717f0 0x7f1c440c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c41d9b700 1 -- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c441606e0 msgr2=0x7f1c440cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c41d9b700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c441606e0 0x7f1c440cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c41d9b700 1 -- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c440717f0 msgr2=0x7f1c440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c41d9b700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c440717f0 0x7f1c440c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c41d9b700 1 -- 172.21.15.43:0/1207595097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34009550 con 0x7f1c440b07d0 2023-06-08T06:39:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c41d9b700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 0x7f1c441f2870 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800b470 tx=0x7f1c3800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011830 con 0x7f1c440b07d0 2023-06-08T06:39:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c380119b0 con 0x7f1c440b07d0 2023-06-08T06:39:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c441f1fd0 con 0x7f1c440b07d0 2023-06-08T06:39:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011d60 con 0x7f1c440b07d0 2023-06-08T06:39:16.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.076+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c441f2590 con 0x7f1c440b07d0 2023-06-08T06:39:16.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.078+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c441f5020 con 0x7f1c440b07d0 2023-06-08T06:39:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.082+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c3801a400 con 0x7f1c440b07d0 2023-06-08T06:39:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.082+0000 7f1c32ffd700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1c2406ace0 0x7f1c2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.082+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1c38089620 con 0x7f1c440b07d0 2023-06-08T06:39:16.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.085+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c441f5020 con 0x7f1c440b07d0 2023-06-08T06:39:16.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.087+0000 7f1c4259c700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1c2406ace0 0x7f1c2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.087+0000 7f1c4259c700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1c2406ace0 0x7f1c2406d190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009c40 tx=0x7f1c34008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:16.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.400+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c441f5020 con 0x7f1c440b07d0 2023-06-08T06:39:16.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.402+0000 7f1c32ffd700 1 -- 172.21.15.43:0/1207595097 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c441f5020 con 0x7f1c440b07d0 2023-06-08T06:39:16.411 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-06-08T06:39:16.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1c2406ace0 msgr2=0x7f1c2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1c2406ace0 0x7f1c2406d190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009c40 tx=0x7f1c34008030 comp rx=0 tx=0).stop 2023-06-08T06:39:16.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 msgr2=0x7f1c441f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 0x7f1c441f2870 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800b470 tx=0x7f1c3800b780 comp rx=0 tx=0).stop 2023-06-08T06:39:16.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 shutdown_connections 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f1c2406ace0 0x7f1c2406d190 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c441606e0 0x7f1c440cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c440717f0 0x7f1c440c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 --2- 172.21.15.43:0/1207595097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c440b07d0 0x7f1c441f2870 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 >> 172.21.15.43:0/1207595097 conn(0x7f1c4406c160 msgr2=0x7f1c440caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 shutdown_connections 2023-06-08T06:39:16.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.409+0000 7f1c48ccc700 1 -- 172.21.15.43:0/1207595097 wait complete. 2023-06-08T06:39:16.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T06:39:16.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.649+0000 7f29a363a700 1 Processor -- start 2023-06-08T06:39:16.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.649+0000 7f29a363a700 1 -- start start 2023-06-08T06:39:16.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.650+0000 7f29a363a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f299c1606f0 0x7f299c06c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.650+0000 7f29a363a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f299c0ce440 0x7f299c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.650+0000 7f29a363a700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c160ac0 con 0x7f299c06af00 2023-06-08T06:39:16.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.650+0000 7f29a363a700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0cec20 con 0x7f299c0ce440 2023-06-08T06:39:16.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.650+0000 7f29a363a700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0ce940 con 0x7f299c1606f0 2023-06-08T06:39:16.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f299c1606f0 0x7f299c06c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f299c1606f0 0x7f299c06c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.43:52250/0 (socket says 172.21.15.43:52250) 2023-06-08T06:39:16.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 -- 172.21.15.43:0/1129710412 learned_addr learned my addr 172.21.15.43:0/1129710412 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:16.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 -- 172.21.15.43:0/1129710412 >> v2:172.21.15.43:3300/0 conn(0x7f299c0ce440 msgr2=0x7f299c06a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T06:39:16.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 --2- 172.21.15.43:0/1129710412 >> v2:172.21.15.43:3300/0 conn(0x7f299c0ce440 0x7f299c06a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 -- 172.21.15.43:0/1129710412 >> v1:172.21.15.43:6789/0 conn(0x7f299c06af00 legacy=0x7f299c070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 -- 172.21.15.43:0/1129710412 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c069ee0 con 0x7f299c1606f0 2023-06-08T06:39:16.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.651+0000 7f29a13d6700 1 --2- 172.21.15.43:0/1129710412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c1606f0 0x7f299c06c2b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f299c070470 tx=0x7f298c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f047a8e4202ba29 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.660+0000 7f2993fff700 1 -- 172.21.15.43:0/1129710412 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00b870 con 0x7f299c1606f0 2023-06-08T06:39:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.660+0000 7f2993fff700 1 -- 172.21.15.43:0/1129710412 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00b9d0 con 0x7f299c1606f0 2023-06-08T06:39:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.660+0000 7f2993fff700 1 -- 172.21.15.43:0/1129710412 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00bd60 con 0x7f299c1606f0 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.661+0000 7f29a363a700 1 -- 172.21.15.43:0/1129710412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c1606f0 msgr2=0x7f299c06c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.661+0000 7f29a363a700 1 --2- 172.21.15.43:0/1129710412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c1606f0 0x7f299c06c2b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f299c070470 tx=0x7f298c009bd0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.661+0000 7f29a363a700 1 -- 172.21.15.43:0/1129710412 shutdown_connections 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.661+0000 7f29a363a700 1 --2- 172.21.15.43:0/1129710412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c1606f0 0x7f299c06c2b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.661+0000 7f29a363a700 1 --2- 172.21.15.43:0/1129710412 >> v2:172.21.15.43:3300/0 conn(0x7f299c0ce440 0x7f299c06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.661+0000 7f29a363a700 1 -- 172.21.15.43:0/1129710412 >> 172.21.15.43:0/1129710412 conn(0x7f299c0cee30 msgr2=0x7f299c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:16.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.663+0000 7f29a363a700 1 -- 172.21.15.43:0/1129710412 shutdown_connections 2023-06-08T06:39:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.667+0000 7f29a363a700 1 -- 172.21.15.43:0/1129710412 wait complete. 2023-06-08T06:39:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.669+0000 7f29a363a700 1 Processor -- start 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.669+0000 7f29a363a700 1 -- start start 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a363a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c06af00 0x7f299c15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a363a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 0x7f299c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a363a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f299c1606f0 0x7f299c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a363a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0befd0 con 0x7f299c0ce440 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a363a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0b1e00 con 0x7f299c06af00 2023-06-08T06:39:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a363a700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0bf290 con 0x7f299c1606f0 2023-06-08T06:39:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a0bd5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 0x7f299c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a13d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c06af00 0x7f299c15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a0bd5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 0x7f299c14ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42408/0 (socket says 172.21.15.43:42408) 2023-06-08T06:39:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a0bd5700 1 -- 172.21.15.43:0/3247562007 learned_addr learned my addr 172.21.15.43:0/3247562007 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a13d6700 1 -- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f299c1606f0 msgr2=0x7f299c14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a13d6700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f299c1606f0 0x7f299c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a13d6700 1 -- 172.21.15.43:0/3247562007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 msgr2=0x7f299c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.670+0000 7f29a13d6700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 0x7f299c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f29a13d6700 1 -- 172.21.15.43:0/3247562007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009550 con 0x7f299c06af00 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f29a0bd5700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 0x7f299c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f29a13d6700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c06af00 0x7f299c15fcb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f298c016000 tx=0x7f298c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c004520 con 0x7f299c06af00 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c0036a0 con 0x7f299c06af00 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c0bf570 con 0x7f299c06af00 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c003a50 con 0x7f299c06af00 2023-06-08T06:39:16.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.671+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1601f0 con 0x7f299c06af00 2023-06-08T06:39:16.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.673+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f298c003bb0 con 0x7f299c06af00 2023-06-08T06:39:16.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.673+0000 7f2991ffb700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f298006ace0 0x7f298006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:16.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.674+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f298c08ad50 con 0x7f299c06af00 2023-06-08T06:39:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.674+0000 7f29a0bd5700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f298006ace0 0x7f298006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.675+0000 7f29a0bd5700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f298006ace0 0x7f298006d190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f299c0af780 tx=0x7f2998009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:16.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.678+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c073fa0 con 0x7f299c06af00 2023-06-08T06:39:16.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:16.684+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f298c055e30 con 0x7f299c06af00 2023-06-08T06:39:17.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.007+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f299c0bf3d0 con 0x7f299c06af00 2023-06-08T06:39:17.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.007+0000 7f2991ffb700 1 -- 172.21.15.43:0/3247562007 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f299c0bf3d0 con 0x7f299c06af00 2023-06-08T06:39:17.015 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-06-08T06:39:17.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.022+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f298006ace0 msgr2=0x7f298006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.022+0000 7f29a363a700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f298006ace0 0x7f298006d190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f299c0af780 tx=0x7f2998009210 comp rx=0 tx=0).stop 2023-06-08T06:39:17.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.022+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c06af00 msgr2=0x7f299c15fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.022+0000 7f29a363a700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c06af00 0x7f299c15fcb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f298c016000 tx=0x7f298c004750 comp rx=0 tx=0).stop 2023-06-08T06:39:17.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.026+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 shutdown_connections 2023-06-08T06:39:17.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.026+0000 7f29a363a700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f298006ace0 0x7f298006d190 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.026+0000 7f29a363a700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f299c1606f0 0x7f299c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.026+0000 7f29a363a700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f299c06af00 0x7f299c15fcb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.026+0000 7f29a363a700 1 --2- 172.21.15.43:0/3247562007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f299c0ce440 0x7f299c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.026+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 >> 172.21.15.43:0/3247562007 conn(0x7f299c0cee30 msgr2=0x7f299c0afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:17.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.032+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 shutdown_connections 2023-06-08T06:39:17.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.032+0000 7f29a363a700 1 -- 172.21.15.43:0/3247562007 wait complete. 2023-06-08T06:39:17.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T06:39:17.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.282+0000 7f3e30409700 1 Processor -- start 2023-06-08T06:39:17.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.286+0000 7f3e30409700 1 -- start start 2023-06-08T06:39:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e30409700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e280cd220 0x7f3e28071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e30409700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3e280b19a0 0x7f3e280ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:17.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e30409700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e28071320 con 0x7f3e28069db0 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e30409700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e28071600 con 0x7f3e280b19a0 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e30409700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e280ced70 con 0x7f3e280cd220 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e2e9a6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3e280b19a0 0x7f3e280ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.287+0000 7f3e2d9a4700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e280cd220 0x7f3e28071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3e280b19a0 0x7f3e280ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42416/0 (socket says 172.21.15.43:42416) 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/1925826054 learned_addr learned my addr 172.21.15.43:0/1925826054 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:17.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e1a5700 1 --1- 172.21.15.43:0/1925826054 >> v1:172.21.15.135:6789/0 conn(0x7f3e28069db0 0x7f3e2806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.43:52770/0 (socket says 172.21.15.43:52770) 2023-06-08T06:39:17.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/1925826054 >> v2:172.21.15.135:3300/0 conn(0x7f3e280cd220 msgr2=0x7f3e28071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 --2- 172.21.15.43:0/1925826054 >> v2:172.21.15.135:3300/0 conn(0x7f3e280cd220 0x7f3e28071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/1925826054 >> v1:172.21.15.135:6789/0 conn(0x7f3e28069db0 legacy=0x7f3e2806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/1925826054 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280cf050 con 0x7f3e280b19a0 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2e9a6700 1 --2- 172.21.15.43:0/1925826054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280b19a0 0x7f3e280ab8f0 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f3e280711a0 tx=0x7f3e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50393feefc4520f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2d1a3700 1 -- 172.21.15.43:0/1925826054 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000e070 con 0x7f3e280b19a0 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2d1a3700 1 -- 172.21.15.43:0/1925826054 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000b910 con 0x7f3e280b19a0 2023-06-08T06:39:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.288+0000 7f3e2d1a3700 1 -- 172.21.15.43:0/1925826054 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000bcc0 con 0x7f3e280b19a0 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.289+0000 7f3e30409700 1 -- 172.21.15.43:0/1925826054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280b19a0 msgr2=0x7f3e280ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.289+0000 7f3e30409700 1 --2- 172.21.15.43:0/1925826054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280b19a0 0x7f3e280ab8f0 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f3e280711a0 tx=0x7f3e2000b330 comp rx=0 tx=0).stop 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.290+0000 7f3e30409700 1 -- 172.21.15.43:0/1925826054 shutdown_connections 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.290+0000 7f3e30409700 1 --2- 172.21.15.43:0/1925826054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280b19a0 0x7f3e280ab8f0 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.290+0000 7f3e30409700 1 --2- 172.21.15.43:0/1925826054 >> v2:172.21.15.135:3300/0 conn(0x7f3e280cd220 0x7f3e28071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.290+0000 7f3e30409700 1 -- 172.21.15.43:0/1925826054 >> 172.21.15.43:0/1925826054 conn(0x7f3e2806aec0 msgr2=0x7f3e2806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:17.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.290+0000 7f3e30409700 1 -- 172.21.15.43:0/1925826054 shutdown_connections 2023-06-08T06:39:17.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.290+0000 7f3e30409700 1 -- 172.21.15.43:0/1925826054 wait complete. 2023-06-08T06:39:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.292+0000 7f3e30409700 1 Processor -- start 2023-06-08T06:39:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.292+0000 7f3e30409700 1 -- start start 2023-06-08T06:39:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e30409700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e28069db0 0x7f3e28156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e30409700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e280b19a0 0x7f3e280c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e30409700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 0x7f3e280c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e30409700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cb270 con 0x7f3e280cd220 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e30409700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cb550 con 0x7f3e28069db0 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e30409700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cb830 con 0x7f3e280b19a0 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 0x7f3e280c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 0x7f3e280c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42424/0 (socket says 172.21.15.43:42424) 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/3629633117 learned_addr learned my addr 172.21.15.43:0/3629633117 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e1a5700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e28069db0 0x7f3e28156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e280b19a0 msgr2=0x7f3e280c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e280b19a0 0x7f3e280c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e28069db0 msgr2=0x7f3e28156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e28069db0 0x7f3e28156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 -- 172.21.15.43:0/3629633117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009b30 con 0x7f3e280cd220 2023-06-08T06:39:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.293+0000 7f3e2e9a6700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 0x7f3e280c7330 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000b370 tx=0x7f3e20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:17.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.294+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20004930 con 0x7f3e280cd220 2023-06-08T06:39:17.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.294+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e200099b0 con 0x7f3e280cd220 2023-06-08T06:39:17.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.294+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2001c680 con 0x7f3e280cd220 2023-06-08T06:39:17.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.294+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e280cbb10 con 0x7f3e280cd220 2023-06-08T06:39:17.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.294+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e280c8d80 con 0x7f3e280cd220 2023-06-08T06:39:17.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.295+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e28073fa0 con 0x7f3e280cd220 2023-06-08T06:39:17.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.296+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e2001c7e0 con 0x7f3e280cd220 2023-06-08T06:39:17.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.297+0000 7f3e1effd700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3e0c06ace0 0x7f3e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T06:39:17.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.297+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3e2008b270 con 0x7f3e280cd220 2023-06-08T06:39:17.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.297+0000 7f3e2e1a5700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3e0c06ace0 0x7f3e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T06:39:17.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.298+0000 7f3e2e1a5700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3e0c06ace0 0x7f3e0c06d190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000f60 tx=0x7f3e24007ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T06:39:17.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.302+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e20056430 con 0x7f3e280cd220 2023-06-08T06:39:17.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.669+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e280b55d0 con 0x7f3e280cd220 2023-06-08T06:39:17.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.669+0000 7f3e1effd700 1 -- 172.21.15.43:0/3629633117 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3e20059a50 con 0x7f3e280cd220 2023-06-08T06:39:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3e0c06ace0 msgr2=0x7f3e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3e0c06ace0 0x7f3e0c06d190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000f60 tx=0x7f3e24007ed0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 msgr2=0x7f3e280c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 0x7f3e280c7330 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000b370 tx=0x7f3e20004ad0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 shutdown_connections 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:6832/298241574,v1:172.21.15.135:6833/298241574] conn(0x7f3e0c06ace0 0x7f3e0c06d190 secure :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000f60 tx=0x7f3e24007ed0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e280cd220 0x7f3e280c7330 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e28069db0 0x7f3e28156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 --2- 172.21.15.43:0/3629633117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e280b19a0 0x7f3e280c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T06:39:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.679+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 >> 172.21.15.43:0/3629633117 conn(0x7f3e2806aec0 msgr2=0x7f3e2806ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T06:39:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.680+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 shutdown_connections 2023-06-08T06:39:17.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-06-08T06:39:17.680+0000 7f3e30409700 1 -- 172.21.15.43:0/3629633117 wait complete. 2023-06-08T06:39:17.684 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-06-08T06:39:17.699 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-08T06:39:17.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T06:39:17.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-08T06:39:17.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T06:39:17.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T06:39:17.765 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-08T06:39:17.857 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-06-08T06:39:17.857 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T06:39:17.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=367 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.43:6789:/test /tmp/tmp.1Kn6ZLhw2Utest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=5ca92cbd-c0c8-4573-b70a-f139aab8d7d6,acl 0 0 2023-06-08T06:39:17.898 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-06-08T06:39:17.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T06:39:17.899 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-08T06:39:17.968 INFO:teuthology.orchestra.run.smithi043.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-08T06:39:17.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T06:39:17.969 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T06:39:17.969 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T06:39:18.089 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19943 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-08T06:39:18.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T06:39:18.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T06:39:18.089 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-08T06:39:18.164 INFO:teuthology.orchestra.run.smithi135.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-08T06:39:18.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T06:39:18.165 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-06-08T06:39:18.166 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T06:39:18.223 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19943 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-08T06:39:18.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-06-08T06:39:18.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T06:39:18.224 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-08T06:39:18.292 INFO:teuthology.orchestra.run.smithi135.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-08T06:39:18.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T06:39:19.900 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-08T06:39:19.901 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-08T06:39:19.901 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-08T06:39:19.902 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-08T06:39:19.902 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-08T06:39:19.902 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-08T06:39:19.903 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-08T06:39:19.903 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-08T06:39:19.903 INFO:tasks.ceph.mds.c:Sent signal 15 2023-06-08T06:39:19.904 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-08T06:39:19.904 INFO:tasks.ceph.mds.d:Sent signal 15 2023-06-08T06:39:19.904 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-08T06:39:19.905 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-08T06:39:19.905 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-08T06:39:19.905 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-08T06:39:19.906 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-08T06:39:19.906 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T06:39:19.901+0000 7faeecb4e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 115107) UID: 0 2023-06-08T06:39:19.906 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-06-08T06:39:19.901+0000 7faeecb4e700 -1 mds.a *** got signal Terminated *** 2023-06-08T06:39:19.907 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f3a4f6e3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 99524) UID: 0 2023-06-08T06:39:19.907 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f3a4f6e3700 -1 osd.1 44 *** Got signal Terminated *** 2023-06-08T06:39:19.907 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f3a4f6e3700 -1 osd.1 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.908 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f2caacdc700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 99189) UID: 0 2023-06-08T06:39:19.908 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f2caacdc700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-08T06:39:19.908 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f81ab7dd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 99534) UID: 0 2023-06-08T06:39:19.909 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f81ab7dd700 -1 osd.2 44 *** Got signal Terminated *** 2023-06-08T06:39:19.909 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-06-08T06:39:19.903+0000 7f81ab7dd700 -1 osd.2 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.909 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T06:39:19.902+0000 7fbd52849700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 115108) UID: 0 2023-06-08T06:39:19.909 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-06-08T06:39:19.902+0000 7fbd52849700 -1 mds.c *** got signal Terminated *** 2023-06-08T06:39:19.909 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:39:19.900+0000 7f2ad0054700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 99536) UID: 0 2023-06-08T06:39:19.910 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:39:19.900+0000 7f2ad0054700 -1 osd.3 44 *** Got signal Terminated *** 2023-06-08T06:39:19.910 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-06-08T06:39:19.900+0000 7f2ad0054700 -1 osd.3 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.985 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:39:19.981+0000 7fa7ef89e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 99423) UID: 0 2023-06-08T06:39:19.985 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:39:19.981+0000 7fa7ef89e700 -1 osd.7 44 *** Got signal Terminated *** 2023-06-08T06:39:19.985 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-06-08T06:39:19.981+0000 7fa7ef89e700 -1 osd.7 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.986 INFO:tasks.ceph.mon.b.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f3923a2d700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 98756) UID: 0 2023-06-08T06:39:19.986 INFO:tasks.ceph.mon.b.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f3923a2d700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-08T06:39:19.987 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f0a3bebe700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 99413) UID: 0 2023-06-08T06:39:19.987 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f0a3bebe700 -1 osd.4 44 *** Got signal Terminated *** 2023-06-08T06:39:19.987 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f0a3bebe700 -1 osd.4 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.988 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T06:39:19.981+0000 7f0e4bdb3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 99417) UID: 0 2023-06-08T06:39:19.988 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T06:39:19.981+0000 7f0e4bdb3700 -1 osd.5 44 *** Got signal Terminated *** 2023-06-08T06:39:19.988 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-06-08T06:39:19.981+0000 7f0e4bdb3700 -1 osd.5 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.989 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f6c29414700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 99420) UID: 0 2023-06-08T06:39:19.989 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f6c29414700 -1 osd.6 44 *** Got signal Terminated *** 2023-06-08T06:39:19.989 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f6c29414700 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T06:39:19.990 INFO:tasks.ceph.mon.c.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f222e8fc700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 98755) UID: 0 2023-06-08T06:39:19.990 INFO:tasks.ceph.mon.c.smithi135.stderr:2023-06-08T06:39:19.982+0000 7f222e8fc700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-08T06:39:19.990 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-06-08T06:39:19.983+0000 7f4c65343700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 107446) UID: 0 2023-06-08T06:39:19.991 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-06-08T06:39:19.983+0000 7f4c65343700 -1 mds.b *** got signal Terminated *** 2023-06-08T06:39:19.991 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-06-08T06:39:19.983+0000 7faf06696700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 107445) UID: 0 2023-06-08T06:39:19.991 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-06-08T06:39:19.983+0000 7faf06696700 -1 mds.d *** got signal Terminated *** 2023-06-08T06:39:20.107 INFO:tasks.ceph.mgr.y.smithi043.stderr:daemon-helper: command crashed with signal 15 2023-06-08T06:40:30.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:40:30.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:01.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:01.063 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:31.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:31.217 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:01.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:01.330 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:31.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:31.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:01.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:01.590 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:31.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:31.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:01.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:01.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:32.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:32.019 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:02.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:02.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:32.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:32.271 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:02.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:02.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:32.559 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:32.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:02.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:02.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:32.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:32.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:02.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:02.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:32.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:32.981 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:03.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:03.102 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:33.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:33.221 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:03.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:03.389 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:33.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:33.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:03.684 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:03.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:33.848 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:33.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:04.000 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:04.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:34.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:34.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:04.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:04.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:34.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:34.452 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:04.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:04.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:34.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:34.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:04.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:04.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:34.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:34.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:05.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:05.109 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:35.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:35.284 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:05.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:05.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:35.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:35.589 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:05.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:05.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:35.807 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:35.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:05.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:05.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:36.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:36.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:06.273 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:06.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:36.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:36.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:06.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:06.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:36.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:36.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:06.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:06.786 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:36.920 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:36.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:07.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:07.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:37.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:37.157 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:07.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:07.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:37.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:37.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:07.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:07.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:37.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:37.750 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:07.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:07.904 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:38.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:38.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:08.102 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:08.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:38.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:38.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:08.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:08.388 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:38.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:38.536 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:08.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:08.681 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:38.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:38.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:08.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:08.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:39.000 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:39.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:09.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:09.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:39.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:39.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:09.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:09.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:39.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:39.563 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:09.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:09.683 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:39.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:39.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:09.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:09.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:40.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:40.139 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:10.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:10.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:40.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:40.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:10.541 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:10.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:40.687 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:40.690 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:10.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:10.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:40.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:40.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:11.126 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:11.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:41.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:41.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:11.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:11.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:41.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:41.558 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:11.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:11.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:41.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:41.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:11.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:11.980 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:42.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:42.168 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:12.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:12.297 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:42.441 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:42.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:12.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:12.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:42.733 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:42.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:12.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:12.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:43.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:43.053 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:13.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:13.199 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:43.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:43.337 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:13.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:13.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:43.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:43.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:13.781 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:13.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:43.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:43.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:14.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:14.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:44.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:44.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:14.365 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:14.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:44.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:44.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:14.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:14.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:44.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:44.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:14.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:14.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:45.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:45.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:15.151 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:15.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:45.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:45.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:15.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:15.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:45.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:45.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:15.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:15.771 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:45.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:45.918 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:16.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:16.064 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:46.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:46.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:16.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:16.347 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:46.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:46.494 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:16.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:16.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:46.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:46.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:16.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:16.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:47.070 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:47.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:17.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:17.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:47.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:47.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:17.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:17.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:47.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:47.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:17.718 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:17.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:47.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:47.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:18.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:18.056 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:48.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:48.200 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:18.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:18.330 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:48.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:48.493 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:18.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:18.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:48.740 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:48.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:18.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:18.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:48.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:49.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:46:19.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:46:19.115 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:46:49.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:46:49.244 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:19.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:19.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:49.550 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:49.554 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:19.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:19.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:49.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:49.848 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:19.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:19.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:50.093 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:50.096 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:20.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:20.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:50.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:50.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:20.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:20.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:50.690 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:50.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:20.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:20.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:51.005 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:51.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:21.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:21.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:51.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:51.283 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:21.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:21.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:51.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:51.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:21.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:21.717 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:51.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:51.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:22.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:22.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:52.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:52.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:22.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:22.283 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:52.425 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:52.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:22.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:22.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:52.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:52.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:22.862 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:22.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:52.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:52.986 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:23.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:23.116 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:53.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:53.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:23.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:23.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:53.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:53.540 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:23.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:23.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:53.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:53.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:23.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:24.002 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:54.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:54.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:24.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:24.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:54.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:54.416 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:24.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:24.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:54.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:54.646 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:24.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:24.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:54.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:54.882 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:25.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:25.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:55.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:55.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:25.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:25.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:55.440 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:55.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:25.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:25.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:55.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:55.735 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:25.919 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:25.922 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:56.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:56.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:26.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:26.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:56.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:56.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:26.513 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:26.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:56.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:56.669 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:26.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:26.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:56.910 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:56.912 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:27.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:27.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:57.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:57.221 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:27.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:27.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:57.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:57.455 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:27.607 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:27.610 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:57.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:57.747 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:27.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:27.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:58.045 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:58.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:28.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:28.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:58.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:58.367 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:28.517 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:28.520 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:58.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:58.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:28.818 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:28.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:58.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:58.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:29.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:29.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:59.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:59.260 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:29.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:29.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:59.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:59.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:29.712 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:29.715 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:59.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:59.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:24:30.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:24:30.019 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:00.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:00.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:30.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:30.304 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:00.442 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:00.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:30.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:30.575 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:00.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:00.738 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:30.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:30.885 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:01.014 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:01.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:31.149 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:31.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:01.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:01.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:31.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:31.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:01.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:01.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:31.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:31.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:01.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:01.891 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:32.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:32.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:02.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:02.103 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:32.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:32.237 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:02.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:02.392 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:32.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:32.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:02.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:02.684 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:32.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:32.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:03.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:03.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:33.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:33.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:03.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:03.310 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:33.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:33.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:03.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:03.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:33.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:33.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:03.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:03.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:34.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:34.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:04.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:04.200 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:34.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:34.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:04.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:04.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:34.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:34.548 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:04.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:04.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:34.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:34.735 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:04.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:04.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:35.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:35.005 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:05.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:05.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:35.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:35.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:05.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:05.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:35.551 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:35.554 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:05.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:05.696 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:35.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:35.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:05.972 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:05.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:36.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:36.122 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:06.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:06.252 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:36.378 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:36.381 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:06.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:06.527 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:36.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:36.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:06.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:06.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:36.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:36.949 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:07.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:07.104 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:37.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:37.225 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:07.368 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:07.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:37.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:37.525 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:07.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:07.607 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:37.740 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:37.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:07.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:07.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:38.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:38.029 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:08.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:08.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:38.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:38.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:08.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:08.484 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:38.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:38.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:08.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:08.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:38.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:38.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:09.056 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:09.059 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:39.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:39.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:09.348 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:09.353 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:39.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:39.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:09.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:09.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:39.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:39.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:09.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:09.927 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:40.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:40.059 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:10.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:10.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:40.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:40.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:10.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:10.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:40.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:40.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:10.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:10.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:40.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:40.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:10.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:10.981 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:41.149 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:41.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:11.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:11.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:41.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:41.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:11.528 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:11.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:41.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:41.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:11.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:11.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:41.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:41.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:12.105 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:12.108 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:42.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:42.245 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:09:12.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:09:12.391 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:09:42.518 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:09:42.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:12.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:12.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:42.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:42.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:12.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:12.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:43.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:43.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:13.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:13.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:43.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:43.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:13.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:13.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:43.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:43.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:13.775 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:13.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:43.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:43.857 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:14.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:14.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:44.181 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:44.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:14.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:14.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:44.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:44.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:14.606 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:14.610 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:44.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:44.750 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:14.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:14.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:45.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:45.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:15.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:15.190 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:45.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:45.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:15.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:15.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:45.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:45.529 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:15.605 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:15.608 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:45.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:45.770 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:15.898 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:15.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:46.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:46.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:16.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:16.159 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:46.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:46.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:16.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:16.492 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:46.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:46.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:16.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:16.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:46.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:46.891 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:17.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:17.039 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:47.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:47.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:17.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:17.346 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:47.498 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:47.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:17.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:17.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:47.790 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:47.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:17.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:17.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:48.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:48.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:18.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:18.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:48.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:48.353 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:18.479 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:18.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:48.608 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:48.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:18.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:18.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:48.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:48.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:19.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:19.076 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:49.209 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:49.213 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:19.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:19.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:49.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:49.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:19.624 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:19.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:49.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:49.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:19.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:19.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:50.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:50.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:20.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:20.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:50.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:50.332 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:20.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:20.478 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:50.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:50.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:20.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:20.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:50.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:50.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:21.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:21.063 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:51.143 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:51.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:21.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:21.296 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:51.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:51.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:21.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:21.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:51.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:51.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:21.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:21.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:51.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:51.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:21.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:21.990 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:52.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:52.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:22.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:22.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:52.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:52.412 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:22.554 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:22.556 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:52.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:52.698 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:22.852 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:22.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:52.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:52.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:23.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:23.160 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:53.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:53.297 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:23.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:23.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:53.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:53.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:23.718 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:23.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:53.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:53.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:23.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:23.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:54.104 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:54.107 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:24.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:24.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:54.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:54.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:24.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:24.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:54.664 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:54.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:24.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:24.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:54.897 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:54.900 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:25.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:25.022 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:55.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:55.160 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:25.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:25.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:55.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:55.402 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:25.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:25.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:55.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:55.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:25.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:25.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:56.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:56.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:26.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:26.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:56.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:56.312 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:26.454 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:26.457 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:56.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:56.596 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:26.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:26.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:56.935 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:56.938 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:27.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:27.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:57.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:57.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:27.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:27.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:57.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:57.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:27.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:27.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:57.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:57.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:27.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:27.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:57.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:57.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:28.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:28.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:58.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:58.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:28.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:28.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:58.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:58.607 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:28.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:28.762 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:58.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:58.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:29.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:29.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:59.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:59.203 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:29.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:29.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:59.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:59.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:29.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:29.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:59.773 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:59.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:12:29.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:12:29.931 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:00.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:00.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:30.211 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:30.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:00.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:00.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:30.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:30.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:00.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:00.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:30.770 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:30.773 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:00.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:00.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:31.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:31.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:01.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:01.222 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:31.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:31.341 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:01.485 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:01.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:31.631 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:31.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:01.795 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:01.798 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:31.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:31.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:02.094 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:02.097 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:32.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:32.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:02.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:02.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:32.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:32.519 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:02.605 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:02.608 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:32.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:32.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:02.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:02.891 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:33.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:33.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:03.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:03.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:33.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:33.261 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:03.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:03.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:33.550 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:33.555 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:03.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:03.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:33.818 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:33.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:03.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:03.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:34.094 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:34.098 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:04.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:04.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:34.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:34.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:04.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:04.508 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:34.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:34.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:04.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:04.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:34.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:34.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:05.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:05.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:35.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:35.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:05.359 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:05.362 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:35.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:35.499 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:33:05.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:33:05.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:33:35.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:33:35.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:05.910 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:05.913 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:36.048 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:36.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:06.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:06.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:36.331 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:36.333 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:06.469 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:06.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:36.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:36.595 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:06.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:06.681 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:36.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:36.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:06.919 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:06.923 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:37.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:37.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:07.205 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:07.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:37.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:37.359 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:07.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:07.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:37.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:37.653 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:07.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:07.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:37.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:37.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:07.991 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:07.995 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:38.151 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:38.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:08.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:08.283 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:38.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:38.440 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:08.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:08.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:38.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:38.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:08.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:08.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:39.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:39.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:09.149 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:09.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:39.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:39.285 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:09.416 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:09.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:39.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:39.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:09.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:09.697 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:39.847 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:39.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:09.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:09.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:40.129 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:40.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:10.275 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:10.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:40.414 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:40.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:10.502 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:10.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:40.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:40.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:10.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:10.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:40.940 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:40.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:11.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:11.091 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:41.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:41.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:11.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:11.382 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:41.516 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:41.519 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:11.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:11.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:41.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:41.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:11.862 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:11.866 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:42.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:42.005 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:12.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:12.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:42.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:42.288 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:12.414 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:12.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:42.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:42.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:12.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:12.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:42.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:42.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:12.989 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:12.992 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:43.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:43.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:13.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:13.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:43.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:43.433 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:13.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:13.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:43.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:43.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:13.883 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:13.887 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:44.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:44.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:14.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:14.187 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:44.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:44.310 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:14.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:14.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:44.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:44.625 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:14.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:14.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:44.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:44.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:15.045 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:15.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:45.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:45.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:15.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:15.341 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:45.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:45.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:15.669 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:15.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:45.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:45.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:15.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:15.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:46.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:46.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:16.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:16.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:46.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:46.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:16.505 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:16.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:46.626 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:46.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:16.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:16.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:46.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:46.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:17.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:17.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:47.152 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:47.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:17.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:17.325 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:47.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:47.448 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:17.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:17.579 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:47.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:47.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:17.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:17.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:47.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:47.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:18.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:18.169 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:48.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:48.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:18.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:18.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:48.513 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:48.517 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:18.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:18.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:48.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:48.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:18.868 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:18.871 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:49.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:49.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:19.135 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:19.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:49.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:49.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:19.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:19.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:49.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:49.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:19.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:19.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:49.883 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:49.886 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:20.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:20.035 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:50.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:50.169 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:20.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:20.324 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:50.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:50.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:20.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:20.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:50.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:50.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:20.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:20.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:50.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:50.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:21.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:21.112 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:51.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:51.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:21.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:21.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:51.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:51.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:21.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:21.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:51.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:51.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:21.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:21.927 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:52.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:52.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:22.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:22.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:52.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:52.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:22.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:22.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:52.654 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:52.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:22.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:22.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:52.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:52.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:22.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:22.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:53.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:53.100 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:23.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:23.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:53.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:53.362 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:23.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:23.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:53.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:53.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:23.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:23.775 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:53.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:53.955 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:24.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:24.092 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:54.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:54.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:24.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:24.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:54.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:54.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:24.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:24.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:54.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:54.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:24.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:25.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:55.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:55.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:25.324 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:25.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:55.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:55.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:25.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:25.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:55.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:55.731 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:25.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:25.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:55.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:55.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:26.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:26.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:56.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:56.316 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:26.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:26.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:56.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:56.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:26.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:26.705 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:56.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:56.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:26.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:26.980 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:57.123 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:57.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:27.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:27.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:57.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:57.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:27.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:27.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:57.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:57.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:27.813 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:27.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:57.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:57.978 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:28.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:28.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:58.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:58.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:28.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:28.407 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:58.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:58.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:28.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:28.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:58.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:58.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:28.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:28.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:59.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:59.113 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:58:29.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:58:29.259 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:58:59.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:58:59.423 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:29.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:29.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:59.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:59.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:00:29.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:00:29.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:00.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:00.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:30.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:30.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:00.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:00.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:30.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:30.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:00.588 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:00.592 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:30.726 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:30.730 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:00.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:00.858 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:31.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:31.004 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:01.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:01.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:31.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:31.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:01.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:01.401 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:31.528 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:31.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:01.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:01.669 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:31.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:31.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:01.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:01.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:32.053 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:32.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:02.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:02.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:32.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:32.324 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:02.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:02.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:32.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:32.599 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:02.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:02.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:32.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:32.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:03.076 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:03.078 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:33.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:33.148 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:03.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:03.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:33.440 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:33.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:03.602 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:03.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:33.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:33.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:03.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:03.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:33.965 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:33.968 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:04.094 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:04.097 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:34.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:34.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:04.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:04.365 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:34.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:34.461 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:04.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:04.594 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:34.742 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:34.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:04.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:04.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:35.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:35.020 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:05.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:05.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:35.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:35.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:05.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:05.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:35.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:35.513 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:05.673 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:05.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:35.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:35.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:05.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:05.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:36.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:36.106 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:06.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:06.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:36.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:36.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:06.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:06.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:36.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:36.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:06.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:06.794 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:36.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:36.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:07.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:07.061 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:37.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:37.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:07.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:07.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:37.441 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:37.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:07.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:07.529 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:37.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:37.684 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:07.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:07.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:37.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:37.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:08.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:08.122 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:38.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:38.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:08.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:08.355 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:38.508 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:38.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:08.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:08.632 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:38.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:38.770 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:08.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:08.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:39.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:39.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:09.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:09.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:39.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:39.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:09.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:09.467 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:39.609 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:39.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:09.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:09.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:39.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:39.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:10.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:10.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:40.152 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:40.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:10.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:10.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:40.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:40.458 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:10.574 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:10.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:40.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:40.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:10.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:10.827 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:40.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:40.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:11.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:11.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:41.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:41.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:11.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:11.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:41.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:41.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:11.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:11.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:41.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:41.750 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:11.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:11.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:42.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:42.045 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:12.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:12.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:42.331 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:42.334 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:12.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:12.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:42.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:42.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:12.720 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:12.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:42.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:42.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:13.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:13.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:43.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:43.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:13.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:13.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:43.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:43.395 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:13.513 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:13.516 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:43.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:43.662 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:13.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:13.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:43.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:43.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:14.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:14.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:44.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:44.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:14.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:14.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:44.486 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:44.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:14.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:14.618 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:44.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:44.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:14.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:14.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:45.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:45.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:15.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:15.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:45.272 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:45.276 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:15.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:15.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:45.563 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:45.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:15.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:15.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:45.839 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:45.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:15.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:15.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:46.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:46.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:16.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:16.271 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:46.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:46.402 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:16.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:16.548 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:46.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:46.702 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:16.847 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:16.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:46.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:46.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:17.148 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:17.150 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:47.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:47.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:17.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:17.460 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:47.630 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:47.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:17.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:17.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:47.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:47.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:18.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:18.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:48.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:48.209 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:18.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:18.362 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:48.498 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:48.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:18.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:18.648 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:48.777 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:48.780 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:18.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:18.900 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:49.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:49.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:19.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:19.191 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:49.368 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:49.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:19.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:19.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:49.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:49.656 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:19.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:19.794 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:49.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:49.931 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:20.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:20.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:50.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:50.249 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:20.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:20.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:50.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:50.525 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:20.651 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:20.654 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:50.807 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:50.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:20.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:20.881 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:51.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:51.019 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:21.154 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:21.157 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:51.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:51.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:21.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:21.374 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:51.501 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:51.504 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:21.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:21.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:51.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:51.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:21.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:21.919 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:52.061 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:52.065 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:22.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:22.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:52.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:52.332 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:23:22.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:23:22.461 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:23:52.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:23:52.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:22.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:22.794 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:52.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:52.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:23.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:23.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:53.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:53.227 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:23.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:23.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:53.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:53.494 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:23.638 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:23.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:53.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:53.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:23.940 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:23.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:54.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:54.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:24.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:24.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:54.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:54.356 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:24.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:24.495 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:54.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:54.632 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:24.775 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:24.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:54.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:54.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:25.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:25.063 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:55.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:55.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:25.352 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:25.355 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:55.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:55.493 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:25.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:25.632 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:55.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:55.780 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:25.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:25.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:56.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:56.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:26.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:26.200 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:56.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:56.347 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:26.499 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:26.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:56.628 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:56.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:26.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:26.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:56.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:56.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:27.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:27.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:57.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:57.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:27.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:27.329 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:57.456 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:57.459 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:27.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:27.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:57.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:57.768 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:27.911 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:27.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:58.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:58.069 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:28.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:28.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:58.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:58.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:28.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:28.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:58.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:58.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:28.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:28.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:58.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:58.894 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:29.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:29.027 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:59.162 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:59.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:29.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:29.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:59.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:59.440 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:29.584 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:29.587 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:59.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:59.716 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:49:29.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:49:29.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:00.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:00.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:30.148 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:30.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:00.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:00.302 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:30.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:30.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:00.584 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:00.587 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:30.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:30.724 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:00.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:00.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:30.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:30.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:01.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:01.139 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:31.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:31.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:01.505 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:01.508 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:31.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:31.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:01.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:01.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:31.850 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:31.853 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:01.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:01.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:32.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:32.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:02.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:02.209 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:32.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:32.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:02.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:02.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:32.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:32.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:02.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:02.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:32.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:32.915 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:03.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:03.071 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:33.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:33.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:03.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:03.389 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:33.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:33.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:03.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:03.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:33.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:33.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:03.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:03.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:34.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:34.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:04.263 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:04.266 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:34.409 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:34.412 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:04.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:04.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:34.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:34.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:04.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:04.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:34.936 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:34.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:05.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:05.061 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:35.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:35.199 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:05.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:05.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:35.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:35.499 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:05.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:05.646 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:35.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:35.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:05.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:05.931 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:36.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:36.078 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:06.203 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:06.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:36.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:36.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:06.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:06.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:36.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:36.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:06.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:06.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:36.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:36.796 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:06.939 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:06.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:37.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:37.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:07.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:07.218 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:37.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:37.374 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:07.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:07.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:37.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:37.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:07.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:07.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:37.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:37.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:08.118 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:08.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:38.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:38.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:08.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:08.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:38.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:38.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:08.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:08.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:38.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:38.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:08.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:08.983 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:39.102 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:39.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:09.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:09.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:39.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:39.389 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:09.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:09.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:39.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:39.648 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:09.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:09.786 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:39.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:39.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:10.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:10.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:40.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:40.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:10.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:10.323 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:40.474 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:40.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:10.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:10.623 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:40.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:40.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:10.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:10.881 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:41.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:41.027 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:11.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:11.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:41.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:41.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:11.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:11.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:41.628 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:41.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:11.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:11.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:41.895 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:41.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:12.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:12.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:42.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:42.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:12.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:12.312 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:42.406 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:42.409 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:12.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:12.529 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:42.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:42.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:12.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:12.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:42.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:42.925 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:13.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:13.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:43.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:43.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:13.370 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:13.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:43.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:43.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:13.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:13.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:43.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:43.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:13.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:13.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:44.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:44.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:14.114 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:14.117 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:44.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:44.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:14.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:14.402 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:44.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:44.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:14.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:14.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:44.805 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:44.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:14.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:14.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:45.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:45.099 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:15.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:15.221 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:45.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:45.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:15.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:15.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:45.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:45.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:47:15.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:47:15.731 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:47:45.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:47:45.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:16.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:16.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:46.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:46.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:16.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:16.292 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:46.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:46.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:16.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:16.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:46.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:46.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:16.790 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:16.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:46.920 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:46.923 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:17.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:17.078 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:47.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:47.215 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:17.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:17.353 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:47.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:47.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:17.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:17.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:47.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:47.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:17.919 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:17.922 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:48.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:48.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:18.203 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:18.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:48.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:48.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:18.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:18.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:48.608 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:48.611 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:18.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:18.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:48.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:48.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:19.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:19.042 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:49.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:49.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:19.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:19.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:49.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:49.448 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:19.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:19.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:49.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:49.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:19.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:19.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:50.014 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:50.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:20.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:20.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:50.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:50.309 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:20.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:20.439 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:50.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:50.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:20.720 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:20.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:50.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:50.844 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:21.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:21.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:51.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:51.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:21.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:21.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:51.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:51.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:21.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:21.618 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:51.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:51.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:21.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:21.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:52.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:52.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:22.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:22.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:52.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:52.341 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:22.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:22.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:52.630 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:52.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:22.777 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:22.780 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:52.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:52.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:23.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:23.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:53.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:53.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:23.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:23.266 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:53.391 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:53.395 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:23.521 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:23.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:53.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:53.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:23.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:23.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:53.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:53.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:24.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:24.103 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:54.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:54.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:24.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:24.378 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:54.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:54.523 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:24.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:24.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:54.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:54.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:24.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:24.954 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:55.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:55.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:25.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:25.217 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:55.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:55.384 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:25.528 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:25.537 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:55.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:55.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:25.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:25.848 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:56.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:56.025 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:26.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:26.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:56.335 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:56.375 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:26.516 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:26.539 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:56.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:56.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:26.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:26.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:56.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:56.990 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:27.126 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:27.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:57.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:57.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:27.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:27.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:57.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:57.509 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:27.659 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:27.663 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:57.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:57.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:27.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:27.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:58.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:58.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:28.211 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:28.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:58.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:58.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:28.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:28.525 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:58.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:58.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:28.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:28.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:58.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:58.937 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:29.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:29.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:59.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:59.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:29.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:29.392 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:59.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:59.522 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:29.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:29.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:59.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:59.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:29.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:29.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:41.704 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-08T15:37:41.723 DEBUG:teuthology.task.console_log:Killing console logger for smithi043 2023-06-08T15:37:41.724 DEBUG:teuthology.task.console_log:Killing console logger for smithi135 2023-06-08T15:37:41.724 DEBUG:teuthology.exit:Finished running handlers